KR20070087318A - Remote controller and image display apparatus using the same - Google Patents

Abstract

A remote controller and an image display device using the remote controller are provided to input a written image in touch screen type to send the inputted image to a tablet image display apparatus, so that a user can easily input the written image. A storage(120) stores manual information on inputting of a written image. A touch screen(130) inputs the written image and various user commands for writing. A remote control unit(140) controls displaying of the manual information, and controls transmission of the written image inputted on the screen(130) as controlling transmission by constructing a format of written image data inputted through the screen(130). A display(150) displays the manual information delivered from the remote control unit(140).

Description

[0001] The present invention relates to a remote controller and an image display apparatus using the remote controller,

1 is a configuration diagram of a remote controller according to an embodiment of the present invention,

2 is a configuration diagram of a video display device according to an embodiment of the present invention,

FIG. 3 is a configuration diagram of a handwriting image generation unit according to FIG. 2,

4 shows a format of handwritten image data,

5 is a configuration diagram of a handwriting image combining unit according to FIG.

The present invention relates to an image display apparatus using a remote controller, and more particularly, to a remote controller having a touch screen type input function and an image display apparatus capable of storing and displaying a handwritten image input through the remote controller.

In recent years, a tablet video display device having a function of inputting a handwritten image on a screen of a video display device such as a television receiver or a computer monitor has been developed, for example, a tablet television receiver or a tablet monitor. We will divide into branches.

In the first method, the handwriting image is input directly on the screen, and the handwriting image is synthesized with the background image. In the other method, the writing board is disposed separately from the screen. When inputted, And then the television receiver or the main body of the computer synthesizes the received handwritten image with the background image of the screen and displays the synthesized handwritten image.

In general, since a tablet TV receiver is large in screen size, it is preferable to input a handwritten image directly on a screen for presentation, but since the screen area is large, the price of an input sensor such as an infrared ray or a video camera, There has been a problem in that it is inconvenient to record the contents described for a predetermined time, to encode it on a hard disk via a computer, to store it again on a television receiver.

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above problems, and it is an object of the present invention to provide an image display apparatus using a remote controller that allows a user to easily input a handwritten image by inputting a handwritten image using a touch screen method and transmitting the handwritten image to a tablet image display The purpose is to do.

According to an aspect of the present invention, there is provided an image display apparatus including decoding means for recovering a compressed image input according to a vertical / horizontal synchronizing signal; Generating a handwriting line by using the extracted point coordinates, generating a handwriting image input to the remote controller using the handwriting line, generating the handwriting image input from the remote controller by using the vertical / horizontal Handwritten image processing means for synthesizing the handwritten image generated by the background image, which is the image restored according to the synchronization signal; Control means for controlling output of the composite image combined with the reconstructed image; And output means for selectively outputting and displaying the synthesized image synthesized with the reconstructed image under the control of the control means.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a remote controller according to an embodiment of the present invention.

Referring to FIG. 1, the remote controller 100 of the present invention includes a button pad 110 for inputting a user command, a storage unit 120 for storing various information and execution programs, A remote controller 140 for controlling various functions including channel switching of the television receiver and controlling the input of a handwritten image, and a controller 140 for displaying various images and / or characters transmitted from the remote controller 140 And an infrared light emitting unit 160 for converting various signals transmitted from the remote control unit 140 into infrared signals and transmitting them to the outside.

The button pad 110 includes a power button for turning on / off the power of the image display device, buttons for setting functions related to the handwritten image, and buttons for controlling functions of the image display device.

The storage unit 120 stores an executable program for handwritten images and an execution program for controlling functions other than handwritten images among the functions of the image display apparatus and stores various manual information related to handwritten images, Various manual information for setting is stored.

For example, the storage unit 120 stores manual information related to the handwriting image color such as red (R), green (G), and blue (B), manual information on the font size of the handwritten image, , Manual information on figures and symbols to be written on the image display device, and manual information on paper patterns such as a document or a line for writing on the image display device. The storage unit 120 stores manual information for setting the VCR function, the set-top box function, and the DVD function of the image display apparatus.

The touch screen 130 is disposed opposite to the upper portion of the display unit 150 and informs the remote control unit 140 of a manual selected by touching with a finger or a touch pen among the manual information displayed on the display unit 150.

The remote control unit 140 controls the various functions including the handwriting image function of the image display device by selectively executing the execution programs stored in the storage unit 120 according to the user's instructions. More specifically, the remote control unit 140 will be described below.

If the user selects one of the VCR function, the STB function, and the DVD function of the image display apparatus through the touch screen 130, for example, the VCR function, the remote control unit 140 displays the VCR And transmits the VCR function control signal to the infrared ray emitting unit 160. The VCR function control signal is transmitted to the infrared ray emitting unit 160 through the infrared communication signal system.

When the character or the image inputted by the user is displayed on the touch screen 130, the remote control unit 140 recognizes the point coordinates (X coordinate and Y coordinate) of the character or image displayed on the touch screen 130 and recognizes Converts a point coordinate value into a pulse signal, converts the pulse signal into an infrared communication signal system, and transmits the pulse signal to the infrared light emitting unit 160. Here, the remote control unit 140 senses the point coordinate value displayed on the touch screen 130 by about 150 times per second and recognizes the two-dimensional to three-dimensional touch position, so that the pulse signal of the point coordinate value is two- It is a signal indicating the touch position. And, the three-dimensional data represents the horizontal, vertical, and writing pressure, and the pressure value is used for scratching the writing line.

In addition, the point coordinate values recognized by the remote control unit 140 have values of 12 to 14 bits in the horizontal (X-axis) and vertical (Y-axis), respectively, according to the resolution of the image display device. These values are actually scaled according to the resolution of the image display device, and the range of values to be scaled is determined according to the resolution of the screen, for example, 1024x768, 1366x768, 1920x1080, and the like. In particular, the remote control unit 140 constructs a format of handwritten image data input through the touch screen 130 and transmits the handwritten image data to the image display apparatus.

The display unit 150 may be implemented as a liquid crystal display (LCD), and is positioned at a lower portion of the touch screen 130, but facing the touch screen 130.

The infrared ray emitting unit 160 converts the pulse signal transmitted from the remote controller 140 into an infrared signal and transmits the infrared signal to the image display apparatus. In the present invention, the remote controller 100 is implemented to transmit an infrared signal. However, the wireless transmission method is not limited thereto, and Bluetooth communication or radio frequency communication method may be applied.

The configuration and function of the image display apparatus of the present invention for displaying handwritten images input through the remote controller of the present invention having the above-described configuration and function will be described below.

2 is a block diagram of an image display apparatus according to an embodiment of the present invention.

2, an image display apparatus 200 according to the present invention includes an infrared ray receiving unit 210-1 for receiving an infrared signal, a handwritten coordinate extracting unit 210-2 for extracting a point coordinate, A handwriting image generation unit 210-4 for generating a handwriting image, a memory 210-5 for storing a handwriting image, a handwriting image generation unit 210-3 for generating a handwriting image, A handwritten image synthesis unit 210-6 for synthesizing a handwritten image, an image decoder 220 for decoding an input image, an MPEG decoder 230 for recovering a compressed image, A hard disk driver (HDD) 250 for storing a compressed synthesized image, a main controller 260 for controlling the display of an image, a synthesized image A multiplexer 270 for selectively outputting the reconstructed image, And the image processing unit 280 for scaling the image, and a display unit 290 for displaying the scaled image.

The infrared light receiving unit 210-1 converts the infrared signal received from the remote controller 100 into a signal system suitable for the handwriting coordinate extraction unit 210-2 and the main control unit 260 and outputs the handwriting coordinate extraction unit 210-2 And outputs it to the main control unit 260.

The handwritten coordinate extracting unit 210-2 extracts the point coordinates (X coordinate and Y coordinate) of the pulse signal received via the infrared ray receiving unit 210-1 and outputs it to the handwritten line generating unit 210-3.

The handwriting line generation unit 210-3 generates a handwriting line by connecting the point coordinates extracted by the handwriting coordinate extraction unit 210-2 with a solid line and then transmits the handwriting line to the handwriting image generation unit 210-4 Output. Here, the handwriting-line creating unit 210-3 separates and outputs the attribute data (line thickness, handwriting image color, eraser, etc.) in the extracted point coordinates.

The handwritten image generation unit 210-4 generates a handwritten image in accordance with the vertical / horizontal synchronization signal provided from the image decoder 220, The handwritten image generated after the handwritten image is generated is stored in the memory 210-5 on a frame-by-frame basis. The handwriting image generation unit 210-4 generates a storage control signal for controlling the storage of the generated handwriting image signal and outputs the storage control signal to the memory 210-5.

The memory 210-5 stores a handwritten image written by the handwritten image generation unit 210-4 and stores a synthesized image of a background image and a handwritten image written by the handwritten image synthesis unit 210-6 do.

The handwritten image synthesis unit 210-6 synthesizes the handwritten image stored in the memory 210-5 and the TV image reconstructed by the MPEG decoder 230 according to the vertical and horizontal synchronization signals provided from the image decoder 220, The TV image reconstructed by the MPEG decoder 230 is processed as a background image and the handwritten image read from the memory 210-5 is overlapped with the background image to synthesize the background image and the handwritten image And generates an image. Then, the handwritten image synthesis unit 210-6 outputs the synthesized image to the MPEG encoder 240 and the multiplexer 270.

The video decoder 220 converts the TV analog video signal inputted according to the control of the main controller 260 into a digital video signal and outputs it to the MPEG decoder 230 to separate and extract the color difference signal from the TV video signal MPEG decoder 230, and outputs the vertical / horizontal synchronizing signal of the TV image signal to the handwriting image generating unit 210-4 and the handwriting image synthesizing unit 210-6.

The MPEG decoder 230 restores the TV compressed image decoded by the video decoder 220 according to the control of the main controller 260 and outputs it to the handwritten image synthesizer 210-6 and the multiplexer 270. [ The MPEG decoder 230 reads the composite image stored in the hard disk driver 250 under the control of the main controller 260, restores the compressed composite image, and outputs the compressed composite image to the multiplexer 270.

The MPEG encoder 240 compresses the image synthesized by the handwritten image synthesis unit 210-6 by the MPEG compression method and stores the compressed image in the hard disk driver 250.

The hard disk driver 250 stores the compressed composite image recorded by the MPEG encoder 240. [

The main control unit 260 controls the output of the TV image in accordance with the user's instruction inputted through the remote controller 100 and controls the combination of the TV image and the handwritten image and also outputs the TV image and the composite image .

The multiplexer 270 selectively outputs an image reconstructed by the MPEG decoder 230 or an image synthesized by the handwritten image synthesis unit 210-6 under the control of the main control unit 260. [

The image processing unit 280 scales the TV image and composite image output from the multiplexer 270 and displays the scaled image on the display unit 290.

3 is a configuration diagram of a handwriting image generation unit according to FIG.

3, the handwriting image generation unit 210-4 includes an address generation unit 211-1 for generating an address, a storage control signal generation unit 211-2 for generating a storage control signal, A handwriting image generation control unit 211-3 for controlling the generation of the handwriting image, a handwriting processing unit 211-4 for processing the handwriting line, and a resolution scaling unit (scaling unit) A memory 211 - 7 for storing the start and end coordinates of the line, a memory 211 - 3 for storing the start and end coordinates of the line, A note form combining unit 211-9 for combining the handwritten data with the generated note form, and a blending rate (%) occupied by the handwriting data on the screen And a handwritten blending bit combining unit 211-10 for specifying the handwriting blending bit.

The address generating unit 211-1 generates an address according to the vertical / horizontal synchronizing signal provided from the video decoder 220 and outputs the address to the storage control signal generating unit 211-2, the note form generating unit 211-8, And outputs it to the form combining unit 211-9.

The storage control signal generator 211-2 generates a storage control signal when the address is inputted from the address generator 211-1 and outputs the storage control signal to the memory 210-5 and simultaneously outputs the inputted address to the memory 210-5 ).

The handwriting image generation control section 211-3 processes the thickness, color, or eraser of the handwriting line according to the handwriting attribute data (line thickness, color of the handwriting image, eraser, etc.) input from the handwriting line generation section 210-3 And controls the handwriting processing section 211-4.

The handwriting processing unit 211-4 processes the handwriting line source data input from the handwriting line generation unit 210-3 so that the handwriting image generation control unit 211-3 generates a handwriting line in accordance with the attribute data designated to be processed And outputs it to the resolution scaling unit 211-5. For example, the handwriting processing unit 211-4 may process the color and thickness of the handwriting line so as to match the line color and line thickness designated by the handwriting image generation control unit 211-3, -3) specifies line eraser to erase handwriting line. Here, when the handwriting line is eraser-processed, the corresponding handwriting line displayed on the display unit 290 is erased.

The resolution scaling unit 211-5 processes the resolution of the handwritten image processed by the handwriting processing unit 211-4 according to the vertical / horizontal synchronizing signal provided from the image decoder 220, (290).

The line processing unit 211-6 smoothes the line by shaping the line scaled by the resolution scaling unit 211-5, and then anti-aliasing the line again, . Here, the line processing unit 211-6 scans the high frequency portion of the handwriting image so as to softly curve the line, and aligns the line according to the start and end coordinates of the stroke stored in the memory 211-7 to anti-aliasing -aliasing.

The memory 211-7 stores the start and end coordinates of one stroke inputted from the line processing unit 211-6.

The note form generation unit 211-8 generates a predetermined note form when the address is inputted from the address generation unit 211-1, and outputs the predetermined note form to the note form synthesis unit 211-9.

The note form combining unit 211-9 overlaps the handwritten data generated by the note form generating unit 211-8 with the preprocessing and anti-aliasing data by the line processing unit 211-6, Bit combining unit 211-10.

The handwriting blending bit combiner 211-10 combines the handwriting data overlapped with the note form by the note form combining unit 211-9 into the background image at the handwriting image combining unit 210-6, (%) To be displayed on the screen. At this time, the blending ratio (%) of the handwritten data specified by the handwriting blending bit combiner 211-10 is stored in the memory 210-5. Here, the handwriting blending bit combiner 211-10 compares the blending ratio (%) in which the handwriting data is displayed on the screen according to the blending bit formed in the format of the handwriting image data shown in FIG. 4, .

In particular, the format of the handwritten image data shown in FIG. 4 is recorded with 32 bits. The format of the handwritten image data includes the thickness of the handwriting line, the blending bit, the color (R, G, B) Coordinates are constructed. Here, the writing line drawing, the blending bit, the color, the vertical coordinate, and the horizontal coordinate are information inputted by the user through the remote controller 100. The format of the writing image data is constructed by the remote controller 100, 200).

5 is a configuration diagram of a handwriting image combining unit according to FIG.

5, the handwriting image combining unit 210-6 includes a blending ratio determining unit 212-1 for determining a blending ratio of a handwritten image, a multiplier for multiplying handwriting image data and a blending ratio, Multipliers 212-5 to 212-7 for correspondingly multiplying the TV image data R, G and B with the blending ratios on a one-to-one basis, multipliers 212-1 to 212-4, 212-2 and 212-5 and an adder 212-8 for adding the image data multiplied by the multipliers 212-3 and 212-6, An adder 212-10 for adding the image data multiplied by the multipliers 212-4 and 212-7, a storage control signal generator 212-11 for generating a storage control signal, .

The blending ratio determination unit 212-1 determines the color of the handwritten image to be displayed by analyzing the color bits constructed in the format of the handwritten image data in Fig. 4, And determines the blending ratio of the handwritten image data and the TV image data. For example, if the blending ratio of the handwritten image data is 30%, the blending ratio of the TV image data that is background image data is 70%.

The multiplier 212-2 multiplies the handwriting image data by the blending ratio output from the blending ratio determination unit 212-1 and outputs the product to the adder 212-8. If the color of the handwritten image data determined by the blending ratio determining unit 212-1 is R and the blending ratio is 30%, the multiplier 212-2 multiplies the blending ratio 30% by the handwriting image data And outputs it to the adder 212-8. If the color of the handwritten image data determined by the blending ratio determining unit 212-1 is G or B, the blending ratio determining unit 212-1 outputs '0' to the multiplier 212-2 This corresponds to the case where the handwritten image data of R is not displayed.

The multiplier 212-3 multiplies the blending ratio output from the blending ratio determination unit 212-1 by the handwriting image data and outputs the product to the adder 212-9. If the color of the handwritten image data determined by the blending ratio determining unit 212-1 is G and the blending ratio is 30%, the multiplier 212-3 multiplies the blending ratio 30% by the handwriting image data And outputs it to the adder 212-9. If the color of the handwritten image data determined by the blending ratio determining unit 212-1 is R or B, the blending ratio determining unit 212-1 outputs '0' to the multiplier 212-3 This corresponds to the case where the handwritten image data of G is not displayed.

The multiplier 212-4 multiplies the blending ratio output from the blending ratio determination unit 212-1 by the handwriting image data and outputs the product to the adder 212-10. Here, if the color of the handwritten image data determined by the blending ratio determining unit 212-1 is B and the blending ratio is 30%, the multiplier 212-4 multiplies the blending ratio 30% by the handwriting image data And outputs it to the adder 212-10. If the color of the handwriting image data determined by the blending ratio determination unit 212-1 is R or G, the blending ratio determination unit 212-1 outputs '0' to the multiplier 212-4 This corresponds to the case where the handwritten image data of B is not displayed.

The multiplier 212-5 multiplies the blending ratio output from the blending ratio determination unit 212-1 by the background image data, which is TV image data for R, and outputs the result to the adder 212-8. Here, if the blending ratio determining unit 212-1 determines that the blending ratio of the handwritten image data output to the multiplier 212-2 is 30%, the R image data for R output to the multiplier 212-5 The blending ratio is 70%.

The multiplier 212-6 multiplies the blending ratio output from the blending ratio determination unit 212-1 by the background image data, which is G image data for TV, and outputs the product to the adder 212-9. If the blending ratio determining unit 212-1 determines that the blending ratio of the handwritten image data output to the multiplier 212-3 is 30%, the G image data to be output to the multiplier 212-6 The blending ratio is 70%.

The multiplier 212-7 multiplies the background image data, which is the TV image data of B, with the blending ratio output from the blending ratio determination unit 212-1, and outputs the result to the adder 212-10. Here, if the blending ratio determining unit 212-1 determines that the blending ratio of the handwritten image data output to the multiplier 212-4 is 30%, the B image data for B output to the multiplier 212-7 The blending ratio is 70%.

The adder 212-8 adds the handwritten image data having the blending ratio multiplied by the multiplier 212-2 to the background image data of the R having the blending ratio multiplied by the multiplier 212-5, And outputs the video signal of the R signal. Here, if the blending ratio of the handwritten image data is 30% and the blending ratio of the background image data of R is 70%, the blending ratio of the synthesized R image signal becomes 100%.

The adder 212-9 adds the handwritten image data having the blending ratio multiplied by the multiplier 212-3 to the background image data of the G having the blending ratio multiplied by the multiplier 212-6, And outputs the video signal of the G Here, if the blending ratio of the handwritten image data is 30% and the blending ratio of the background image data of G is 70%, the blending ratio of the synthesized G image signal becomes 100%.

The adder 212-10 adds the handwritten image data having the blending ratio multiplied by the multiplier 212-4 and the background image data of B having the blending ratio multiplied by the multiplier 212-7, And outputs the video signal of B Here, if the blending ratio of the handwritten image data is 30% and the blending ratio of the background image data of B is 70%, the blending ratio of the synthesized B image signal becomes 100%.

The storage control signal generator 212-11 generates a storage control signal in response to the vertical / horizontal synchronization signal input from the video decoder 220 and outputs the storage control signal to the memory 210-5. This storage control signal controls the memory 210-5 to store the handwritten image data synthesized by the handwritten image synthesis unit 210-6.

It is to be noted that the technical idea of the present invention has been specifically described in accordance with the above preferred embodiment, but the above-mentioned embodiments are intended to be illustrative and not restrictive. In addition, it will be understood by those of ordinary skill in the art that various embodiments are possible within the scope of the technical idea of the present invention.

As described above, according to the present invention, a video display device such as a tablet-television receiver or a computer monitor stores and displays a handwritten image directly input through a touch-screen remote controller to display and display various kinds of information in various seminars and presentations, The user can easily store his / her opinion in the image display device as a handwritten image by using only the remote control possessed by the user.

Claims (9)

A storage unit for storing manual information related to an input of a handwritten image; A touch screen for inputting various user commands for handwriting images and handwriting; A remote controller for controlling the display of the manual information, controlling transmission of a handwritten image input to the touch screen, constructing a format of handwritten image data input through the touch screen, and controlling transmission; And And a display unit for displaying the manual information transmitted from the remote control unit. The method according to claim 1, Wherein the touch screen is disposed to face the upper portion of the display unit. The method according to claim 1, Wherein the remote control unit recognizes a point coordinate value of a character or an image displayed on the touch screen, and converts the point coordinate value into a pulse signal to be transmitted. 4. The method according to any one of claims 1 to 3, Wherein the format of the handwritten image data constructed by the remote control unit is formed by the thickness of the handwritten image, the blending bit, the color of the handwritten image, the vertical coordinate, and the horizontal coordinate. Decoding means for recovering a compressed image input in accordance with the vertical / horizontal synchronizing signal; Generating a handwriting line using the extracted point coordinates, generating a handwriting image input to the remote controller using the handwriting line generated, extracting a handwriting image received from the remote controller, Handwritten image processing means for synthesizing a handwritten image data format and the generated handwritten image with the background image, which is the image restored according to the vertical / horizontal synchronization signal; Control means for controlling output of the composite image combined with the reconstructed image; And And output means for selectively outputting and displaying the synthesized image synthesized with the reconstructed image under the control of the control means. 6. The method of claim 5, Encoding means for compressing the image synthesized by the handwritten image synthesis unit; And storage means for storing the composite image compressed by the encoding means; Further comprising a display unit for displaying the image. 6. The method of claim 5, Wherein the handwritten image processing means comprises: A handwritten coordinate extractor for extracting a point coordinate of a handwritten video signal received from the remote controller; A handwriting line generation unit for generating a handwriting line by connecting the extracted point coordinates with a solid line; A handwriting image generation unit for generating a handwriting image input to the remote controller using the handwriting line generated according to the vertical / horizontal synchronization signal; A memory for storing the handwriting line and the composite image generated by the handwriting image generation unit; And a handwriting image synthesizer for generating the synthesized image by overlapping the handwritten image read from the memory with the background image reconstructed according to the vertical / horizontal synchronization signal, and storing the synthesized image in the memory And the video display device. 8. The method of claim 7, Wherein the handwritten image generating unit comprises: An address generator for generating an address according to the vertical / horizontal synchronizing signal; A storage control signal generator for generating a storage control signal output to the memory as the address is input; A handwriting image generation control unit for controlling processing of a handwriting line according to handwriting attribute data input from the handwriting line generation unit; A handwriting processing unit for processing a handwriting line input from the handwriting line generation unit in accordance with the attribute data designated by the handwriting image generation control unit to be processed; A resolution scaling unit for scaling a resolution of the handwritten image processed by the handwriting processing unit according to the vertical / horizontal synchronizing signal; A line processor for smoothly curving the line by scaling the line scaled by the resolution scaling unit and anti-aliasing to soften the surface of the line; A memory for storing start and end coordinates of a stroke input from the line processing unit; A note form generating unit for generating a predetermined note form as the address is input; A note form synthesizer for overlapping the handwritten data, which has been subjected to shaping and anti-aliasing by the line processor, on the note form; And a handwriting blending bit combining unit for specifying a blending ratio in which the handwritten data overlapping the note form is displayed on the screen. 6. The method of claim 5, Wherein said output means comprises: A multiplexer for selectively outputting the composite image synthesized with the reconstructed image under the control of the control means; An image processor for scaling an image signal output through the multiplexer; And A display unit for displaying a video signal scaled by the image processing unit, And a display device.

Images