KR20060016714A - A mobile phone for remote controlling a electronic product by using 2-dimensional barcode symbology - Google Patents

Abstract

The present invention captures and decodes a control code embedded in a two-dimensional bar code symbol with a mobile phone (cellular phone, PDA, smartphone, etc.) having a digital camera function and a wireless communication function by an infrared LED. It relates to a system that can be used as a remote control of an electronic product.

First, the output signal information of the remote controller device, that is, the head length, is displayed on the 2D barcode symbol. Code (parameter) the product code, the code value corresponding to the key (custom code) value, and pulse information for 1 and 0, and use the mobile phone equipped with digital camera function and infrared communication function. After the gap, the code value is decrypted. The information obtained through the decoding is converted into an output signal (streaming) for the remote control, and a signal is transmitted through an infrared LED to implement a remote control function. The remote controller function provided by the existing mobile phone provides a function limited to a pre-programmed model, and there is a difficulty to download a control program every time a third-party electronic product and a new product are released. There are a number of electronic products in the home, and the method of the present invention makes it easy to register the code values of the products directly to the mobile phone through the two-dimensional barcode symbol, which is convenient to use as an auxiliary remote controller. For example, when a lot of people are together in a karaoke room, it is possible to select a song after recognizing the barcode with their mobile phones. Recent mobile phones are equipped with a camera sensor for image capture and infrared LED (Infrared LED) for wireless communication, so it is possible to achieve the function of the present invention only by installing firmware (Firmware) without any additional hardware burden. In addition, a character input device is required to write characters on the large screen using LCD TV and PDP TV, or to use the Internet, but it is difficult to use a conventional remote controller, and there is a price burden to produce a dedicated remote control. This can also be easily solved by using a key on the mobile phone.

The overall configuration of the present invention is a two-dimensional barcode image capture portion 101; A part 104 for converting this into a code value using decoding software; A signal generation portion 105 for generating binary data for the remote control using the obtained information; An infrared ray transmitter 102 for outputting a signal through a built-in infrared ray LED; The display unit 103 shows a bar code symbol, a decrypted code value or a description of a key on the screen of the mobile phone.

2D barcode symbol, mobile phone, infrared LED, remote control

Description

A mobile phone for remote controlling a electronic product by using 2-dimensional barcode symbology}

1 is a remote control process using a two-dimensional barcode symbol and a mobile phone,

2 is a two-dimensional bar code decryption and transmission process in a mobile phone,

3 is an overall signal processing process of the present invention,

4 is a configuration diagram of a bitstream encoded with a two-dimensional barcode;

The present invention relates to a method of controlling an electronic product by infrared wireless communication using a portable camera phone, a mobile phone (cellular phone, PDA, smart phone). The code value of the remote controller for electronic products is converted into a 2D barcode symbol, attached to the product or a manual, and shipped. The user captures a 2D barcode image using a camera built into the mobile phone. In the semiconductor processor (RISC), binarization process-Error correction process (Reed-Solomon and BCH)-Decoding process to recover the code and use it to generate a bitstream signal for the control signal like the function of the remote control Sends signal through LED (Infrared LED). Since the barcode attached to the electronic product is directly recognized, the user can select the product model and directly use the remote controller in the recognized state. Since most electronic products have their own remote controllers, they can't be used due to battery life, device failure, etc. When used in the present invention, a mobile phone is always a portable device and can be used as a separate remote control by storing it as an easy-to-find storage number in the device like a phone number registration. In the future, if new products use a code system using two-dimensional bar code symbols, the mobile phone can be used as a universal remote control regardless of nationality, company or product.

In the existing product, there is a program for the remote control, or a program suitable for a new product can only be downloaded from the Internet to perform a remote control function. Since the company, product, model name is selected and operated on the display screen of the mobile phone, there are many problems in use depending on the user hierarchy. In addition, there is a problem of product registration between electronic products and mobile phone manufacturers. In today's society, all electronic products have complicated functions and each product has its own remote control, which makes it difficult to manage and emergency emergency remote control is absolutely necessary.

According to the present invention, a control code value capable of performing a remote control function is converted into an efficient two-dimensional barcode symbol (QR, DataMatrix, PDF-417) and attached to a product or enclosed in a manual. The phone can be scanned (captured) and decoded to generate a signal. Therefore, the mobile phone should have a program that can completely decode the 2D barcode symbol and a signal processing program that converts the control signal for the remote control using the code value. In particular, since the camera embedded in the mobile phone is a color image sensor, it has limitations depending on lighting and distance. The image must be converted to grayscale level, captured at a higher resolution, then resized, and the decoding program must use an algorithm that matches the sensor characteristics and ambient brightness.

The present invention for controlling electronic products using a mobile phone captures and captures a two-dimensional barcode symbol attached or attached to the electronic product with an image camera in the mobile phone, and decodes it with an embedded microprocessor (RISC). If you look at the simplified picture [Fig. 1], the two-dimensional barcode symbol 100 having a code value is captured using the camera image sensor 101, and the captured image is binarized (0 and 1). Perform the next error correction (Reed-Solomon and BCH). When the operation is completed normally, the desired bitstream code is generated. If you remove the header and error correction code necessary for the operation, only the code value data remains. This code value data is stored as a code value to be used or used as an electronic product control code if necessary. A key (button) in the mobile phone is used as a user input means. That is, it is used for power ON / OFF, channel change, arrow key, character input, etc. The code value is converted into a control signal through the signal processing operation 105 and transmitted to the outside through the infrared LED 102 to control the electronic product 106.

As shown in FIG. 4, the data array of the two-dimensional barcode symbol has a Version and Format information bit string 400, an encoded data string 401, an error correction bit string 402, and a blank space filling for a two-dimensional barcode analysis. Bit string 403, and a bit string 404 indicating the end. The encoded data bit string is a code value necessary for a signal for a remote controller. It consists of Header bits (405) indicating the information of the bit string constituting the code value, a product code (or address) 406, and a Custom code (407) indicating the key value, followed by a complementary code depending on the company. It is also attached. It is not a problem to generate these control signals if the company uses a slightly different form or header information.

And most electronics makers have a constant stream of bit streams, and since they express uniform expressions for 0 and 1, you can save and use company-specific timing values in advance.

Currently available 2D barcode symbols can be PDF-417, DataMatrix, or QR registered in international standards, but the resolution of video input sensor is easy to use 640 * 480, 800 * 600 or 1024 * 768 resolution. For this reason, using a barcode symbol in the shape of a square such as DataMatrix or QR improves the recognition rate. Using 2D barcodes corrects errors in decoding up to 30%, even if stained or torn. Restoration is possible. In addition, since the barcode system includes a reed-solomon error correction word and a BCH error correction bit in the code, a separate check bit or an error correction code may not be inserted in the data bits 401. This means that the decrypted data cannot come out with wrong values. In the code that determines the presence of an error by using only the checksum like the one-dimensional barcode, the data is often wrong, which is not suitable for use as data.

Referring to FIG. 3, the operation of the entire system will be described.

In the process of decoding the 2D barcode symbol and storing the code value, (300) 2D barcode image capturing step: BMF data is obtained by capturing an image using an image sensor of a mobile phone. After shooting at VGA level (640 * 480 pixels) or higher, remove the color image part, use only black and white image (grayscale), and scale down (image reduction) to a suitable image size for signal processing. At this time, image reduction should use a method of reducing data loss.

(301) Converting to binary: Active Threshold value by referring to the characteristics and brightness of the changed bit stream without determining 0 and 1 using only a random threshold value at 0 to 255 levels of grayscale value. Eject 0 and 1 by applying.

(302) Barcode Area Ejection Step: Ejecting a barcode area by extracting a Finder pattern or a specific shape from all shapes.

(303) Determination of the applied barcode type: Determine the type of used two-dimensional barcode by using the type of finder pattern. If an error occurs in the subsequent step, the barcode type can be re-determined by feeding back to the previous step.

Mapping step by minimum symbol unit: A step of partitioning a bit string into word units is a step of dividing an information area, a data area, an error correction area, and the like.

(305) Information extraction step: Contains information about a version, a format, a mask, and an error correction level for a two-dimensional barcode symbol.

(306) Error correction and data extraction step: Reed-Solomon operation is performed using the information obtained in (5) and the normal data is extracted. If the operation fails, it indicates a fault in the previous step and returns to the previous step.

(307) Converting to Code Values Step: This is a process of converting data values into code values for a remote controller. Since the code value of the remote controller is usually expressed as an ASCII value, it is not necessary to use alphanumeric characters or double-byte characters. If you want to reduce the code size, use only alphanumeric codes or numbers.

(308) Saving at the designated address step: The code value is stored in the semiconductor memory in the mobile phone so that it can be called and written if necessary. If it is a one-time run, it will be saved without saving and it will be deleted automatically when finished.

In the process of transmitting the signal by calling the stored code value,

Code value selection step of the designated address: Calls the code value for the desired remote control from among codes stored in the semiconductor memory of the mobile phone.

(311) Header content analysis step: Parsing the header of the first part from the retrieved code value to distinguish timing information, code length and code position.

(312) Determining the output signal type: Determines the pulse type to be output and waits for a key (button) value to be input from the user. Each company or product can be composed of a bitstream of a slightly different form, and only a key (button) value needs to be filled in a fixed position.

Recognizing the selected key (button) value: The key value is returned from the main processor in the mobile phone, and the corresponding code value is found and inserted into the bitstream to be output.

(314) Output pulse generation step: This step is to output a list of the codes obtained above in a line.

315) Signal output step by infrared LED step: Output the bitstream through the LED drive stage.

The output radio signal is received and decoded by the receiving module of the electronic product and passed to the control processor.

As described above, according to the present invention, a mobile phone having a digital camera function and an infrared communication function can be used as a remote control substitute. Since the object of the invention can be achieved by simply changing the program, practicality becomes very high. Decode the secondary one-bar code symbol, store the code value, and call it if necessary to generate the signal for the output signal. And like the existing remote control, it is not limited to a specific product but can be used for all products. The two-dimensional bar code symbol used here is the most appropriate symbol (symbology) because it can be encoded with a strong error correction function and a large number of code values. Since mobile phones have a built-in projection input device and infrared communication port, no hardware is needed for the present invention and can be replaced only by a program. Many electronic products in the house use a remote controller (remote control or remote control), which is difficult to maintain and repair and there is a risk of loss, if this happens, you can use the method of the present invention.

Claims (5)

Built-in code value for remote control in the 2D barcode symbol, and barcodes such as mobile phones (communication mobile phones with image processing function) such as cellular phones, PDAs, and smartphones that have camera devices and infrared transmitters. In the system for remotely controlling electronic products by decrypting A method of expressing a code value in the form of a streaming structure, that is, a streaming structure arranged with timing information, product code, key (button) code, and other auxiliary code (complementary code = complementary, terminator, etc.). The system of claim 1, wherein the decrypted code value or barcode symbol can be stored in a semiconductor memory in the mobile phone and transferred to a call or other mobile phone for use. The method of claim 1, wherein the code value is represented using two-dimensional bar code symbols with excellent error correction. The mobile phone according to claim 1, wherein contents of key (button) values are displayed on a display device of the mobile phone to increase convenience and transmit code values such as English, Korean, and special character values through infrared rays. 7. The mobile phone according to claim 6, wherein the mobile phone or the electronic product is controlled to enable the display of various characters or symbols (pictures) in advance by setting a code value for the characters from the mobile phone to the electronic product.

Images