TWI514198B - Handheld electronic device and operation method of the same - Google Patents

Description

Handheld electronic device and method of operating same

The invention relates to a universal remote control technology, and in particular to a handheld electronic device with a universal remote control mechanism and an operation method thereof.

In order to increase the convenience of living or meet the entertainment needs in the family, various household appliances are often purchased. Among them, many electrical appliances such as televisions, video recorders, audio, air-conditioning, etc., are equipped with corresponding independent remote controls. As the number of electrical appliances increases, the number of remote controls also increases, which often causes confusion, loss or damage, resulting in inconvenience in the use of household appliances.

When the remote control is lost or damaged, the user often purchases a universal remote control to replace the original remote control. In order to enable the universal remote control to operate the electrical appliance, the universal remote control must have a combination of different device brands, types and models of device control codes, and after a complicated testing process to find the correct device control code combination. Control. However, the remote control generally seen on the market does not have an intuitive search mechanism for the user to quickly find a matching device control code combination. The user needs to try each device control code combination one by one, in addition to requiring great concentration, the efficiency is low. Test process also makes the whole process It is quite time consuming and laborious.

Therefore, how to design a handheld electronic device and its operation method to quickly find a matching device control code combination by using the increasingly powerful processing capability of the handheld electronic device to achieve remote control of the electrical device or other electronic device. This is an urgent problem for the industry.

Accordingly, one aspect of the present invention is to provide a handheld electronic device for controlling an external wireless device. The handheld electronic device comprises: a storage unit, a sound sensor, a processing unit and a wireless control unit. The storage unit is configured to store the first device data and the first control data corresponding to the first device data. The sound sensor is configured to receive sound, and the sound sensor generates a sound signal based on the received sound. The processing unit is coupled to the storage unit and the sound sensor, and the processing unit is configured to recognize the voice information according to the sound signal. The wireless control unit is coupled to the processing unit, and the wireless control unit is configured to generate a wireless signal for controlling the wireless device. Wherein, when the processing unit determines that the voice information is consistent with the first device data, the wireless control unit generates a wireless signal according to the first control data.

According to an embodiment of the present invention, the storage unit is further configured to store the second device data and the second control data corresponding to the second device data, and when the processing unit determines that the voice information is consistent with the second device data, the wireless control unit is configured according to the second The second control data generates a wireless signal.

According to another embodiment of the present invention, the handheld electronic device further includes an image sensor coupled to the processing unit, and the processing unit determines the voice information and the If the device information is not met, the image sensor captures the image of the related wireless device, and the processing unit generates image information according to the captured image. When the processing unit determines that the image information is consistent with the first device data, the wireless control unit is configured according to the first control data. Generate a wireless signal. The image of the related wireless device includes the model number, trademark, appearance or barcode of the wireless device.

According to still another embodiment of the present invention, the handheld electronic device further includes an input unit coupled to the processing unit. When the processing unit determines that the image information does not match the first device data, the input unit receives the input, and the input unit generates the input data according to the input. The processing unit determines that the input data is consistent with the first device data, and the wireless control unit generates the wireless signal according to the first control data.

According to still another embodiment of the present invention, the handheld electronic device further includes an input unit coupled to the processing unit. When the processing unit determines that the voice information does not match the first device data, the input unit receives the input, and the input unit generates the input data according to the input. The processing unit determines that the input data is consistent with the first device data, and the wireless control unit generates the wireless signal according to the first control data.

According to another embodiment of the present invention, the handheld electronic device further includes a wireless communication unit coupled to the processing unit. When the processing unit determines that the voice information does not match the first device data, the processing unit wirelessly couples the server via the wireless communication unit. The processing unit is configured to wirelessly transmit voice information to the server via the wireless communication unit, the processing unit receives the third control data via the wireless communication unit, and the wireless control unit generates the wireless signal according to the third control data.

According to still another embodiment of the present invention, the wireless communication unit includes an infrared unit, a Bluetooth unit, a wireless fidelity unit, and an optical unit. One of the sounding units.

According to an embodiment of the invention, the handheld electronic device further includes: a display unit and an input unit. The display unit is configured to display the corresponding user interface after the processing unit determines that the voice information matches the first device data. The input unit is configured to receive a selection input corresponding to the user interface, and the wireless control unit generates a wireless signal according to the first control data and the selection input. The display unit and the input unit are integrated into the touch display unit, and the user interface includes a plurality of virtual buttons.

Accordingly, another aspect of the present invention is to provide a method of controlling an external wireless device using a handheld electronic device, the method comprising the following steps. Storing the first device data and the first control data corresponding to the first device data; receiving the sound; generating the sound signal according to the received sound; identifying the voice information according to the sound signal; and determining that the voice information matches the first device data, according to the A control data generates a wireless signal to control an external wireless device.

According to an embodiment of the invention, the method further comprises: determining that the voice information does not match the data of the first device; capturing an image of the related wireless device; generating image information according to the captured image; determining that the image information matches the first device data, and Generating a wireless signal based on the first control data.

According to another embodiment of the present invention, the method further includes: determining that the image information does not match the first device data; receiving the input; generating the input data according to the input; determining that the input data is consistent with the first device data, and generating the wireless according to the first control data signal.

According to still another embodiment of the present invention, the method further comprises: determining a voice resource The information does not match the data of the first device; receives the input; generates the input data according to the input; determines that the input data matches the data of the first device, and generates a wireless signal according to the first control data.

According to still another embodiment of the present invention, the method further includes: determining that the voice information does not match the first device data; wirelessly coupling the server to wirelessly transmit the voice information to the server; receiving the third control data from the server; The three control data generates a wireless signal.

According to another embodiment of the present invention, the method further includes: displaying the corresponding user interface after determining that the voice information matches the first device data; and receiving a selection input corresponding to the user interface, according to the first control data And select input to generate a wireless signal.

The invention has the advantages of identifying various sounds, images or other types of inputs by means of a sound sensor, an image sensor or an input unit, and rapidly generating wireless signal control according to the control data corresponding to the device data. An external wireless device can easily achieve the above purpose.

1, 4, 5‧‧‧ Handheld electronic devices

100‧‧‧ storage unit

101‧‧‧ device information

102‧‧‧Sound sensor

103‧‧‧Control data

104‧‧‧Processing unit

105‧‧‧ Sound

106‧‧‧Wireless Control Unit

107‧‧‧Sound signal

108‧‧‧Touch display unit

109‧‧‧Voice Information

111‧‧‧Wireless signal

113‧‧‧Select input

115‧‧‧ input signal

2‧‧‧Wireless devices

3‧‧‧User interface

30‧‧‧virtual buttons

40‧‧‧Wireless communication unit

41‧‧‧Control data

42‧‧‧Server

50‧‧‧Image sensor

51‧‧‧ images

53‧‧‧Image information

55‧‧‧Enter

57‧‧‧ Input data

600‧‧‧ method

601-605‧‧‧Steps

1 is a block diagram of a handheld electronic device according to an embodiment of the present invention; FIG. 2 is a schematic diagram showing an example of control data in FIG. 1 according to an embodiment of the present invention; and FIG. 3 is an embodiment of the present invention; In the example, the top view of the handheld electronic device; 4 is a block diagram of a handheld electronic device according to another embodiment of the present invention; FIG. 5 is a block diagram of a handheld electronic device according to another embodiment of the present invention; and FIG. 6 is an embodiment of the present invention In the flow chart of a method.

Please refer to Figure 1. 1 is a block diagram of a handheld electronic device 1 in accordance with an embodiment of the present invention. The handheld electronic device 1 includes a storage unit 100, a sound sensor 102, a processing unit 104, a wireless control unit 106, and a touch display unit 108.

The storage unit 100 is configured to store the device data 101 and the control data 103. In various embodiments, device profile 101 may include information of different electronic devices, such as, but not limited to, information of a model, trademark, design, brand, or combination thereof, and may be in the form of, for example, but not limited to, text, images, or graphics. The control data 103 contains control information of different electronic devices such as, but not limited to, coded messages that control various electronic devices to perform different functions.

The sound sensor 102 is configured to receive the sound 105. In an embodiment, the sound sensor 102 can be a microphone. The sound sensor 10 generates a sound signal 107 based on the received sound 105. The processing unit 104 is coupled to the storage unit 100 and the sound sensor 102. The processing unit 104 is configured to recognize the voice information 109 based on the sound signal 107, and further to compare the device data 101 search in the storage unit 100 according to the voice information 109.

The wireless control unit 106 is coupled to the processing unit 104. In one implementation In the example, when the processing unit 104 determines that the voice information 109 matches one of the device data 101, the control data 103 corresponding to the device data 101 is retrieved, so that the wireless control unit 106 generates the wireless signal 111 according to the control data 103.

In various embodiments, the wireless control unit 106 can be an infrared unit, a Bluetooth unit, a WiFi unit, or other wireless form of control unit to generate infrared or wireless signals 111 that conform to wireless communication specifications such as Bluetooth, WiFi, and the like. This wireless signal 111 will be transmitted to the wireless device 2 in the form of wireless transmission to control the wireless device 2.

The wireless device 2 can be, for example, but not limited to, a television, an air conditioner, an audio, a DVD player, etc., that can receive and control the wireless signal 111 in various embodiments. In various embodiments, the control of the wireless device 2 includes operating the wireless device 2 to perform different functions such as, but not limited to, activation, shutdown, or a particular function. For example, if the wireless device 2 is a television, the wireless signal 111 generated by the wireless control unit 106 can be used to control the volume level of the television, the number of channels, the display mode, and the like.

For example, when the user dictates the handheld electronic device 1 to "Sony KDL-55HX750", the sound sensor 102 will receive the sound 105 and generate a sound signal 107. The processing unit 104 recognizes the voice information 109 included in the sound signal 107, and searches the device unit 101 based on the voice information 109 to the storage unit 100. When the device data 101 includes a piece of data with a brand name of Sony and the model number is KDL-55HX750, the processing unit 104 matches the judgment voice information 109 with the device data 101, and retrieves the corresponding control data 103. Wireless control unit 106 A wireless signal 111 is generated based on the control data 103 to control the television device whose brand and model conform to the "Sony KDL-55HX750".

It should be noted that the labels and machines of the above embodiments are only an example. In other embodiments, the controlled electronic device 2 can be other brands, models, and types of electronic devices such as, but not limited to, a Samsung DVD player or a Toshiba air conditioner.

Various embodiments of the handheld electronic device 1 will be described in more detail below.

Please refer to Figure 2. FIG. 2 is a schematic diagram showing an example of the control data 103 in FIG. 1 according to an embodiment of the present invention. In the present embodiment, each line of code corresponds to a piece of control data 103. The control profile 103 can be, for example but not limited to, including an identification code located in the first field and a plurality of function control codes located in the other fields. The function control code can correspond to a function of the wireless device 2, respectively. The control data 103 having the identification code 001 is taken as an example, and includes a device control code 10h corresponding to the power switch function, a function control code 20h corresponding to the function of up-regulating the number of channels, a function control code 30h corresponding to the function of lowering the number of channels, and the like.

Please refer to both Figure 1 and Figure 3. FIG. 3 is a top view of the handheld electronic device 1 in accordance with an embodiment of the present invention. In the present embodiment, after the processing of the voice information 109 and the device data 101, the processing unit 104 can display the corresponding user interface 3 by the touch display unit 108 in addition to the corresponding control data 103. A plurality of virtual buttons 30 may be included in the user interface 3 to correspond to different functions of the wireless device 2.

The touch display unit 108 can further receive a corresponding user interface. The selection input 113 of 20 selects one of the functions and further produces an input signal 115. In an embodiment, the processing unit 104 can search for a piece of function control code corresponding to the function from the control data 103 according to the input signal 115, so that the wireless control unit 106 can generate the wireless signal 111 according to the control data 103 and the input signal 115. The wireless device 2 is controlled to perform this function.

For example, when the user touches the virtual button 30 labeled "power", the wireless control unit 106 can generate a wireless signal 111 according to the function control code corresponding to the power control in the control data 103 to control the wireless device 2 to turn on the power or Is to turn off the power.

It should be noted that, in this embodiment, the handheld electronic device 1 achieves the function of displaying the user interface 3 and receiving the selection input 113 by integrating the touch display unit 108 into one. In other embodiments, the handheld electronic device 1 may also perform display of the user interface 3 and reception of the selection input 113 by a separate display unit (not shown) and an input unit (not shown). It is not limited to the examples of the embodiment.

Therefore, the handheld electronic device 2 of the present invention can generate a sound signal to recognize the voice information in the sound input by the sound sensor, and determine the device data corresponding thereto according to the voice information, so that the wireless control unit responds according to the corresponding The control data of the device data generates a wireless signal to control the effectiveness of the wireless device.

Please refer to Figure 4. 4 is a block diagram of a handheld electronic device 4 in another embodiment of the present invention. The handheld electronic device 4 illustrated in FIG. 4 is substantially the same as the components included in the handheld electronic device 1 illustrated in FIG. 1, and thus the same components will not be described. In this embodiment The handheld electronic device 4 further includes a wireless communication unit 40.

When the processing unit 104 determines that the voice information 109 does not match the device profile 101, the processing unit 104 will wirelessly couple the server 42 via the wireless communication unit 40. The wireless communication unit 40 is configured to wirelessly communicate with the server 42 so that the processing unit 104 can wirelessly transmit voice information 109 to the server 42 via the wireless communication unit 40. After the server 42 searches the internal database (not shown), the processing unit 104 receives the control data 41 wirelessly transmitted by the server 42 via the wireless communication unit 40, and the wireless control unit 106 generates a wireless signal according to the control data 41. 111.

In various embodiments, the wireless communication unit 40 includes one of an infrared unit, a Bluetooth unit, a wireless fidelity unit, an optical unit, and a sounding unit.

Therefore, in the embodiment, when the data built in the handheld electronic device 5 does not store the device control code combination corresponding to the controlled electronic device 2, the handheld electronic device 4 can be connected by the wireless communication unit 40. For example, but not limited to, the manufacturer of the wireless device 2, the server of the manufacturer of the handheld electronic device 4, or other server with related information to obtain the corresponding corresponding control data 41 to achieve control The purpose of the wireless device 2.

Please refer to Figure 5. FIG. 5 is a block diagram of a handheld electronic device 5 in accordance with still another embodiment of the present invention. The handheld electronic device 5 illustrated in FIG. 5 is substantially the same as the components included in the handheld electronic device 1 illustrated in FIG. 1, and thus the same components will not be described. In the handheld electronic device 5 of the embodiment, the image sensor 50 is further included.

The image sensor 50 is coupled to the processing unit 104. When the processing unit 104 determines that the voice information 109 does not match the device data 101, the image sensor 50 captures the image 61 of the related wireless device 2, and generates image information 53 according to the captured image 51.

The image information 53 may include a model of the wireless device 2 (eg, on the body, marked with a type of imprint or sticker), a trademark, a form, or a bar code. The processing unit 104 performs image recognition and image processing on the image information 53. The image recognition and processing may include edge detection, segmentation, and shape matching on the image to capture and identify the information of the related wireless device 2, and determine the image information. Whether the information of 53 matches the device profile 101. When the image information 53 matches one of the device data 101, the wireless control unit 106 generates the wireless signal 111 according to the control data 103 corresponding to the device data 101.

In another embodiment of the present invention, if the processing unit 104 determines that the voice information 109 and the image information 53 are not consistent with the device data 101, the input 55 can be received by the touch display unit 108 to generate the input data 57.

In one embodiment, the input data 57 can be a text input to directly enter the brand and model of the wireless device 2 by the user for the processing unit 104 to determine whether the input data 57 matches the device profile 101. When the input data 57 matches one of the device data 101, the wireless control unit 106 generates the wireless signal 111 based on the control data 103 corresponding to the device data 101.

Therefore, with the above embodiments, the handheld electronic device of the present invention The device can generate the device data according to the image, text or other types of information by using the image sensor or the input unit, and then the wireless control unit generates the control data according to the corresponding device data. Wireless signal to control the effectiveness of the wireless device.

Please refer to Figure 6. FIG. 6 is a flow chart of a method 600 in accordance with an embodiment of the present invention. Method 600 can be applied to handheld electronic devices 1, 4, and 5 as shown in Figures 1, 4, and 5. The hand-held electronic device 1 of Fig. 1 will be described below as an example. The method 600 includes the following steps (it should be understood that the steps mentioned in the present embodiment can be adjusted according to actual needs, and can be performed simultaneously or partially simultaneously, unless otherwise specified.

In step 601, the storage unit 100 stores the device data 101 and the control data 103 of the corresponding device data 101.

At step 602, the sound input 105 is received by the sound sensor 102 to produce a sound signal 107.

In step 603, the voice information 109 is recognized by the processing unit 104 based on the sound signal 107.

In step 604, the processing unit 104 determines that the voice information 109 matches the device profile 101, and generates a wireless signal 111 based on the control profile 103 corresponding to the device profile 101 to control the wireless device 2 in step 605.

The present disclosure has been disclosed in the above embodiments, but it is not intended to limit the disclosure, and any person skilled in the art can make various changes and refinements without departing from the spirit and scope of the disclosure. The scope of protection of the disclosure is defined by the scope of the patent application attached. Prevail.

1‧‧‧Handheld electronic device

100‧‧‧ storage unit

101‧‧‧ device information

102‧‧‧Sound sensor

103‧‧‧Control data

104‧‧‧Processing unit

105‧‧‧ Sound

106‧‧‧Wireless Control Unit

107‧‧‧Sound signal

108‧‧‧Touch display unit

109‧‧‧Voice Information

111‧‧‧Wireless signal

113‧‧‧Select input

115‧‧‧ input signal

2‧‧‧Wireless devices

Claims (11)

A handheld electronic device for controlling an external wireless device, the handheld electronic device comprising: a storage unit configured to store a first device data and a first control data corresponding to the first device data; a sound a sensor configured to receive a sound, the sound sensor generating a sound signal according to the received sound; a processing unit coupled to the storage unit and the sound sensor, the processing unit configured to be based on the sound signal Identifying a voice information; a wireless control unit coupled to the processing unit, the wireless control unit configured to generate a wireless signal for controlling the wireless device; wherein, when the processing unit determines the voice information and the first device data Correspondingly, the wireless control unit generates the wireless signal according to the first control data; and an image sensor coupled to the processing unit, when the processing unit determines that the voice information does not match the first device data, the image The sensor captures an image of the wireless device, and the processing unit generates an image information according to the captured image. The processing unit determines that the image information data in line with the first means, the radio control unit generates the radio signal based on the first control information; wherein the first means comprises a data field and a label field model. The handheld electronic device of claim 1, wherein the storage unit is further configured to store a second device data and a corresponding second device data. And a second control data, when the processing unit determines that the voice information is consistent with the second device data, the wireless control unit generates the wireless signal according to the second control data. The handheld electronic device of claim 1, further comprising an input unit coupled to the processing unit, wherein when the processing unit determines that the image information does not match the first device data, the input unit receives an input, the input The unit generates an input data according to the input. When the processing unit determines that the input data is consistent with the first device data, the wireless control unit generates the wireless signal according to the first control data. The handheld electronic device of claim 1, further comprising an input unit coupled to the processing unit, and when the processing unit determines that the voice information does not match the first device data, the input unit receives an input, the input The unit generates an input data according to the input. When the processing unit determines that the input data is consistent with the first device data, the wireless control unit generates the wireless signal according to the first control data. The handheld electronic device of claim 1, further comprising a wireless communication unit coupled to the processing unit, wherein the processing unit determines that the voice information does not conform to the first device data, and the processing unit passes the wireless communication unit Wirelessly coupled to a server, the processing unit is configured to wirelessly transmit the voice information to the server via the wireless communication unit, and the processing unit receives a third control data via the wireless communication unit, the wireless control unit root The wireless signal is generated based on the third control data. The handheld electronic device of claim 1, further comprising: a display unit, configured to display a corresponding user interface after the processing unit determines that the voice information matches the first device data; and input The unit is configured to receive a selection input corresponding to the user interface and generate an input signal, and the wireless control unit generates the wireless signal according to the first control data and the input signal. A method for controlling an external wireless device by using a handheld electronic device, the method comprising: storing a first device data and a first control data corresponding to the first device data; receiving a sound; according to the received sound Generating a voice signal; identifying a voice message according to the voice signal; determining that the voice message is consistent with the first device data, generating the wireless signal according to the first control data to control the external wireless device; and determining When the voice information does not match the first device data, the method further includes: capturing an image of the wireless device; generating an image information according to the captured image; and determining that the image information matches the first device data, And according to The first control data generates the wireless signal; wherein the first device data includes a label field and a model field. The method of claim 7, further comprising: determining that the image information does not match the first device data; receiving an input; generating an input data according to the input; and determining that the input data is consistent with the first device data, And generating the wireless signal according to the first control data. The method of claim 7, further comprising: determining that the voice information does not match the first device data; receiving an input; generating an input data according to the input; determining that the input data is consistent with the first device data, and The wireless signal is generated based on the first control data. The method of claim 7, further comprising: determining that the voice information does not match the first device data; wirelessly coupling a server to wirelessly transmit the voice information to the server; receiving a message from the server Three control data; and generating the wireless signal based on the third control data. The method of claim 7, further comprising: after determining that the voice information matches the first device data, displaying a corresponding one of the user interfaces; and receiving a selection input corresponding to the user interface, and generating a Inputting a signal to generate the wireless signal based on the first control data and the input signal.