JP2008299477A - Method, device, and program for controlling electronic apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem that the power source of a television receiver is turned on without noticing a user, and that the power source is left on for a long period of time, and that any unnecessary power is consumed when the user unintentionally claps his or her hands three times when the power-on of a television receiver is recognized according as the user claps his or her hands three times. <P>SOLUTION: When a television receiver is put in a power-off state (state that the power source of any device other than the device concerning the recognition of this invention is off), and a user unintentionally claps his or her hands three times due to any factor near the television receiver in an ON-OFF mode, three time handclap is recognized at a time t1 as shown by (G), and the television receiver is put in a power-on state as shown by (B) as a result. Confirmation display shown by (A) is executed the lapse of a fixed time ta1 after the time t1 when the power source is turned on. When the confirmation work is not executed by the handclap recognition operation and the other operations in the confirmation display period tb1, it is determined that the probability of erroneous recognition is high, and the power source is forcedly turned off as shown by (C) at a time t3. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic device control method, a control device, and a control program, and more particularly, to an electronic device control method, a control device, and a control program for remotely operating an electronic device to be operated without using a remote controller.

  In the 1980s, infrared remote controllers (commonly called remote controllers) came to be attached to household appliances such as television receivers, and user interfaces that can remotely control household appliances at hand became widespread, greatly increasing the operation mode of household appliances. Transformed. Even now, this mode of operation is mainstream. The remote control is an operating device based on a mechanism for executing one function by pressing one key assigned to the function. For example, a remote controller attached to a television receiver has keys for remotely operating functions such as “power”, “channel”, “volume”, and “input switching”. This remote operation method using a remote control has been a very convenient remote operation method for conventional television receivers.

  However, in television receivers that have recently started receiving digital broadcasts and data broadcasts, in order to select the desired menu screen, the “up”, “down”, “left”, “right” and “decision” buttons on the remote control ”Key must be pressed many times, and the operation with the remote control is complicated and difficult to use. When operating using an EPG (Electronic Program Guide), it is necessary to select a desired position from a guide screen arranged in a matrix and press a key on the remote control. As with the machine, there is a problem that a fine selection operation is necessary. In addition, operations of many functions are concentrated on the remote control, and it has become difficult to operate without the remote control. Now, the operation mode and usage mode of the remote control are being reviewed.

  Accordingly, the present inventor has disclosed a control device for an electronic device that achieves both flexibility and convenience of remote operation for various electronic devices and eliminates the need to use a remote operation device such as a remote control at hand. (For example, refer to Patent Document 1). In this electronic device control device according to the present inventor, the user's hand motion is photographed with a video camera, and the photographed image of the hand is displayed on the display device together with the operation image including the operation buttons, and the displayed hand is displayed. When the operation is performed by moving the finger on the operation button and bending the finger, the control operation corresponding to the operation is executed. As a result, this electronic device control device enables remote operation of the electronic device without using a remote control.

  In addition, as a control device for an electronic device that makes it unnecessary to use a remote operation device such as a remote control at hand, a proposal has been made to operate the electronic device with sounds that can be emitted by humans, such as applause sounds. (For example, see Patent Document 2 and Patent Document 3).

JP 2006091948 A JP 05-031483 A Japanese Patent Laid-Open No. 06-318424

  However, in the control apparatus for electronic devices described in Patent Documents 1 to 3 described above, the recognition operation is performed using images and non-speech sounds (applause sounds). Even if the improvement measures are taken, it is assumed that the same problem occurs in the recognition operation, which is an interface between the person and the machine, so that a recognition error occurs in communication between people and a problem is discovered.

  For example, when the control device of the electronic device is configured to recognize the power-on of the television receiver with three applauses, if it is applauded three times to call a person without being aware of that, the television receiver The machine is turned on. As a result, if the power is not noticed, the television receiver is turned on and off for a long time, and unnecessary power is consumed.

  In the case of human beings, in this case, feedback work of confirmation is entered, and after the problem is discovered, action is taken to resolve it. However, in the recognition operation, there is no confirmation work, and there is a possibility of causing erroneous recognition for such unintended sounds and operations. In order to prevent such misrecognition, it is necessary not only to technically improve resistance to misrecognition, but also to construct a feedback loop corresponding to a confirmation operation such as communication between people.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above points. In remote control of an electronic device using images and non-sound, all recognition operations of the electronic device and other operations (operations on the remote controller and the electronic device main body) are provided. In view of the above, it is possible to provide an electronic device control method, a control device, and a control program capable of preventing misrecognition and performing control of the electronic device in an appropriate state by performing a confirmation operation of a person (user). Objective.

In order to achieve the above object, a method for controlling an electronic device according to a first aspect of the present invention recognizes an operator's operation using a captured image obtained by photographing the operator or sound waves emitted intermittently by the operator, In a control method of an electronic device equipped with a display device that performs control corresponding to the recognized operation on the electronic device,
A signal generation step for generating a captured image signal obtained by photographing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator, and a specific operation of the operator is detected or intermittently detected based on the captured image signal The operation recognition step for recognizing the operation of the operator by detecting the number of sound generation of the sound wave to be generated based on the sound signal, and the operation recognized in the operation recognition step is an operation for turning on the power to the electronic device A first power control step for controlling the electronic device to turn on when a power-on operation is detected at the detection step, and a first preset after the electronic device is turned on After the period of time elapses, an operation confirmation process is performed to confirm whether a signal for prompting the operator to confirm the operation is displayed on the display device or pronounced by the sound generation means. Confirmation for determining whether or not an operation for confirmation has been performed by executing the signal generation step and the operation recognition step again within a preset second period after the operation confirmation processing by the step and the confirmation step is started. When it is determined that the confirmation operation is performed within the determination step and the second period, the electronic device is kept powered on, and when it is determined that the confirmation operation is not performed within the second period, And a second power control step of controlling the electronic device to forcibly turn off the power after the second period has elapsed.

In order to achieve the above object, the control device for an electronic device according to the second aspect of the invention recognizes and controls the operation of the operator using a photographed image obtained by photographing the operator or a sound wave intermittently emitted by the operator. In a control device for an electronic device having a display device that performs control corresponding to the recognized operation on the target electronic device,
A sound generation unit that generates a sound; a captured image signal corresponding to a captured image obtained by capturing the operator; or a signal generation unit that generates a sound signal corresponding to a sound wave emitted intermittently by the operator; The operation recognition means that recognizes the operation of the operator by detecting the operation based on the picked-up image signal or the number of sound generations of intermittently generated sound waves based on the sound signal, and the operation recognition means. Detecting means for detecting that the operated operation is a power-on operation for the electronic device, and first power control means for controlling the electronic device to be turned on when the detecting means detects the power-on operation; When the electronic device is turned on, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device or sounded by the sound generation means. Do A confirmation means for performing the operation confirmation process, and an operation for confirmation by controlling the signal generation means and the operation recognition means to operate again within a preset second period after the operation confirmation process is started by the confirmation means. Confirmation determination means for determining whether or not a confirmation operation has been performed, and when it is determined that a confirmation operation has been performed within the second period, the power-on state of the electronic device is continued and a confirmation operation is performed within the second period. And a second power supply control unit for controlling the electronic device to forcibly turn off the power after the second period has elapsed.

In order to achieve the above object, a control program for an electronic device according to a third aspect of the present invention recognizes an operator's operation using a photographed image obtained by photographing the operator or a sound wave intermittently emitted by the operator, and performs control. In a control program for an electronic device provided with a display device, the computer is used to perform control corresponding to the recognized operation on the target electronic device.
A signal generation step for generating a captured image signal obtained by photographing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator, and a specific operation of the operator is detected or intermittently detected based on the captured image signal The operation recognition step for recognizing the operation of the operator by detecting the number of sound generation of the sound wave to be generated based on the sound signal, and the operation recognized in the operation recognition step is an operation for turning on the power to the electronic device A first power control step for controlling the electronic device to turn on when a power-on operation is detected at the detection step, and a first preset after the electronic device is turned on After the period of time elapses, an operation confirmation process is performed to confirm whether a signal for prompting the operator to confirm the operation is displayed on the display device or pronounced by the sound generation means. Confirmation for determining whether or not an operation for confirmation has been performed by executing the signal generation step and the operation recognition step again within a preset second period after the operation confirmation processing by the step and the confirmation step is started. When it is determined that the confirmation operation is performed within the determination step and the second period, the electronic device is kept powered on, and when it is determined that the confirmation operation is not performed within the second period, And a second power control step of controlling the electronic device to forcibly turn off the power after the second period has elapsed.

  According to the present invention, when the power-on operation is recognized and the power is turned on, the operator is prompted to confirm the operation. When the confirmation operation is not performed within the operation confirmation setting period, the power is turned on. By forcibly turning it off, it is possible to suppress waste of power due to erroneous detection of power-on. Further, according to the present invention, it is possible to reduce the burden on the operator by not performing the operation confirmation when a general operation is performed before prompting the operation confirmation.

  Next, the best mode for carrying out the present invention will be described in detail with reference to the drawings. Electronic device operation methods include a method of operating the operation switches of the main unit, a method of remote control by transmitting control codes via infrared or wireless using a control device such as a remote control, and a control device such as a remote control There is a recognition operation method that realizes control by using a human action as an operation without using a computer. Furthermore, recognition operations include image recognition and non-voice recognition (applause sound recognition). The applause sound recognition operation is to control an electric device by converting sound waves into an electric signal with a microphone and determining that the electric signal satisfies a specific condition. In the following embodiments of the present invention to be described, it is assumed that a recognition operation method using a clapping sound operation is adopted to remotely operate a television receiver as an electronic device.

  FIG. 1 is a block diagram showing a main part of an embodiment of a control apparatus for electronic equipment according to the present invention. The control device according to the present embodiment includes a microphone (hereinafter abbreviated as a microphone) 101 that collects the applause sound of an operator, an amplifier 102 that amplifies an analog audio signal from the microphone 101, and an analog output from the amplifier 102. The audio signal and the TV decoded sound amplified by the amplifier 203 are input to perform applause sound recognition, and the applause sound recognition unit 100 outputs a determination signal as a determination result.

  The applause sound recognition unit 100 converts the A / D converters 103 and 204, the offset component removal units 104 and 205 that remove the offset component of the output digital audio signal, and the digital audio signal from which the offset component has been removed into absolute values. Based on the absolute value signals from the absolute value circuits 105 and 206 for outputting the absolute value signal and the absolute value signals from the absolute value circuits 105 and 206, the main body sound (the sound generated from the main body speaker 201 of the television receiver) is removed. The main body sound removing unit 106 for extracting the applause sound component, the edge signal extractor 107 and the noise state detecting unit 110 to which the output signal of the main body sound removing unit 106 is supplied, and an edge pulse based on the edge signal are generated. Based on the edge pulse generator 108, each output signal of the edge pulse and noise state detection unit 110, and the determination mode, Consists determination processing unit 109 for performing determination processing such as timing.

  Next, the operation of this embodiment will be described. The microphone 101 is installed at a predetermined position of a television receiver that is an electronic device to be operated. The microphone 101 collects the applause sound of the operator, performs acoustic-electric conversion, and outputs an analog audio signal. This analog audio signal is amplified to an optimum amplitude level with respect to the dynamic range of the A / D conversion by the A / D converter 103 at the subsequent stage by the amplifier 102, and then supplied to the A / D converter 103 to be digitally converted from the analog signal. Converted to a signal. The audio signal digitized by the A / D converter 103 is subjected to signal processing according to the contents of the subsequent functional blocks by software processing or hardware processing. Here, the processing method is limited. Not what you want.

  The output digital audio signal of the A / D converter 103 is a digital signal having a sound waveform centered on the offset component 304 of the level 305 during silence in the dynamic range 303 of the A / D converter 103 as shown in FIG. The actual applause sound waveform 301 and its envelope waveform 302 are obtained as digital audio signals. Although the sound waveform corresponds to an actual waveform 301 including various frequency components, the present embodiment focuses on the actual waveform envelope 302, and in the following description of the waveform, the actual waveform envelope will be described. This is illustrated by line 302.

  Returning to FIG. 1, the output digital audio signal of the A / D converter 103 is passed through a high-pass filter (HPF) having an appropriate characteristic by the offset component removal unit 104 and the offset component is removed. The absolute value is converted into an absolute value by the absolute value converting circuit 105 to obtain an absolute value signal of waveform # 1. The absolute value signal of the waveform # 1 is a signal obtained by making the absolute value based on the average level of the analog audio signal obtained by collecting sound by the microphone 101.

  On the other hand, the decoded audio signal of the television broadcast signal decoded in the television receiver main body is amplified by the main body amplifier 202 and subjected to electro-acoustic conversion by the main body speaker 201, and is generated as a decoded sound from the main body speaker 201 into the air. , Coming around from the microphone 101. Therefore, the absolute value signal of the waveform # 1 output from the absolute value circuit 105 is a mixture of the applause sound captured by the microphone 101 and the decoded sound of the television.

  The signal corresponding to the mixed TV main body sound is digitally output by the A / D converter 204 after the amplifier 203 adjusts the output analog audio signal (the TV decoded sound signal) to an appropriate amplitude. The signal is converted into a signal, passed through a high-pass filter (HPF) having an appropriate characteristic in the offset component removing unit 205, the offset component is removed, and an absolute value signal obtained by converting the waveform into an absolute value by the absolute value conversion circuit 206. It corresponds.

  That is, the waveform example of the output absolute value signal of the absolute value conversion circuit 206 is waveform # 2, which is similar to the waveform of waveform # 1 without the applause sound. The absolute value signal of the waveform # 2 is a signal obtained by making the absolute value based on the average level of the analog audio signal output from the main amplifier 202 (decoded sound signal of the television). The main body sound removing unit 106 subtracts the absolute value signal of the waveform # 2 from the absolute value signal of the waveform # 1 to thereby mix the main body sound mixed from the microphone 101 in the absolute value signal of the waveform # 1. In order to cancel the component (decoded sound of television), the waveform # 2 is shaped in consideration of the propagation characteristics of the transmission path that travels through the space from the main body speaker 201 to the microphone 101, and then the waveform # 1 is subtracted.

  In this way, the main body sound included in the absolute value signal output from the absolute value converting circuit 105 is canceled by the main body sound removing unit 106. The signal output from the main body sound removing unit 106 is a voice signal in which a sound other than the applause sound and the applause sound and a minute residual main body sound that could not be canceled are mixed. Because of the impulsive sound, the energy is large and covers the entire frequency band of the sound, and can be distinguished by capturing the edge component. Therefore, the edge signal is extracted by the edge signal extractor 107 to obtain the waveform # 3 at the output. The edge signal extractor 107 extracts, for example, a signal component having a high frequency component equal to or higher than a predetermined frequency and a level equal to or higher than a predetermined first threshold as an edge signal.

The edge pulse generator 108 generates an edge pulse waveform # 4 using the waveform # 3 as a trigger. For example, when it becomes the second threshold value or more levels of the waveform # 3 edge signal predetermined to generate an edge pulse having a constant width, the determination process as an edge detection flag F _p it as a detection signal of the clap Output to the unit 109.

  The noise state detection unit 110 evaluates the noise level in the environment where the operator, which is the output signal of the main body sound removal unit 106, and generates a noise state flag if the environment is inappropriate for recognizing applause sound. And output to the determination processing unit 109. The configuration of the noise state detection unit 110 is, for example, taking out an absolute value signal from the main body sound removal unit 106, sequentially comparing the absolute value signal with a predetermined threshold A, and the level of the absolute value signal is equal to or higher than the threshold A. When it is, the absolute value signal level is cumulatively added. When the absolute value signal level is less than the threshold A, the absolute value signal level is cumulatively subtracted to obtain a cumulative calculation value. When this happens, it is determined that the noise is present, and a noise state flag having a predetermined value is generated.

Determination processing unit 109, the edge pulse generator 108 to obtain an edge detection flag F _p evaluated along the decision algorithm, when the condition is met, and outputs a determination signal. The determination condition is switched according to the input determination mode. Further, when a noise state flag having a predetermined value is generated from the noise state detection unit 110, the recognition operation is stopped and the output of the determination signal is prohibited. As a result, it is possible to prevent malfunctions caused by misrecognizing noise such as a loud sound of a television or an environmental sound as a clapping sound in a noise state. The noise state detection unit 110 is preferably provided because it increases the resistance to malfunction, but it is not always necessary to provide the noise state detection unit 110.

FIG. 3 is a block diagram illustrating an example of the configuration of the determination processing unit 109. 4 and 5 are timing charts for explaining the determination processing algorithm of the determination processing unit 109. FIG. As shown in FIG. 3, the determination processing unit 109 includes a counter 1091 and a determination processor 1092. The determination processor 1092 receives the edge detection flag _Fp , the noise state flag, and the determination mode. The counter 1091 is for managing a time axis for generating a cycle between a plurality of edge flags input to the determination processor 1092, a gate pulse for gating a specific area, and the like.

  The algorithm of the determination processor 1092 is switched depending on the determination mode. This determination mode sets a quiet period in which there is no applause before and after a predetermined number of applause starts, and in this embodiment, when applause is performed at equal intervals three or four times, recognition is confirmed and determined. Two types can be set: an ON-OFF mode in which a signal is output, and a selection up-down mode in which a recognition signal is output after applause is confirmed once.

FIG. 4 shows a timing chart in the ON-OFF mode in which recognition operation is performed by performing applause three times. In the ON-OFF mode algorithm shown in the timing chart of FIG. 4, regardless of the number of applauses, the applause is detected at a predetermined number of times, and the applause is not detected for a certain period before and after that. This is the condition for confirming recognition. Specifically, the conditions for the recognition confirmation are a silence flag F _S shown in FIG. 4C, flags F _{1 to} F ₃ shown in FIGS. 4D to 4F, and a silence flag shown in FIG. F _N is set. In the example of FIG. 4, the predetermined number of applause is three. The determination processing operation will be described step by step according to the timing chart of FIG.

First, the determination processor 1092 of the determination processing section 109 determines whether silence flag _{F s} shown in FIG. 4 (C) is set. Determination processor 1092, silence flag _{F s} is not set, and to start the counting of the counter 1091 from the state edge detection flag _{F P} shown in FIG. 4 (A) is 0. Count value as shown in FIG. 4 (I) from the count start time of the counter 1091 (t = 0) is gradually increased, a period of time (t _s) to reach a predetermined _value, as shown in FIG. (A) If the state is not set edge detection flag F _p is (at logic 0) is followed, is set silence flag F _s as shown in FIG regarded as silence (C) (logic 1 becomes), thereby the time t A series of judgment operations starts after resetting to 0.

In less elapse of a predetermined time t _s, if the edge detection flag F _p is set to reset the counter 1091 to "0", begins counting again. In order to prevent overflow, a limiter value LM is provided in the counter 1091 as shown in FIG.

Thereafter, when the quiet flag F _s is “1” and the detection pulse F _{1 of the first} applause sound described later is the initial value “0”, the input detection state of the edge detection flag F _p is awaited, and the time t Increment. When the edge detection flag of the first applause sound is input as indicated by 501 in FIG. 4A, the edge detection flag _Fp is determined to be “1”, and the detection flag F of the first applause sound is determined. ₁ is set as shown in FIG. 4D (as logic “1”), and it is determined that the applause is the first time. At this time, it is set again to "0" to time t, the counter 1091 at the rising edge detection flag F _p starts counting again as shown in FIG. (I).

After that, when both the flags F _s and F ₁ are “1”, and the detection flag F _{2 of the second} applause sound described later is the initial value “0”, the input detection state of the edge detection flag F _p is awaited. It becomes. In this state, when the edge detection flag F _p of the second applause sound is input as indicated by 502 in FIG. 4A and it is determined that the edge detection flag F _p is “1”, 2 rising t ≧ _{t 1} of the edge detection flag _{F p} times th clapping sound, _{and, t <t 1 + t 2} ,
In other words, it determines whether the 4 within the gate 504 for the second clapping sound gate flag F _G with the gate width t ₂ shown in (B). If the rising edge detection flag F _p of the second clap a gate within 504, the detection flag F ₂ of the second clapping sound as shown in FIG. 4 (E) is set. At the same time, the value of t at that time is stored as an interval period t _I between the first applause sound and the second applause sound, reset to t = 0, and the counter 1091 starts counting again.

Next, in the state where the above-mentioned flags F _S , F ₁ and F ₂ are “1” and the detection flag F _{3 of the third} applause sound described later is the initial value “0”, the third applause sound of the edge detection flag F _p is input, as shown by 503 in FIG. 4 (a), it is determined that the edge detection flag F _p is "1", the third clapping sound edge detection flag F _p The rise of
_{t ≧ t I - (t 3} /2), _{and, t <t I + (t} 3/2)
In other words, it determines whether the 4 within the gate 505 for the third clapping sound gate flag F _G with the gate width t ₃ when shown in (B). If third clapping sound edge detection flag within F _p rise of the gate 505 sets the detection flag F ₃ of the third clapping sound as shown in FIG. 4 (F). Further, after the third detection flag F ₃ is set (logic “1”), the counter 1091 starts counting again by resetting to t = 0 again.

At this time, the silence flag F _S , the detection flags F ₁ , F ₂ , and F ₃ are all logic “1”, and the detection flag F _{4 for the fourth} applause sound is in an initial value of “0”. is there. If _{t ≧ t I + (t 3} /2) and until the edge detection flag F _p in this state is set, the time t is gradually incremented, edge detection flag F _p is set to no state of the time t _I + (t _3/2) when continued, as shown in FIG. 4 (G), (turned into the logic "1") silent flag F _N is set.

Since all the flags F _S , F _{1 to} F ₃ , and F _N are set, the condition is satisfied, the input is successful, and a series of determination operations are completed. As shown in FIG. F _J is output for a certain period t _F. After a certain period t _F elapses, all the flags and counters are reset to “0”, and the counter 1091 starts counting again to prepare for the next determination operation. The above is the determination operation in this embodiment.

  As described above, not only the predetermined number of applause but also the state before and after that is added to the determination condition, and if the user applauds the predetermined number of times, the determination is performed for the predetermined number of times + 2 times. Thus, a deeper determination can be made without imposing the burden of increasing the number of applause on the user.

Incidentally, if the state in which the second clapping sound edge detection flag F _P is not input has time continued (t ₁ + t _2), the interval time period t _I and first clapping sound detection flag and determines that the input failure to reset the F _1. Third clapping sound edge detection flag F _P is not input state _{t I + (t 3/2} ) times when you continue, the determines that the input failure silence flag F _S and clapping sound detection flag F ₁ , F ₂ is reset. Further, after setting the detection flag F ₃ of the third clapping sound, before the age of _{t I + (t 3/2} ), when the edge detection flag F _p is input, the predetermined clap Since it is more than the number of times, it is determined that the input has failed.

Thus, according to this embodiment, the interval time period t _I of the first and second clapping sound, by reflecting the second clapping sound in the period leading up to the third gate, the gate flag F _G By automatically adjusting the interval period to be equal, and setting the _second gate period t ₂ to be relatively long, it is possible to cope with the pace of various applause of the user.

  Up to this point, the applause sound recognition in the ON-OFF mode has been described. The content of the algorithm is in accordance with the content of the prior application (Japanese Patent Application No. 2006-230879) by the present inventor, and is a highly resistant system against erroneous recognition. is there. In this embodiment, in the ON / OFF mode, the power is turned on when applause is performed three times at equal intervals. In addition, in the selection up / down mode, a graphics menu screen appears, and each time applause is performed, the operation is confirmed and a control according to the menu guidance is issued (this is applied in this application). This is described in detail in Japanese Patent Application No. 2006-335277 which describes an invention proposed by humans.)

  FIG. 5 is a timing chart for explaining the contents of applause sound recognition for realizing the selection up / down mode. Unlike the algorithm used as the ON-OFF mode described above, in the selective up / down mode, as shown in FIG. 5, the recognition signal is confirmed for each edge detection flag that is output for each applause sound. 4) (equivalent to the determination flag Fj of 4).

  FIG. 5A shows an example in which edge pulses (hereinafter referred to as edge detection flags) are obtained in time series from the edge pulse generator 108. Here, when applause sounds are detected four times as indicated by reference numerals 601 to 604. Represents. More precisely, in this mode, applause recognition is confirmed every time and control is issued four times. In FIG. 5B, gate pulses 605, 606, 607, and 608 are raised immediately after the edge detection flags 601, 602, 603, and 604 are detected, and it is confirmed that there is no edge detection flag immediately after applause. . The period of this gate is set to a period shorter than the period in which it can be continuously applauded by itself, in order to avoid misrecognition when a plurality of people strike or unintentional sound. Therefore, the protection by the gate of FIG. 5B is not always necessary, but it is preferable as a measure for enhancing the tolerance against misrecognition as much as possible.

  FIG. 5C illustrates a case where a determination signal is output when the edge detection flag is detected and recognition is confirmed, and as a result, a specific value is incremented (increased). According to the edge detection flag, the recognition is confirmed for each edge detection flag from the first definite point of the first recognition to the fourth definite point of the fourth recognition, and a determination signal is output. The control is executed. This selective up / down mode has a simpler recognition algorithm and less resistance to misrecognition than the ON-OFF mode, but it can be modified according to the menu during the specified period. Therefore, the problem of resistance is practically acceptable. In addition, the selection up / down mode is effective for creating a variety of applause sound recognition by combining with a menu screen generated by graphics described later.

  FIG. 6 is a diagram illustrating an example of how the screen of the television receiver changes when the recognition operation using the applause sound is controlled according to the determination mode. In FIG. 6, the portion surrounded by the double line on the left side shows the contents to be recognized and controlled in the applause determination mode in the ON-OFF mode. A portion surrounded by a double line on the right side of FIG. 6 shows a menu, and the applause determination mode is recognized and controlled in the selection up / down mode. Then, in order to explain the state of the television receiver according to the applause determination mode and the number of times of applause, FIG.

  In the control device described in Japanese Patent Application No. 2006-335277 proposed by the present applicant, as shown in FIG. 6, in the ON-OFF mode, the applause is turned on by turning applause three times at equal intervals. 4 times to turn off the power and menu. The screen 1 in the upper left of FIG. 6 is in a state where the power is OFF. If applause is given to the television receiver three times from this state, a screen 2a is displayed in which the television receiver is turned on by the control device of the present embodiment, and the television broadcasting or package media is being viewed. When the applause is performed three times on the screen 2a in the viewing state, a menu for changing the volume or channel of the television receiver is turned ON by the control device of the present embodiment, and the volume / channel selection menu screen of the screen 3 is displayed. Become. When this menu appears, the applause recognition method, i.e. the judgment mode, becomes the selection up / down mode on the right side of the drawing.

  On screen 3 where the menu appears, the volume and channel can be selected by one applause. Here, the case where the volume is selected and the screen is changed to the screen 7 will be described and explained. On screen 7, a volume up / down selection menu appears. This volume up / down selection menu has a volume up selection menu and a volume down selection menu that appear alternately on the screen periodically, and that menu is selected by one applause on the menu that appears on the screen. it can. Therefore, when the volume up selection menu is displayed on the screen, if the applause is performed once, the screen transitions to the screen 8 because the volume up is selected, and the applause is performed on the screen 8 until the desired volume is reached. . Here, the number of applause is the volume increase. This is a mode in which the recognition is confirmed and controlled every applause described in FIG. 5, that is, the selective up / down mode referred to here. As shown in FIG. Will be incremented.

  Returning to FIG. 6, the screen 4 when the channel is selected on the screen 3 is in a state where the channel up screen and the channel down screen are alternately switched in the same manner as in the case of the volume, and the channel up or down is changed. Can be controlled. When the up or down of the volume or channel up or down screen 5, screen 6, screen 8, or screen 9 is completed, the screen returns to the television viewing screen 2b after a specific time has elapsed. Or it returns to the television viewing state of the screen 2a by applauding 4 times. When the applause, which is a control to turn off the screen 2b in the television viewing state, is turned four times, the power is turned off. Note that the screen 2a and the screen 2b schematically show the passage of time.

  The above is power ON-OFF, channel up / down, and volume up / down by applause recognition by the control device described in Japanese Patent Application No. 2006-335277. These operations are the main operations of the television receiver, and can be frequently used without using an existing remote controller.

  The present invention avoids the problem that, when the power is turned on due to misrecognition, if the user does not notice it, the power-on state is continued against the user's will without correction. In this embodiment, the user is asked whether the user is aware that the power is turned on, and if there is no response from the user in response to the question, the power is automatically turned off to provide protection. However, if the user is asked each time the power is turned on in the recognition operation, the user becomes annoyed by the complexity and becomes unusable.

  In view of the above, the present invention proposes a measure for ensuring the protection while minimizing the confirmation work for the user as described below. That is, as will be described later in the state of the screen 2a in FIG. 6 above, a confirmation screen for automatically continuing the power-on after a certain period of time is displayed, and in the applause recognition, an operation is promoted as a selection up / down mode, or If the TV is operated during the above-mentioned certain period, it is determined that the power is kept on because the user intends to view the TV.

  7 to 10 are timing charts showing the operation and control states of the television receiver according to the first embodiment of the present invention. The horizontal axis indicates time, and the vertical axis indicates the state of each part. 7 to 10, the graphics display shown in (A) is distinguished by indicating the solid line display and the broken line indicating non-display, and the power on shown in (B) and the power off shown in (C) are distinguished. The state is indicated by a solid line, the timer b shown in (D) and the timer a shown in (E) indicate that the time is counted by the counter, and the solid line of the arrow indicates the function of the counter. The timer a and the timer b are realized by software processing of the system controller 401 shown in FIG. The power off means a state in which the power other than the device according to the recognition of the present invention is turned off.

  In addition, as operation input means, (F) and (G) in FIGS. 7 to 10 represent applause sound recognition and other operations. For applause sound recognition, one applause is represented by a single black circle, and the resulting action is represented as a recognition result. Further, FIG. 7 to FIG. 10G show determination modes obtained by the applause sound recognition unit 100. The other operations shown in FIG. 7 to FIG. 10F schematically show operations of the remote control and the switches on the television receiver body. Further, in FIG. 9F, the presence of any operation is indicated by a white circle on the same line segment.

  In the present embodiment, when the power is turned on by applause without the user's intention in the recognition operation, this is protected as a misrecognition. First, the operation of the present embodiment when none of the intended applause operation, other operation, and confirmation operation is input will be described with reference to the timing chart of FIG. The sequence of the operation and control of the television receiver in FIG. 7 starts when the power of the television receiver is turned on by three applause recognition operations (G). That is, when the user unintentionally claps three times for some reason near the television receiver in the power-off state and in the ON-OFF mode, as shown schematically in (G), 3 The applause is recognized at time t1, and as a result, the power-off state shown in (C) is changed to the power-on state as shown in (B) as shown at time t1.

  When the power is turned on by applause, the timer a starts counting from time t1 as schematically shown in FIG. 7E, and counts ta1 for a set period. The count end point of the period ta1 is time t2, and the first confirmation display is performed here. In the first confirmation display period, as shown schematically in FIG. 7D, the period tb1 in which the timer b is set is counted. Further, in the first confirmation display period, a graphic confirmation screen as shown in FIG. 11 appears as schematically shown by a solid line in FIG. This confirmation screen is a content for inquiring the user whether to continue watching the television. In addition, the user's attention is alerted not only by the confirmation screen but also by sound (voice or electronic sound).

  In the first confirmation display period in which the graphic confirmation screen is displayed, the applause recognition operation is selected from the previous ON / OFF mode (in the embodiment, the power is turned on by three applauses and turned off by four times). The up / down mode is entered, and the operation is confirmed and the control is issued every applause. In the tb1 period of the timer b, which is the first confirmation display period, as shown in FIGS. 7 (F) and (G), if confirmation work is not entered by applause recognition operation and other operations, an error will occur. It is determined that the probability of recognition is high, and the power is forcibly turned off at time t3 when the timer b has elapsed tb1 period, as schematically shown by a solid line in FIG. 7C.

  Next, the operation of this embodiment when the confirmation display screen is displayed and the user's confirmation operation is performed will be described with reference to the timing chart of FIG. 8, the same reference numerals are assigned to the same times as in FIG. 7, and the description thereof is omitted. In the operation and control sequence of the television receiver in FIG. 8, the user's confirmation operation is from the time t2 to the time t3 of the solid line portion during the display period of the first confirmation screen by the graphic display shown in FIG. The case where an operation by applause is entered during is shown. The applause recognition operation is a selection up / down mode, and the recognition operation is completed with one applause.

  That is, when a recognition result of one applause sound is obtained at time tc between the above time t2 and time t3 as schematically shown in FIG. 8G, the same figure (A) at that time tc. As shown schematically in FIG. 5, the first confirmation display scene disappears and the screen returns to the viewing state, and the power-on state continues as schematically shown in FIG.

  The confirmation operation on the confirmation screen means that the user is watching the TV, and the initial power-on was not a false confirmation, or the power was turned on due to a recognition error, but the TV was watched. It seems that I changed my mind. Therefore, the power-on state is continued even if the user confirms that the user has watched the television by entering the confirmation operation. Thereby, viewing of the television is continued by the confirmation operation. In FIG. 8, the confirmation operation on the confirmation screen is an operation based on applause recognition, but the same function can be realized by another operation such as an operation of pressing a determination button on the remote controller, for example.

  However, it is difficult to ask the user for such confirmation work every time the power is turned on by applause recognition operation. For this reason, in this embodiment, when a television operation is entered during the period (ta1) until the first confirmation screen is displayed, the confirmation screen is not displayed because the power-on was not erroneously recognized. Here, the above-mentioned “television operation” means that a channel change or volume applause recognition operation or other operation is entered.

  FIG. 9 shows a sequence when an operation to the television receiver is performed before such a confirmation screen is displayed. In FIG. 9, the same reference numerals are assigned to the same times as in FIG. 7, and the description thereof is omitted. In the operation and control sequence of the television receiver of FIG. 9, the timer a starts counting as shown schematically in FIG. 9E from time t1 when the power is turned on by applause, and within the set period ta1. When the other operation of the television receiver is entered as schematically shown by a white circle in FIG. 8F, the timer a is schematically shown in FIG. 5E at the time td when the operation is entered. Then, the operation of the counter is stopped. Thus, the continuation of power-on is determined at time td when another operation is entered, and the confirmation screen is not displayed as shown in FIG. The other operations are when the television is operated with a remote control or a main body control switch.

  FIG. 10 shows a sequence when an operation to the television receiver is performed before the confirmation screen is displayed as in FIG. In FIG. 10, the same reference numerals are assigned to the same times as in FIG. 7, and the description thereof is omitted. In the operation and control sequence of the television receiver of FIG. 10, the timer a starts counting as shown schematically in FIG. 10E from time t1 when the power is turned on by applause, and within a set period ta1. As shown schematically in FIG. 5G, when the applause recognition operation is entered, the timer a is stopped or reset as shown schematically in FIG.

  As a result, when the applause recognition operation is entered, the continuation of power-on is determined. The applause recognition operation here is control of the channel and volume by the applause recognition described above. By applauding three times in the TV viewing state, a graphical menu screen is displayed (on) as schematically shown in FIG. 10A, and it is selected and up / down by applause. .

  As described above, according to the present embodiment, if confirmation is performed by other operations or applause during the period (ta1) until the first confirmation screen is displayed, it is confirmed that the power-on was not erroneously recognized. Finish the work and keep the power on.

  Next, a second embodiment of the electronic apparatus control method according to the present invention will be described with reference to the drawings. 12 to 16 are timing charts showing the operation and control states of the television receiver according to the second embodiment of the present invention. The horizontal axis indicates time, the vertical axis indicates the state of each part, and the vertical axis items are as follows. This is the same as in FIGS. In the second embodiment, the reliability is further improved by performing the second confirmation when the first confirmation is applause recognition. That is, applause recognition in the selected up / down mode is completed with one applause, and therefore it is assumed that the same noise as applause is erroneously recognized and the confirmation is completed. Therefore, in this embodiment, the aim is to avoid misrecognition by reconfirmation. However, the channel and volume change operation by applause recognition is to applaud 3 times to bring up the menu, applause once to select the menu, and more than one applause to further up and down, If it is confirmed that there is no misrecognition, the power is turned on continuously.

  First, the operation of the present embodiment when none of the intended applause operation, other operation, and confirmation operation is input will be described with reference to the timing chart of FIG. The sequence of the operation and control of the television receiver in FIG. 12 starts when the power of the television receiver is turned on by three applause recognition operations (G). That is, when the user unintentionally claps three times for some reason near the television receiver in the power-off state and in the ON-OFF mode, as shown schematically in (G), 3 The applause is recognized at time t1, and as a result, the power-off state shown in (C) is changed to the power-on state as shown in (B) as shown at time t1.

  Then, as in the case of the first embodiment shown in FIG. 7, the timer a starts counting from the time t1 as schematically shown in FIG. 12E, and the time at the end of the counting of the set period ta1. At t2, as shown schematically in FIG. 12D, the timer b counts for the set period tb1, and a first confirmation screen is displayed as schematically shown in FIG. 12A. In the second embodiment, it is assumed that no confirmation operation has been performed during the first confirmation display period. In the second embodiment, when the confirmation operation is not performed during the first confirmation display period, the confirmation is performed as shown schematically in FIG. 12A at time t3 after the period tb1 of the first confirmation screen. As the screen automatically disappears, the timer a starts counting again as schematically shown in FIG. 5E, and switches to the ON-OFF mode as shown in FIG.

  Thereafter, from time t3, the count ends in a period ta2 in which the timer a is set as schematically shown in FIG. 12E, and the mode is switched to the selected up / down mode as shown in FIG. At the time t4 at the end of the counting, as shown schematically in FIG. 12D, the timer b is counted for the set period tb2, and the second confirmation is performed as schematically shown in FIG. A screen is displayed. If no confirmation operation is performed during the second confirmation display period, the confirmation screen is automatically displayed as shown in FIG. 12A at time t5 after the period tb2 of the second confirmation screen. And the power is forcibly turned off as schematically shown in FIG. In this way, in this embodiment, if there is no operation before the second confirmation screen display period tb2 and no confirmation operation is entered on the confirmation screen, the power is forcibly turned off.

  FIG. 17A shows a first confirmation screen, and FIG. 17B shows a second confirmation screen. As shown in FIG. 17A, the first confirmation screen has a display area that is small enough not to interfere with viewing the television. This is because even if this opportunity is missed, the power is not forcibly turned off, so it can be missed. On the other hand, as shown in FIG. 17B, the second confirmation screen prompts the confirmation operation by closing many areas of the screen that prevent viewing as the final confirmation. The first confirmation screen and the second confirmation screen are not limited to changing the size of the screen as described above, and the color and / or shape of the screen may be changed.

  In the same way as in the first embodiment, if an operation using a clap sound or other operations (remote control / main unit operation) is entered before the confirmation screen is displayed, the confirmation screen is not displayed and the power is turned on. Is. Similarly, when alerting the user with sound, attention is urged by changing the content, tone color, volume, or period of the voice between the first confirmation period and the subsequent confirmation period. For example, in the first confirmation period, the sound is not disturbed to watch TV, and a sound for raising attention is generated in the final confirmation period.

  In this way, the second confirmation requires time until the final confirmation, so that some operation is performed in the meantime, so that the user is not required to confirm, or the confirmation operation is neglected and the forced power-off is not caused. It is for aiming. As a result, when the user is actually watching the television, the power-on state is continued without the user's trouble, and when the power is turned on due to erroneous recognition, the power is turned off as in the first embodiment. It becomes possible.

  Next, the operation of this embodiment when the second confirmation display screen is displayed and the user's confirmation operation is performed will be described with reference to the timing chart of FIG. In FIG. 13, the same reference numerals are assigned to the same times as in FIG. In the operation and control sequence of the television receiver of FIG. 13, the user's confirmation operation is from time t4 to time t5 of the solid line portion during the display period of the second confirmation screen by the graphic display shown in FIG. The case where an operation by applause is entered during is shown. The applause recognition operation is a selection up / down mode, and the recognition operation is completed with one applause.

  That is, when a recognition result of one applause sound is obtained at time te between time t4 and time t5 as shown schematically in FIG. 13G, the same figure (A) at that time te. As shown schematically, the second confirmation display scene disappears and the screen returns to the viewing state, and the power-on state continues as schematically shown in FIG.

  Here, in order to secure the tolerance to misrecognition more, the confirmation operation is requested twice. If the confirmation operation is not entered when the confirmation screen is displayed for the first time, the power is supplied if the confirmation operation is entered for the second time. Continue to turn on. In FIG. 13, when the first confirmation operation is not entered and the second confirmation screen is displayed and the confirmation operation by applause is entered the second time, the power-on is continued. If a confirmation operation is entered during the period when the first confirmation screen is displayed, the confirmation operation is completed there. This is not illustrated in FIG. 13, but is the same as FIG.

  FIG. 14 shows a sequence according to the second embodiment in the case where the confirmation operation is based on the applause of the recognition operation and the user is requested to confirm the operation twice. In FIG. 14, the same reference numerals are assigned to the same times as in FIG. In the sequence of the operation and control of the television receiver in FIG. 14, the time tf between the time t2 and the time t3 of the solid line portion during the display period of the first confirmation screen by the graphic display shown in FIG. After the operation by the applause shown in FIG. 10G is entered, the applause shown in FIG. 10G is obtained at the time tg between the time t4 and the time t5 of the solid line portion during the display period of the second confirmation screen. An example in which a confirmation operation by is entered. In this case, at time tg, the second confirmation display scene disappears and the screen returns to the viewing state as schematically shown in FIG. 5A, and the power is turned on as schematically shown in FIG. The state continues.

  In this embodiment, a confirmation operation with applause is entered on the first confirmation screen, and a confirmation operation with applause is entered on the second confirmation screen, and the confirmation is completed. In the case of the applause recognition operation shown in FIG. 14, confirmation is requested twice, and if the confirmation operation is not entered even if the confirmation screen is displayed twice, forcibly as described with FIG. 13. The power is turned off. Therefore, if the second confirmation operation is not entered even if the first confirmation operation is entered, the third confirmation screen is displayed. If the confirmation operation is entered at that time, the power is turned on and the confirmation operation is not entered. Then the power is forcibly turned off.

  FIG. 15 shows a sequence of the second embodiment in the case where another operation is entered before the second confirmation screen is displayed. In FIG. 15, the same time as in FIG. In the operation and control sequence of the television receiver in FIG. 15, no operation input is made when the first confirmation screen is displayed, but at the time th before the second confirmation screen is displayed. As schematically shown by white circles in FIG. 15 (F), when other operations are performed, the confirmation work is completed assuming that the user is watching the television, and as shown in FIG. The power on is continued without displaying the confirmation screen of 2.

  FIG. 16 shows a sequence of the second embodiment in the case where a volume or channel up / down operation is entered with a clap sound. In FIG. 16, the same reference numerals are assigned to the same times as in FIG. In the operation and control sequence of the television receiver of FIG. 16, no operation input was made when the first confirmation screen was displayed, but before the second confirmation screen was displayed, FIG. As schematically shown in G), applause sound recognition operation menu is displayed as shown in FIG.

  As a result, when a clap recognition operation is entered, the timer a is stopped or reset as shown schematically in FIG. . The applause recognition operation here is control of the channel and volume by the applause recognition described above. Also in this case, in this embodiment, as in FIG. 15, it is assumed that the user is watching the television, and the confirmation operation is completed, and the power-on is continued without displaying the second confirmation screen.

  In the second embodiment, the confirmation operation or confirmation screen is performed twice (a plurality of three or more may be used), so that a deeper confirmation operation can be performed. As a response to the recognition error of the recognition operation, it is possible to optimize the degree of confirmation in a quiet television viewing environment or an environment in which erroneous recognition is likely to occur due to noise or the like.

  Next, an embodiment of the electronic device control method of the present invention will be described. FIG. 18 shows a flowchart of an embodiment of a method for controlling an electronic apparatus according to the present invention. This flowchart is executed by the system controller 401 shown in FIG. First, the power supply is turned off and a power-on (ON) recognition determination is made (step S1). In step S1 of the power-on recognition determination, the power of the television receiver is in an off state (a state in which the power other than the apparatus according to the present invention is turned off). Is turned on (step S2). If three applause sounds are not recognized, the power-on recognition determination is continuously monitored. In this flowchart, the power-on is a recognition operation, and the power-off can be a remote control classified as another operation or a switch operation of the main body. The algorithm of this program is for protection against erroneous recognition of recognition operation, and is processing when power is turned on by recognition operation (applause sound or image recognition).

  When the power is turned on in step S2, the counter Ca is reset to the initial state (step S5r), and then the counter Ca is incremented (count value is increased) (step S5i). Subsequently, it is determined whether the power is off (OFF) (step S3). In step S3 of the power-off determination, when the applause sound is recognized four times, or when the power-off is determined by recognizing the operation of the power switch of the remote controller or the main body, the power is turned off (step S4) and the process returns to the start. .

  On the other hand, if it is determined in the power-off determination step S3 that the power is not off (the power is on), it is evaluated whether a recognition operation has been entered (step S6) or another operation has been entered (step S7). When this evaluation is YES, the count of the counter Ca is stopped (step S8), and this program is terminated. This is because it was determined that the TV was turned on at the user's will and the purpose of this program was achieved.

  When the evaluations in step S6 and step S7 are NO, it is determined whether or not the count value of the counter Ca has become larger than a value corresponding to the set period ta of the timer a (step S9). When the counter value of the counter Ca does not exceed the value corresponding to the set period ta, the process proceeds to step S5i, and the counter Ca in the power-on viewing state is incremented. On the other hand, when the counter value of the counter Ca exceeds a value corresponding to the set period ta, the counter Cb is reset to an initial state (step S10r), and then the counter Cb is incremented (count value is increased) (step S10i). . This counter Cb is for setting the display period of the confirmation message. Subsequently, the confirmation message of FIG. 11 is displayed in confirmation message display step S11. This confirmation message prompts the user to perform a confirmation operation.

  Following the display of the confirmation message in step S11, it is evaluated whether or not a confirmation operation has been entered (step S12). When the confirmation operation is not entered, it is determined whether or not the count value of the counter Cb has become larger than the value corresponding to the set period tb of the timer b (step S14). In step S14 of the timer b, the period during which the confirmation message is displayed is evaluated. When the count value of the counter Cb is equal to or smaller than the value corresponding to the set period tb of the timer b, the confirmation is made via the power OFF determination step S15. The process returns to step S10i to continuously display the message. The power OFF determination step S15 is a case where the power is turned off by the remote control or the power switch of the main body.

  On the other hand, when it is determined in step S14 that the count value of the counter Cb is equal to or greater than the value corresponding to the set period tb of the timer b, the process proceeds to step S4 and the power supply is forcibly cut off. This is a process of turning off the power because it is considered that the user has not reacted when the user does not perform the confirmation operation in the confirmation message display period tb, and the power-on may be erroneously recognized. On the other hand, if it is determined in step S12 that a confirmation operation has been entered, it is determined that the user has responded, the confirmation message is deleted (step S13), and the program is terminated.

  Next, each embodiment of the electronic apparatus control device of the present invention will be described. FIG. 19 is a block diagram of Embodiment 1 of the control apparatus for electronic equipment according to the present invention. In the figure, the same components as those in FIG. In FIG. 19, a television receiver 408 that is an electronic device to be controlled and a user 409 who is watching the television are surrounded by a double line. A confirmation operation regarding viewing of the television of the present embodiment is performed between the television receiver 408 and the user 409.

  The television receiver 408 is an electronic device that controls (remotely operates) operation by applause sound according to the present embodiment. The television receiver 408 includes a microphone 101, an amplifier 102, a applause sound recognition unit 100, and other components. An operation unit 310, a main body speaker 201, a main body amplifier 202, an amplifier 203, a system controller (CPU) 401, a graphics generator 402, a tuner 403, a video mixer 404, and a display device 405 are provided.

  The television receiver 408 receives an RF signal obtained by modulating a television signal with a high-frequency carrier signal. The tuner 403 selects an RF signal from a broadcast station of a desired channel, obtains a band-compressed signal that is demodulated, and then decodes the signal to output a video signal and an audio signal. The audio signal is amplified by the main body amplifier 202 and supplied to the main body speaker 201, thereby being subjected to electro-acoustic conversion and radiated into the air as a sound wave. Further, the output analog audio signal of the main body amplifier 202 is amplified by the amplifier 203 and is supplied to the A / D converter 204 in the applause sound recognition unit 100 described with reference to FIG.

  On the other hand, the sound wave of the viewing environment is acoustic-electrically converted by the microphone 101 to be converted into an analog audio signal, amplified to an appropriate amplitude by the amplifier 102, and A / D in the applause sound recognition unit 100 shown in FIG. Input to the converter 103. The applause sound recognition unit 100 recognizes the applause sound according to the determination mode obtained from the system controller 401. As described above, there are two types of determination modes, the ON-OFF mode and the selective up / down mode. In accordance with this determination mode, the applause sound recognition unit 100 recognizes the applause sound according to the algorithm described above, and outputs the recognition result to the system controller 401 as a determination signal.

  The system control controller distinguishes whether the determination signal is a power-on control when the applause is recognized three times or a power-off control when the applause is recognized four times in the ON-OFF mode according to the determination mode. 401. In the selection up / down mode, since the recognition is confirmed every applause, it is transmitted as a determination signal that the recognition is made every applause.

  The system controller 401 controls the entire system of the television receiver 408 in an integrated manner, and is constituted by, for example, a central processing unit (CPU), and displays power ON-OFF, menu ON-OFF, and appropriate menu display. Control of state transitions of all television receivers 408, such as volume setting and up / down, channel setting and up / down, and the like. The system controller 401 outputs an appropriate determination mode according to the state of the applause sound recognition unit 100, receives a determination signal from the applause sound recognition unit 100, and outputs an appropriate control signal to control the television receiver 408. Further, the operation result of the other operation unit 310 is input to the system controller 401. The other operation unit 310 is assumed to output a result obtained by analyzing a code obtained from the light receiving unit of the remote controller and an operation by a switch installed in the main body of the television receiver 408.

  In this embodiment, when the power is turned on by applause sound recognition, a confirmation screen is displayed to the user after a certain period. This confirmation screen is generated by the graphics generator 402 after the system controller 401 counts the set period ta1 of the timer a. The display period of the confirmation screen is controlled by the system controller 401 by counting the set period tb1 of the timer b.

  The output signal of the graphics generator 402 is mixed by the video signal mixer 404 with the video signal of the desired TV broadcast station output from the tuner 403. The mixed video signal is displayed on the display device 405. Therefore, the display image of the display device 405 is a content in which the menu image generated by the graphics generator 402 is multiplexed on the television broadcast screen. Although a graphics-only menu screen is also conceivable, it is preferable that a television image is flowing in the background and that the menu screen can also be recognized. Various methods of multiplexing by the video mixer 404 are conceivable, but since they are not the gist of the present invention, detailed description thereof will be omitted.

  In the configuration of FIG. 19, the user 409 responds to the television receiver 408 that the user is watching the television by performing an operation with applause of confirmation or other operations in accordance with the content displayed on the confirmation screen of the display device 405. Accordingly, as shown by a broken line in FIG. 19, when the user 409 views and operates the display screen 405, a feedback loop is formed between the television receiver 408 and the user 409, thereby enabling confirmation work. The embodiment of FIG. 19 is an example in which the user 409 visually recognizes the image of the menu screen of the selection generated by the graphics generator 402 and applauds it at an appropriate timing. The confirmation operation is performed through the other operation unit 310 or by the applause sound by the user 409.

  Next, a second embodiment of the electronic apparatus control apparatus of the present invention will be described. FIG. 20 is a block diagram of Embodiment 2 of the control apparatus for electronic equipment according to the present invention. In the figure, the same components as those in FIG. 19 are denoted by the same reference numerals, and the description thereof is omitted. In FIG. 20, a television receiver 410 is an electronic device whose operation is controlled (remotely operated) by applause sound according to the present embodiment, and the television receiver 408 shown in FIG. As compared with the above, the video mixer 404 is deleted, and a sound generator 406 and an audio mixer 407 are added. The present embodiment is configured to prompt a confirmation operation by the sound generated by the sound generator 406, rather than performing a confirmation operation by looking at the graphics confirmation screen as in the embodiment of FIG. The sound generator 406 may generate a sound that does not become a word such as a notification sound.

  In FIG. 20, the sound generator 406 generates a confirmation audio signal based on the control of the system controller 401. The sound signal for confirmation output from the sound generator 406 is mixed with the analog sound signal of the desired TV broadcast obtained from the tuner 403 by the sound mixer 407. The mixed audio signal is amplified by the main body amplifier 202 and output as a sound wave from the main body speaker 201, while being amplified to a required level by the amplifier 203 and supplied to the after-applause sound recognition unit 100.

  In the configuration of FIG. 20, the user 409 performs an operation with confirmation applause or other operations of the operation unit 310 according to the mixed content of the sound of the desired TV broadcast program output from the main body speaker 201 and the confirmation sound or the confirmation notification sound. Then, it responds to the television receiver 408 that the user is watching the television. Accordingly, as shown by a broken line in FIG. 20, when the user 409 hears and operates the confirmation sound or the confirmation notification sound, a feedback loop is formed between the television receiver 408 and the user 409, and the confirmation applause. Confirmation by sound operation and other operations becomes possible. In the present embodiment, the user 409 can be more alerted when the sound and the image are used together for the confirmation work.

  19 and FIG. 20, even when the power is turned off, the amplifiers 203 and 102, the applause sound recognition unit 100, the other operation unit 310, and the system controller 401 are in the standby state of the television receivers 408 and 410. The power supply is always energized, and the power-on operation can be obtained by remote control or recognition operation.

  In the embodiments and examples of the present invention described above, the error that is an essential problem of the recognition operation when the television receiver (electronic device) is remotely controlled using the recognition operation result of images and non-sound. Protection against recognition can be achieved. The misrecognition in this case is not only a problem of recognition accuracy, but also a problem including misrecognition of an operation not intended by a person. In the embodiments and examples of the present invention, even if there are many differences in recognition between people, in most cases, when feedback work of confirmation is entered, feedback is given to the user through a screen or a speaker. The problem of misrecognition described above is solved by realizing interactive confirmation work between the receiver and the user.

  Such an effect of the present embodiment and the example is that the problem that the power is kept on when the power is turned on due to misrecognition can be controlled to an appropriate state by checking with a screen or sound. It can be done. That is, according to the present embodiment and example, when power is turned on due to erroneous recognition, the power can be forcibly turned off, and waste of power can be suppressed. In addition, when a general operation such as a channel or volume is entered before confirmation, the confirmation screen is not displayed on the assumption that the user is willing to watch the television, so the burden on the user can be reduced. . Furthermore, according to the present embodiment and the example, the confirmation operation can be realized by applause or image recognition operation, so that there is an advantage that it is less time-consuming than when operating a device such as a remote controller or a main body.

  In addition, although the recognition operation of the above embodiment and an Example was concretely demonstrated by recognition operation by a applause sound, it replaced with recognition operation by a applause sound, for example, this inventor made Japanese Patent Application No. 2006-297432 and a patent application. The present invention can also be applied to a recognition operation based on image recognition as proposed in 2006-277140. In the electronic device based on image recognition described in Japanese Patent Application No. 2006-297432, an operator positioned in front of a display device in the electronic device is photographed with a video camera provided in the electronic device, and the screen of the photographed image is horizontally oriented. Photographed by the video camera using a plurality of detectors provided corresponding to each of a plurality of detection areas divided into N (N is a natural number of 2 or more) and M divided in the vertical direction (M is a natural number of 2 or more). The operation performed by the operator is controlled based on the detection result of how the captured image is detected in the plurality of detection areas.

  According to this electronic device, a photographed image of an operation in which the operator shakes his / her hand vertically (up and down) with a video camera in a state where the power of the electronic device remains off and nothing is displayed on the display device. If it is recognized, turn on the power. In addition, when the electronic device is turned on and any image is displayed on the display device, the power is turned off when the operator recognizes an action of shaking his / her hand to the side (left / right) from a captured image taken with a video camera. To. The power OFF is a state in which the power other than the device according to the recognition of the present invention is turned off, for example, the display device is not displaying as described above.

  In addition, in the control apparatus for electronic devices based on image recognition described in Japanese Patent Application No. 2006-277140, an operator positioned in front of the display device in the electronic device is photographed with a video camera provided in the electronic device, and the photographed image is captured. The mixed image signal displayed on the display device by mixing the mirror image conversion image signal obtained by mirror image conversion and the operation image signal corresponding to the operation image including a plurality of operation detection areas, and displaying the mixture on the display device. An operation detection area determined to be indicated by the operator displayed in the image is detected from a plurality of operation detection areas in the image, and the control operation of the electronic apparatus corresponding to the detected operation detection area is performed. The recognition operation by the image recognition is, for example, an operation of shaking a hand vertically or clicking a specific button in the space when the power is turned on in a state where the image of the mixed image signal is displayed on the display device. Perform the action.

  In addition, this invention is not limited to the above embodiment and Example, For example, the applause sound recognition process demonstrated with FIGS. 1-4, said image recognition process, or the flowchart shown in FIG. It also includes a control program for electronic equipment executed by a computer. The electronic device control program may be recorded on a recording medium and loaded into a computer, or may be distributed via a communication network and loaded into a computer, or may be incorporated into an electronic device. Good.

It is a block diagram of the principal part of one Embodiment of the control apparatus of the electronic device of this invention. FIG. 2 is a diagram illustrating a state of an input waveform of the A / D converter of FIG. 1 and a relationship between signals before and after A / D conversion. It is a block diagram of an example of the determination process part in FIG. It is a timing chart explaining the determination processing algorithm of ON-OFF mode in the present invention. It is a timing chart explaining the determination algorithm of selection up-down mode in the present invention. It is a figure showing an example of the control method of an electronic device of this invention, and an example of a state transition. It is a timing diagram which shows the operation and control state of the television receiver in Example 1 of this invention, and is a timing diagram when none of the intended applause operation, other operation, and confirmation operation is input. It is a timing diagram which shows the operation and control state of the television receiver in Example 1 of this invention, and is a timing diagram in case a confirmation display screen is displayed and a user's confirmation operation enters. FIG. 6 is a timing chart showing the operation and control states of the television receiver according to the first embodiment of the present invention, and is a timing chart when an operation by another operation on the television receiver is entered before the confirmation screen is displayed. is there. It is a timing diagram which shows the operation and control state of the television receiver in Example 1 of this invention, and is a timing diagram when operation by applause to a television receiver enters before a confirmation screen is displayed. It is a figure which shows the display content of the confirmation screen of Example 1. FIG. It is a timing diagram which shows the state of operation and control of the television receiver in Example 2 of this invention, Comprising: It is a timing diagram when none of the intended applause operation, other operation, and confirmation operation is input. FIG. 9 is a timing chart showing the state of operation and control of the television receiver according to the second embodiment of the present invention. FIG. In the timing chart showing the state of operation and control of the television receiver in the embodiment 2 of the present invention, when the first and second confirmation screens are displayed, an operation by applause to the television receiver has entered. FIG. FIG. 9 is a timing chart showing the state of operation and control of the television receiver according to the second embodiment of the present invention when an operation by another operation on the television receiver is entered before the second confirmation screen is displayed. It is a timing diagram. The timing diagram which shows the operation and control state of the television receiver in Example 2 of this invention, and the timing diagram when operation by the applause to the television receiver enters before the second confirmation screen is displayed It is. It is a figure which shows the display content of the 1st confirmation screen in Example 2 of this invention, and a 2nd confirmation screen. It is a flowchart of one embodiment of a control method of an electronic device of the present invention. It is a block diagram of Example 1 of the control apparatus of the electronic device of this invention. It is a block diagram of Example 2 of the control apparatus of the electronic device of this invention.

Explanation of symbols

100 applause sound recognition unit 101 microphone 102, 203 amplifier 103, 204 A / D converter 104, 205 offset component removal unit 105, 206 absolute value circuit 106 main body sound removal unit 107 edge signal extractor 108 edge pulse generator 109 determination processing Unit 110 noise state detection unit 201 main unit speaker 310 other operation unit 401 system controller 402 graphics generator 403 tuner 404 video mixer 405 display device 406 sound generator 407 audio mixer 408, 410 television receiver 409 user 1091 Counter 1092 judgment processor

Claims (12)

A display device that recognizes an operation of the operator using a photographed image obtained by photographing the operator or a sound wave intermittently emitted by the operator and performs control corresponding to the recognized operation on the electronic device to be controlled. In the control method of the equipped electronic device,
A signal generation step of generating a captured image signal obtained by photographing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator;
An operation for recognizing the operation of the operator by detecting a specific operation of the operator based on the captured image signal or detecting the number of sound generations of the intermittently generated sound wave based on the audio signal. A recognition step;
A detection step for detecting that the operation recognized in the operation recognition step is a power-on operation to the electronic device;
A first power control step for controlling the electronic device to power on when the power on operation is detected in the detecting step;
After turning on the power of the electronic device, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device after the first period has elapsed, or voice sound generation means A confirmation step for performing an operation confirmation process to pronounce
After the operation confirmation processing by the confirmation step is started, the signal generation step and the operation recognition step are executed again within a preset second period to determine whether or not an operation for confirmation has been performed. A confirmation determination step;
When it is determined that the confirmation operation is performed within the second period, the electronic device is kept powered on, and when it is determined that the confirmation operation is not performed within the second period And a second power control step of controlling the electronic device to forcibly turn off the power after the second period has elapsed. Before the first period elapses from the time when the power-on operation is detected in the detection step, any operation other than the captured image, the sound wave, or the captured image and the sound wave operation is performed on the electronic device. An operation determination step for determining whether or not
When it is determined in the operation determination step that the arbitrary operation has been performed, the operation to continue the power-on state without executing the confirmation step, the confirmation determination step, and the second power control step The method according to claim 1, wherein the steps are executed. A display device that recognizes an operation of the operator using a photographed image obtained by photographing the operator or a sound wave intermittently emitted by the operator and performs control corresponding to the recognized operation on the electronic device to be controlled. In the control method of the equipped electronic device,
A signal generation step of generating a captured image signal obtained by photographing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator;
An operation for recognizing the operation of the operator by detecting a specific operation of the operator based on the captured image signal or detecting the number of sound generations of the intermittently generated sound wave based on the audio signal. A recognition step;
A detection step for detecting that the operation recognized in the operation recognition step is a power-on operation to the electronic device;
A first power control step for controlling the electronic device to power on when the power on operation is detected in the detecting step;
After turning on the power of the electronic device, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device after the first period has elapsed, or voice sound generation means A first confirmation step for performing an operation confirmation process of whether to pronounce
Whether or not an operation for confirmation has been performed by executing the signal generation step and the operation recognition step again within a preset second period after the start of the operation confirmation processing in the first confirmation step. A first confirmation determination step for determining
After the second period and a preset third period have elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device or sounded by a sound generation unit. A second confirmation step for performing an operation confirmation process of
Whether the signal generation step and the operation recognition step are executed again within the fourth period set in advance after the operation confirmation process is started in the second confirmation step, and whether or not a confirmation operation has been performed. A second confirmation determining step for determining;
The second confirmation step and the second confirmation determination step are alternately repeated for a preset number of times, and when it is determined that the confirmation operation has been performed at least in the final second confirmation determination step, When it is determined that the confirmation operation is not performed in the first confirmation determination step and all the second confirmation determination steps, the electronic device is kept in a power-on state. And a second power control step of controlling the electronic device to forcibly turn off the power after the fourth period of step elapses.   Each of the first confirmation step and the one or more second confirmation steps displays a signal for prompting the operator to confirm the operation by the display device stored in advance, or 4. The method of controlling an electronic device according to claim 3, wherein the operation confirmation process of whether or not the sound is generated by the sound generation means is displayed or sounded with different contents. A display device that recognizes an operation of the operator using a photographed image obtained by photographing the operator or a sound wave intermittently emitted by the operator and performs control corresponding to the recognized operation on the electronic device to be controlled. In the control device for the electronic equipment provided,
A voice pronunciation means for generating voice;
A signal generation means for generating a captured image signal corresponding to a captured image obtained by capturing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator;
An operation for recognizing the operation of the operator by detecting a specific operation of the operator based on the captured image signal or detecting the number of sound generations of the intermittently generated sound wave based on the audio signal. Recognition means;
Detection means for detecting that the operation recognized by the operation recognition means is a power-on operation to the electronic device;
First power control means for controlling the electronic device to power on when the detection means detects the power-on operation;
After turning on the power of the electronic device, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device after the first period has elapsed, or voice sound generation means Confirmation means for performing an operation confirmation process to pronounce
Whether or not an operation for confirmation is performed by controlling the signal generation unit and the operation recognition unit to operate again within a second period set in advance after the operation confirmation process is started by the confirmation unit. Confirmation determination means for determining;
When it is determined that the confirmation operation is performed within the second period, the electronic device is kept powered on, and when it is determined that the confirmation operation is not performed within the second period And a second power control unit for controlling the electronic device to forcibly turn off the power after the second period has elapsed. Any operation other than the captured image or the sound wave or the captured image and the sound wave operation is performed on the electronic device before the first period elapses from the time when the power-on operation is detected by the detection unit. Operation determination means for determining whether or not
6. The electronic device control device according to claim 5, further comprising: an operation continuation unit that continues the power-on state of the electronic device when the operation determination unit determines that the arbitrary operation has been performed. . A display device that recognizes an operation of the operator using a photographed image obtained by photographing the operator or a sound wave intermittently emitted by the operator and performs control corresponding to the recognized operation on the electronic device to be controlled. In the control device for the electronic equipment provided,
A voice pronunciation means for generating voice;
A signal generation means for generating a captured image signal corresponding to a captured image obtained by capturing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator;
An operation for recognizing the operation of the operator by detecting a specific operation of the operator based on the captured image signal or detecting the number of sound generations of the intermittently generated sound wave based on the audio signal. Recognition means;
Detection means for detecting that the operation recognized by the operation recognition means is a power-on operation to the electronic device;
First power control means for controlling the electronic device to power on when the detection means detects the power-on operation;
After turning on the power of the electronic device, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device after the first period has elapsed, or voice sound generation means First confirmation means for performing an operation confirmation process of whether or not to pronounce,
After the operation confirmation process is started by the first confirmation unit, the signal generation unit and the operation recognition unit are controlled to operate again within a preset second period, and an operation for confirmation is performed. First confirmation determination means for determining whether or not
After the second period and a preset third period have elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device or sounded by a sound generation unit. Second confirmation means for performing an operation confirmation process of
An operation for confirmation is performed by controlling the signal generating means and the operation recognizing means to operate again within a fourth period preset after the operation confirmation processing by the second confirmation means is started. Second confirmation determination means for determining whether or not
The operation by the second confirmation unit and the operation by the second confirmation determination unit are alternately repeated a predetermined number of times, and the confirmation operation is performed at least in the final operation of the second confirmation determination unit. When it is determined that the electronic device has been turned on, the electronic device is kept powered on, and the confirmation operation is not performed in any of the operations of the first confirmation determination unit and the second confirmation determination unit of all times. A second power control means for controlling the electronic device to forcibly turn off the power after the fourth period has elapsed in the final operation of the second confirmation judgment means. An electronic apparatus control device comprising:   Each of the first confirmation means and the second confirmation means displays a signal for prompting the operator to confirm the operation by the display device stored in advance, or by the voice sound generation means. The electronic device control device according to claim 7, wherein the operation confirmation processing for sound generation is displayed or sounded with different contents. A computer is used to recognize the operation of the operator using a captured image obtained by photographing the operator or a sound wave intermittently emitted by the operator, and to perform control corresponding to the recognized operation on the electronic device to be controlled. In a control program for an electronic device equipped with a display device,
In the computer,
A signal generation step of generating a captured image signal obtained by photographing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator;
An operation for recognizing the operation of the operator by detecting a specific operation of the operator based on the captured image signal or detecting the number of sound generations of the intermittently generated sound wave based on the audio signal. A recognition step;
A detection step for detecting that the operation recognized in the operation recognition step is a power-on operation to the electronic device;
A first power control step for controlling the electronic device to power on when the power on operation is detected in the detecting step;
After turning on the power of the electronic device, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device after the first period has elapsed, or voice sound generation means A confirmation step for performing an operation confirmation process to pronounce
After the operation confirmation processing by the confirmation step is started, the signal generation step and the operation recognition step are executed again within a preset second period to determine whether or not an operation for confirmation has been performed. A confirmation determination step;
When it is determined that the confirmation operation is performed within the second period, the electronic device is kept powered on, and when it is determined that the confirmation operation is not performed within the second period And a second power control step of controlling the electronic device to forcibly turn off the power after the second period has elapsed. Before the first period elapses from the time when the power-on operation is detected in the detection step, any operation other than the captured image, the sound wave, or the captured image and the sound wave operation is performed on the electronic device. An operation determination step for determining whether or not
When it is determined in the operation determination step that the arbitrary operation has been performed, the operation to continue the power-on state without executing the confirmation step, the confirmation determination step, and the second power control step 10. The electronic device control program according to claim 9, wherein the computer is caused to execute steps. A computer is used to recognize the operation of the operator using a captured image obtained by photographing the operator or a sound wave intermittently emitted by the operator, and to perform control corresponding to the recognized operation on the electronic device to be controlled. In a control program for an electronic device equipped with a display device,
In the computer,
A signal generation step of generating a captured image signal obtained by photographing the operator or a sound signal corresponding to a sound wave intermittently emitted by the operator;
An operation for recognizing the operation of the operator by detecting a specific operation of the operator based on the captured image signal or detecting the number of sound generations of the intermittently generated sound wave based on the audio signal. A recognition step;
A detection step for detecting that the operation recognized in the operation recognition step is a power-on operation to the electronic device;
A first power control step for controlling the electronic device to power on when the power on operation is detected in the detecting step;
After turning on the power of the electronic device, after a preset first period has elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device after the first period has elapsed, or voice sound generation means A first confirmation step for performing an operation confirmation process of whether to pronounce
Whether or not an operation for confirmation has been performed by executing the signal generation step and the operation recognition step again within a preset second period after the start of the operation confirmation processing in the first confirmation step. A first confirmation determination step for determining
After the second period and a preset third period have elapsed, a signal for prompting the operator to confirm the operation is displayed on the display device or sounded by a sound generation unit. A second confirmation step for performing an operation confirmation process of
Whether the signal generation step and the operation recognition step are executed again within the fourth period set in advance after the operation confirmation process is started in the second confirmation step, and whether or not a confirmation operation has been performed. A second confirmation determination step for determining;
The second confirmation step and the second confirmation determination step are alternately repeated for a preset number of times, and when it is determined that the confirmation operation has been performed at least in the final second confirmation determination step, When it is determined that the confirmation operation is not performed in the first confirmation determination step and all the second confirmation determination steps, the electronic device is kept in a power-on state. And a second power supply control step for controlling the electronic device to forcibly turn off the power after the fourth period of step elapses.   Each of the first confirmation step and the one or more second confirmation steps displays a signal for prompting the operator to confirm the operation by the display device stored in advance, or 12. The control program for an electronic device according to claim 11, wherein the computer is caused to execute an operation confirmation process as to whether the sound is generated by the sound generation means so that the sound is displayed or pronounced with different contents.

Images