JP2003250061A - Operation device, operation method for the operation device, electronic device, operation control method for the electronic device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow an electronic device to execute complicated processing by a simple operation of a remote controller. <P>SOLUTION: A decode program 41a demultiplexes a signal resulting from multiplexing respective signals of voice data and a command sent from the remote controller, decodes the demultiplexed signals, and outputs the voice data to a voice recognition program 41b and the command to a command interpret program 41c. The voice recognition program 41b recognizes the voice and outputs recognized contents to a selection display program 41e as text data. The command interpret program 41c interprets contents of the command and outputs the interpreted result to a selection display program 41e. The selection display program 41e displays a corresponding program on a monitor 40 on the basis of contents of the interpreted command text information corresponding to the voice. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operating device, an operating method of the operating device, an electronic device, an operation control method, and a program, and more particularly, when operating a target electronic device by operating a remote controller,
The present invention relates to an operating device, an operating method of the operating device, an electronic device, an operation control method of the electronic device, and a program, which are capable of realizing a more complicated operation by an easy operation by combining voice instructions.

[0002]

2. Description of the Related Art A so-called remote controller, which is capable of executing a predetermined operation by sending various commands from a position away from a target electronic device by a predetermined distance, is becoming popular. For example, when a remote controller that operates a television receiver is operated by a user and a predetermined operation is performed, a prestored signal is output to the television receiver according to the operation content. Upon receiving this signal, the television receiver executes a corresponding process such as switching to a corresponding channel or adjusting the volume.

[0003]

However, in the above-mentioned configuration, the main purpose is to execute fixed processing such as preset channel switching processing and volume adjustment. Therefore, there is a problem in that it is not possible to execute processing that is not set in advance, and it is not possible to meet the demands of a wide variety of users. Further, in order to solve the above problems, remote controllers are becoming more multifunctional so that a wide variety of commands can be selected. However, the more multifunctional remote controllers, the more operation buttons tend to increase. However, there is a problem that the operation itself becomes complicated as a result.

The present invention has been made in view of such a situation, and makes it possible to cause a target electronic device to perform a more complicated operation by adding a simple operation of a remote controller.

[0005]

SUMMARY OF THE INVENTION An operating device of the present invention includes a voice input means for inputting voice, a command input means for inputting a command to an electronic device, a voice and a command for multiplexing, and generating a multiplexed signal. And multiplexing means for transmitting the multiplexed signal to the electronic device.

The transmitting means may be adapted to transmit the multiplexed signal to the electronic equipment by infrared communication.

The transmitting means may transmit the multiplexed signal to the electronic device by Bluetooth.

The operating method of the operating device according to the present invention includes a voice input step of inputting voice, a command input step of inputting a command to an electronic device, and a multiplexing for multiplexing voice and command to generate a multiplexed signal. And a transmitting step of transmitting the multiplexed signal to the electronic device.

A first program of the present invention is a voice input control step for controlling voice input, a command input control step for controlling command input to electronic equipment, multiplexing voice and command, and multiplexing signal. And a transmission control step for controlling the transmission of the multiplexed signal to the electronic device.

The electronic equipment of the present invention recognizes the receiving means for receiving the multiplexed signal, the separating means for separating the voice and the command from the multiplexed signal received by the receiving means, and the voice separated by the separating means. And a motion control unit that controls the motion of the unit in response to the recognition content recognized by the voice recognition unit and the command separated by the separation unit.

The receiving means may receive the multiplexed signal by infrared communication.

The receiving means may receive the multiplexed signal by Bluetooth.

It is possible to further provide a storage means for storing the recognition content together with the number of times of recognition in the past, and the operation control means has the recognition content, the number of times the recognition content is recognized in the past, and , Corresponding to the command
It can be made to control its own motion.

The electronic equipment operation control method of the present invention comprises a receiving step of receiving a multiplexed signal, a separating step of separating a voice and a command from the multiplexed signal received in the processing of the receiving step, and a separating step. Action control that controls its own action in response to the voice recognition step that recognizes the voice separated in the process, the recognition content that was recognized in the process of the voice recognition step, and the command that was separated in the process of the separation step And a step.

A second program of the present invention is a reception control step for controlling reception of a multiplexed signal, and a separation control for controlling separation of voice and command from the multiplexed signal whose reception is controlled by the processing of the reception control step. A control step, a voice recognition control step for controlling recognition of voices separated by the processing of the separation control step, a recognition content whose recognition is controlled by the processing of the voice recognition step, and a separation controlled by the processing of the separation control step The computer is caused to execute an operation control step of controlling its own operation in response to the issued command.

In the electronic equipment operating system according to the present invention, the operating device multiplexes the voice input means for inputting voice, the command input means for inputting a command to the electronic equipment, the voice and the command, and generates the multiplexed signal. And a transmitting means for transmitting the multiplexed signal to the electronic device, wherein the electronic device receives the multiplexed signal, and receives the voice and the command from the multiplexed signal received by the receiving device. Controls its own operation in response to the separating means for separating, the voice recognizing means for recognizing the voice separated by the separating means, the recognition content recognized by the voice recognizing means, and the command separated by the separating means. And an operation control means for performing the operation.

In the operating method of the electronic equipment operating system of the present invention, the operating method of the operating device is such that a voice input step of inputting a voice, a command input step of inputting a command to the electronic equipment, and a voice and a command are multiplexed. , A multiplexing step of generating a multiplexed signal, and a transmitting step of transmitting the multiplexed signal to an electronic device, wherein the operation control method of the electronic device includes a receiving step of receiving the multiplexed signal and a process of the receiving step. A separation step of separating a voice and a command from the received multiplexed signal, a voice recognition step of recognizing the voice separated by the processing of the separation step, a recognition content recognized by the processing of the voice recognition step, and a separation And an operation control step of controlling its own operation in response to the command separated in the step processing.

A third program according to the present invention includes a voice input control step of controlling voice input to a computer controlling an operating device, a command input control step of controlling command input to an electronic device, and a voice. The command for multiplexing, the multiplexing control step for controlling the generation of the multiplexed signal, and the transmission control step for controlling the transmission of the multiplexed signal to the electronic device are executed, and the computer for controlling the electronic device performs the multiplexing. The reception control step that controls the reception of signals, the separation control step that controls the separation of voice and command from the multiplexed signal whose reception is controlled by the processing of the reception control step, and the separation is controlled by the processing of the separation control step. Speech recognition control step for controlling the recognition of the generated speech, the recognition content whose recognition is controlled by the processing of the speech recognition control step, and the separation control step. Tsu in response to a command separation was controlled by a process-flop, characterized in that to execute an operation control step of controlling their operation.

In the operating device, operating method, and program of the present invention, voice is input, a command is input to an electronic device, voice and command are multiplexed, a multiplexed signal is generated, and a multiplexed signal is generated. Sent to electronic device.

In the electronic apparatus, the operation control method, and the program of the present invention, a multiplexed signal is received, and a voice and a command are separated from the received multiplexed signal,
The separated voice is recognized, and its own operation is controlled according to the recognized content and the separated command.

In the electronic equipment operating system, operating method, and program according to the present invention,
The voice is input, the command is input to the electronic device, the voice and the command are multiplexed, the multiplexed signal is generated, the multiplexed signal is transmitted to the electronic device, the electronic device receives the multiplexed signal, A voice and a command are separated from the received multiplexed signal, the separated voice is recognized, and its own operation is controlled in accordance with the recognized recognition content and the separated command.

[0022]

1 is a block diagram showing the configuration of an embodiment of a broadcasting system according to the present invention. The personal computer 1 inputs the signal supplied from the antenna 2 that receives the ground wave transmitted from the antenna 12 of the broadcasting station 11, and based on the input signal, a predetermined image and sound (so-called program image and Sound) and display or record the image and sound.

The personal computer 1 is an IEEE
(Institute of Electrical and Electronic Engineer
s) Play back images and sounds corresponding to the digital data supplied from the set top box 4 via a network such as 1394, and output or record the images and sounds.

The personal computer 1 includes a set top box 4 and an image or audio signal of the received program.
It outputs the image or audio signal of the program supplied from, or the recorded image or audio signal.

Further, in the personal computer 1, the receiving section 3 receives the signal transmitted from the remote controller 6 in response to the operation of the user. Furthermore, the personal computer 1 receives an EPG (Electric Program Guide) signal included in the signal transmitted from the broadcasting station 11. The personal computer 1
The EPG is displayed based on the received EPG signal.

The antenna 2 receives the ground wave transmitted from the broadcasting station 11 and supplies a signal corresponding to the received radio wave to the personal computer 1.

The receiving unit 3 is a remote controller 6 corresponding to a command for operating the personal computer 1.
Receives the transmitted signal. The exchange of signals between the remote controller 6 and the receiver 3 may be, for example, infrared communication, short-range communication using Bluetooth, or the like.

The set top box 4 inputs a signal supplied from an antenna 5 which receives a radio wave transmitted from a broadcasting station 11 via an artificial satellite 13, and inputs an image and sound signal of a predetermined program to a personal computer. Supply to 1.

The antenna 5 is provided by the broadcasting station 11 to the artificial satellite 1
The radio wave transmitted via 3 is received, and a signal corresponding to the received radio wave is supplied to the set top box 4.

The broadcasting station 11 delivers (broadcasts) the program to the personal computer 1 via the antenna 12 or the artificial satellite 13.

FIG. 2 is a block diagram illustrating the configuration of the personal computer 1. CPU (Central Processin
The g Unit) 31 actually executes an application program described later and a basic OS (Operating System). ROM (Read-Only Memory) 32 is generally a CPU
It stores basically fixed data of the program used by 31 and the parameters for calculation. RAM (Random-Acce
The ss Memory) 33 stores programs used in the execution of the CPU 31 and parameters that change appropriately in the execution. These are connected to each other by a host bus 34 including a CPU bus or a memory bus.

The host bus 34 is connected to a PCI (Peripheral Component Interconnect / Interfac) via the bridge 35.
e) It is connected to an external bus 36 such as a bus.

The keyboard 38 is operated by the user when inputting various commands to the CPU 31. Mouse 39
Is operated by the user when pointing or selecting points on the screen of the monitor 40. The monitor 40 is a CRT (C
athode Ray Tube) or liquid crystal display device,
Display various information as text and images.

HDD (Hard Disk Drive) 41 and FDD (F
The loppy (registered trademark) Disk Drive) drives a hard disk or a floppy (registered trademark) disk, respectively, and causes them to record or reproduce programs or information executed by the CPU 31. The HDD 41 has a decoding program 41a, a voice recognition program 41b, a command interpretation program 41c, selection data 41d, and
A display selection program 41e is stored.

These programs are EPG (Electric Program) displayed on the monitor 40 by the display selection program 41e.
m Guide), the remote controller 6 is operated based on a signal transmitted by being operated by the user. This signal is a multiplexed signal composed of a voice signal composed of a voice uttered by the user and a command according to the operation of the remote controller 6, and various processing is executed based on this multiplexed signal.

The decoding program 41a separates a voice signal and a command from a multiplexed signal transmitted from the remote controller 6 described later, and supplies the voice signal to the voice recognition program 41b and the command to the command interpretation program 41c. . The voice recognition program 41b is
The sound supplied from the decoding program 41a is converted into, for example, HMM (Hidden Markov Model).
Display selection program 4 that recognizes voice using a voice recognition algorithm typified by
Supply to 1e. The command interpretation program 41c interprets the content of the command supplied from the decoding program 41a and supplies it to the display selection program 41e. The display selection program 41e is a program that causes the personal computer 1 to operate as if it were a television receiver, and applies various commands transmitted from the keyboard 38, the mouse 39, or the remote controller 6 to various commands received by the receiving unit 3. Based on the image processing board 4
An image of a predetermined channel of the signals supplied from the monitor 5 is displayed on the monitor 40. Display selection program 41e
Of the signals input via the image processing board 45
The EPG signal is extracted and displayed on the monitor 40. The selection display program 41e is the command interpretation program 4
The program to be displayed is selected and displayed by referring to the selection data 41d based on the command interpreted by 1c and the text data corresponding to the voice recognition result supplied from the voice recognition program 41b. The speaker 43 reproduces a predetermined sound.

The drive 44 reads the program or data recorded in the mounted magnetic disk 47, optical disk 48, magneto-optical disk 49, or semiconductor memory 50 and installs it in the personal computer 1, or the CPU 31 or Supply to RAM33.

These keyboard 38 to drive 44
The light receiving unit 3 is connected to the interface 37, and the interface 37 is connected to the CPU 31 via the external bus 36, the bridge 35, and the host bus 34.

The image processing board 45 is controlled by the CPU 31 and outputs predetermined image or audio data based on the signal supplied from the antenna 2 or the image or audio digital data supplied from the set top box 4. Generate external bus 36 and interface 37
To the HDD 41 via.

The image processing board 45 is controlled by the CPU 31, and based on the signal supplied from the antenna 2 or the digital data of the image or sound supplied from the set top box 4, a predetermined image or sound analog signal. Is generated and supplied to a monitor (not shown) via the video terminal.

Further, the image processing board 45 is connected to the external bus 3
6 or interface 37 to input image or audio data recorded in the HDD 41, generate an analog signal corresponding to the input image or audio data, and supply the analog signal to a monitor (not shown), or Digital data corresponding to the input image or audio data is generated and supplied to the monitor 40.

The image processing board 45 is connected to the CPU 31 via the external bus 36, the bridge 35, and the host bus 34.

Next, the structure of the image processing board 45 will be described. FIG. 3 is a diagram showing a configuration of the image processing board 45. The 1394 interface 51 has a configuration compatible with the IEEE 1394 standard, and is supplied from the set top box 4 based on the protocol compatible with the IEEE 1394 standard, for example, DVCR (Digital Video Cassette Recorde).
r) Receives image or audio digital data in format, and DV (Digital Video) data interface 5
Supply to 2.

Further, the 1394 interface 51 supplies the DVCR format digital data of the image or sound supplied from the DV data interface 52 to the set top box 4 based on the protocol corresponding to the IEEE 1394 standard.

The DV data interface 52 is an image or audio digital data in the DVCR format supplied from the 1394 interface 51, or an image or audio digital data supplied from the digital selector 57 (for example, so-called 4: 1: 1). Uncompressed digital data such as) DV data compression / decompression circuit 53
To the DV and supplied from the DV data compression / expansion circuit 53.
13 CR format image or audio digital data
The digital data (uncompressed) of the image or the sound supplied from the digital selector 57 supplied from the DV data compression / expansion circuit 53 is output to the digital selector 57.

The DV data compression / decompression circuit 53 decompresses the digital image / audio data of the DVCR format supplied from the DV data interface 52 into uncompressed digital data of the image or audio, and outputs it to the DV data interface 52. It outputs or compresses the uncompressed image or audio digital data supplied from the DV data interface 52 into DVCR format image or audio digital data, and outputs it to the DV data interface 52.

The tuner 54 inputs an RF (Radio Frequency) signal supplied from the antenna 2, and outputs an analog signal of image and sound of a predetermined channel to the analog selector 55. The analog selector 55 is a tuner 5
No. 4 or A / D (Analog / Digital) conversion circuit 56, a video signal terminal, which is not shown in the figure Output to external monitor.

The A / D conversion circuit 56 is the analog selector 5
The image and audio analog signals supplied from 5 are converted into digital data (for example, image data such as so-called 4: 1: 1) and output to the digital selector 57. The digital selector 57 includes a DV data interface 52, an A / D conversion circuit 56, or an MPEG (Moving Pictu).
re Experts Group) The image and audio digital data output from the decoder 60 is input, and either image or audio digital data is selected, and the DV data interface 52, the MPEG encoder 58, or the D / A conversion circuit 61 is selected. In addition to the output, the information is output to the bridge 59, and the information on the scene switching position is output to the bridge 59.

The MPEG encoder 58 compresses the image and audio digital data supplied from the digital selector 57 into MPEG digital data, and a bridge 59.
Output to. In addition, the MPEG encoder 58 converts the scene switching image into a still image and outputs the still image to the bridge 59.

The bridge 59 receives the digital data (not compressed) of the image and sound supplied from the digital selector 57 via the PCI bus 36 and the interface 37 of the personal computer 1 to which the image processing board 45 is attached. , Output to the monitor 40. The bridge 59 converts the MPEG image or audio digital data supplied from the MPEG encoder 58 into the PCI of the personal computer 1 to which the image processing board 45 is attached.
Output to the HDD 41 or the CPU 31 via the bus 36.
Further, the bridge 59 receives the digital image or audio data of the MPEG system from the HDD 41 of the personal computer 1 via the PCI bus 36, and the MPEG decoder 60
Output to.

The MPEG decoder 60 decompresses the digital image or audio data of the MPEG system supplied from the bridge 59 into uncompressed image or audio digital data, and outputs it to the digital selector 57.

The D / A conversion circuit 61 includes the digital selector 5
Image and audio digital data supplied from 7
It is converted into an analog signal and output to the analog selector 55.

The processing corresponding to the MPEG encoder 58 or the MPEG decoder 60 is executed by a predetermined program.
You may make it CPU31 perform.

Next, the remote controller 6 will be described with reference to FIG. FIG. 4 shows a schematic view of the remote controller 6. The remote controller 6 is a magneto-optical disc (DVD (Digital Versatile Disc) in this embodiment) mounted on the drive 44 of the personal computer 1 in addition to various buttons for the purpose of operating the selection display program 41e. However, it is also possible to perform an operation of a reproduction program of another recording medium) or an operation for putting the personal computer 1 into a semi-stop state (standby mode).

The changeover switch 81 can be slid in the direction of arrow A in the figure (left and right in the figure). When it is located in the left direction in the figure, the remote controller 6 is operated by the TV for operating the selection display program 41e. (television)
When the mode is switched to the right side in the figure, the remote controller 6 is switched to the PC (personal computer) mode for operating the personal computer 1. In this case, the operation mode of the remote controller 6 is switched to the PC mode of the personal computer 1 because it is located rightward.

The signal transmitting section 82 is a section for transmitting signals corresponding to various operations to the receiving section 3 of the personal computer 1. This signal transmission system may be, for example, an infrared system or a short-range wireless communication system composed of Bluetooth or the like. The microphone 83 is used when the user operates the remote controller 6 in the TV mode and inputs information necessary for program selection as voice. Details of the process of inputting this voice will be described later.

The power button 84 has a changeover switch 81,
When the TV mode is set, the monitor 40 can be turned on and off. Alternatively, the changeover switch 81
Power button 84 when is set to PC mode
Switches on / off the standby mode of the personal computer 1. The mute button 85 is pressed when the output from the speaker 43 is stopped.

Selection display program start / stop button 86a
Is a button for controlling start and stop of the selection display program 41e. When the personal computer 1 is first pressed after being started, the selection display program 41e is started, and the selection display program 41e is in the activated state. When the selection display program 41e is pressed, the selection display program 41e is stopped, and thereafter, the activated and stopped states are switched each time the selection display program start / stop button 86a is pressed.

The DVD start / stop button 86b is a button for controlling start and stop of the program for controlling the DVD. When the personal computer 1 is first pressed after the program is started, the program for controlling the DVD is started, and the DVD is stopped. DVD is pressed when the program that controls the
The program for controlling is stopped, and thereafter, each time the DVD start / stop button 86b is pressed, the start and stop are repeated.

The channel button 87 is composed of buttons having numbers 1 to 12, and is operated when designating a channel number when the selection display program is running. The switch button 88 displays the display screen of the personal computer 1 on the monitor 40 when the left side PC button displayed on the monitor 40 is pressed, and the external button of the personal computer 1 when the TV button is pressed. The image input from the monitor (not shown) connected to is displayed.

The voice switching button 89 switches between Japanese as a main voice and a foreign language voice as a sub voice in a program such as a bilingual broadcast. The input switching button 90 switches between images from the set top box 4 and the antenna 2. The channel button 91 is pressed when switching channels, the channel number increases when the button with the plus sign in the upper part of the drawing is pressed, and the channel number decreases when the button with the minus sign in the lower part of the drawing is pressed. The volume button 92 is pressed when adjusting the volume, the volume is increased when the plus sign button in the upper part of the figure is pressed, and the volume is decreased when the minus sign button in the lower part of the figure is pressed.

The operation button 93 is used to select a content to be reproduced from the contents recorded on the DVD or to reproduce the content while the program for controlling the DVD is activated.
Alternatively, it is a button that is operated when executing stop processing or the like. The favorite button 94 is the display selection program 41.
When the user wants to register the program displayed in the activated state of e as his / her favorite program, the user presses the program, and at this time, the program ID indicating the favorite program is stored in the HDD 41. Further, when the user inputs a desired keyword into the microphone 83 (when a voice is input) while the favorite button 94 is pressed for a predetermined time or longer (hereinafter, referred to as a long press), the audio program selection process is performed. As a result, the information of the keyword is transmitted to the personal computer 1, and the corresponding program is displayed on the monitor 40. still,
This program selection processing will be described later with reference to the flowchart in FIG. The reject button 95 is a button pressed by the user when the selected program is not the desired program.

The parental lock button 96 is a button operated when setting the parental lock. The parental lock is, for example, for restricting viewing of a program for which viewing restriction is set according to age (for example, designated as an adult). The signal of the program,
When the broadcasting station 11 distributes a program in advance, the viewing restriction information about viewing restrictions corresponding to age etc. may be included. In the parental lock, the selection display program 41e detects this parental lock information and limits the display based on the parental lock setting condition.

When the parental lock button 96 is pressed, a parental lock setting dialog box is displayed on the monitor 40 as shown in FIG. In the parental lock setting dialog box, a button for selecting a rating is arranged. here,
Rating is to set parental control for each age.

For example, in the example shown in FIG. 5, a radio button for selecting a rating corresponding to a program that can be viewed by children aged 7 and over, and a rating corresponding to a program that can be viewed by adolescents aged 13 and over The radio button of and the radio button for turning off the parental lock are arranged in the parental lock setting dialog box.

Any one of a radio button for selecting a rating corresponding to a program that can be viewed by children aged 7 and over and a radio button for selecting a rating corresponding to a program that can be viewed by adolescents aged 13 and over , Operation button 97 (left button 97a, right button 97
b, up button 97c, down button 97d, enter button 97
e) is selected by operating and the button named OK is clicked (OK button 97e
When is pressed), the selection display program 41e sets the parental lock rating in response to the selection of the radio button.

More specifically, for example, when the radio button of a child aged 7 or over is turned on, the display of a program for which viewing restrictions are set for children under the age of 7 is restricted. Further, when the radio button for adolescents over 13 years old is turned on, the display of programs for which viewing restrictions are set for children under 13 is restricted.

Below that, when the radio button for turning off the parental lock is selected and the button named OK is clicked, the selection display program 41e releases the parental lock. .

Further, when the reject button 95 is continuously pressed a predetermined number of times, the parental lock rating of the program displayed at that time is set according to the number of times the button is pressed. That is, for example, if the reject button 95 is pressed three times in a row, a rating that can be viewed only by children aged 7 or older is set for the program, and the reject button 95 is pressed five times in a row. 13
A rating is set that can only be viewed by young people over the age of 10.

The age restriction of this rating is not limited to this example, and other age settings may be used, or it may be other than age. Furthermore, the rating setting stage is not limited to two stages of 7 years old or 13 years old, and may be a stage configuration other than that, for example, every 1 year old.

For the EPG button 98, the changeover switch 81 is the TV
The EPG is displayed on the monitor 40 when pressed when the mode is set. FIG. 6 shows a display example when the EPG is displayed on the monitor 40. The EPG displays a program description for each channel. In this case, the program from time 19:00 to 22:00 is displayed, and on channel 1 indicated by CH1, "Baseball relay" is displayed in the column from time 19:00 to 20:00.
Is displayed, indicating that the baseball relay is broadcast as a program at that time. Also, "giant x marine" is displayed below it, indicating that the team "giant" and the team "marine" are playing baseball. Further, "Sports" is displayed below it, indicating that the genre of the program is sports. In addition, the program ID for identifying the program is displayed in the upper left of the display, and in this case, the baseball relay shows "11.
It is displayed that "1" is set.

Further, in CH1, time from 20:00 to 21: 0
In the 0 column, "Monday historical drama" is displayed, and it is shown that the program "Monday historical drama" will be broadcast at that time. Below that, "Edo Komon" is displayed, It is shown that the concrete content of the historical drama is "Edo Komon". Further below that, "drama" is displayed, indicating that the genre of the program is "drama", below that, "112" is displayed, and its program ID is "112".
Is shown.

In CH1, "weather of each place" is displayed in the column from time 21:00 to 21:45, which indicates that a weather forecast program of weather of each place is broadcast. Below, "weather news" is shown as the genre of the program. Below that, as the program ID, "113"
It is shown.

In CH1, "Sign Language" is displayed in the column from time 21:45 to 22:00, which indicates that the program of "Sign Language" will be broadcast. “Education” is displayed, indicating that the genre of the program is “education”. Also, "114" is displayed as the program ID.

In CH2, "Enthusiasm Hobby Encyclopedia" is displayed in the column from time 19:00 to 20:30, and it is shown that "Enthusiasm Hobby Encyclopedia" is packaged at this time. Also,
Below that, "Today's theme: Gardening" and "Moderator: Adams Ivan" are displayed, showing that today's theme is gardening, and Adams and Ivan are moderators. Further, below that, "variety" is displayed, which indicates that the genre of the program is "variety." Furthermore, "211" is displayed as the program ID.

In CH2, "Weekly Volunteer" is displayed in the column from 20:30 to 21:45, and further "Performer Nagaaki Yodogawa Katomizu" is displayed at that time, which is called "Weekly Volunteer". The program is broadcast and it is shown that the performer is "Yodogawa Choaki Katomizu". Below that, "variety" is displayed, indicating that the genre of the program is "variety." Also, "212" is displayed as the program ID.

In CH2, "news" is displayed in the column from time 21:45 to 22:00, indicating that a news program will be broadcast at that time, and below that,
"Weather news" is displayed as the genre of the program, and "213" is displayed as the program ID.

In CH3, "Popular animation special feature" is displayed in the column from time 19:00 to 20:00, which shows that the program of the popular animation special feature is broadcast at that time. Below that again, "Gandame",
And "Himitsu no Takko-chan" is displayed,
Specifically, the title of the animation to be broadcast is shown, and below that, "animation" showing the genre of the program is displayed. Also, “311” is displayed as the program ID.

In CH3, "Monday road show" is displayed in the column from time 20:00 to 21:30, and it is shown that "Monday road show" will be broadcast at that time. "Rambu" is displayed on the screen, and the name of the movie to be specifically broadcast is shown. Further, below that, "Western movies" is displayed, indicating that the genre of the program is "Western movies". Also, as the program ID, "31
2 ”is displayed. Furthermore, in the lower left of that column,
It is displayed as "R-12" and shows the rating used for parental locks, and in this case, it is a display that children under 12 years are recommended to restrict viewing Has been done.

In CH3, "Cooking time" is displayed in the column from 21:30 to 22:00, and at that time,
"Cooking time" is shown to be broadcasted, and today's title "Nikujaga" is displayed below it, and below that, "Cooking" indicating the genre of the program is displayed. . Also, "313" is displayed as the program ID.

In CH4, "Soccer relay" is displayed in the column from 19:00 to 20:30, and at that time,
It is shown that "football relay" will be broadcast. Below that, "US x Japan" is displayed, which indicates that the United States and Japan are in battle. Further, below that, "sports" is displayed as the genre of the program. Also, "411" is displayed as the program ID.

In CH4, in the column of time 20:30 to 22:00, "The crossing world is the only one" is displayed, and below that, "Drama" is displayed, and at that time It is shown that a drama titled "The world is all about him" will be broadcast. The EPG data is transmitted as text data by being multiplexed with the broadcast signal from the broadcasting station 11, and is transmitted via the image processing board 45, the external bus 36, and the interface 37 to the HDD.
41, and the stored data is displayed on the monitor 40. Further, the selection display program 41e selects a program to be displayed from this EPG data based on the selection data 41d and displays it on the monitor 40.

FIG. 7 is a block diagram for explaining the configuration of the remote controller 6.

The CPU 121 actually executes various application programs and a basic OS. ROM122
Generally stores basically fixed data of a program used by the CPU 121 and parameters for calculation. The RAM 123 stores programs used in the execution of the CPU 121 and parameters that change appropriately in the execution. These are connected to each other by a host bus 124 including a CPU bus or a memory bus.

The host bus 124 is connected to an external bus 126 such as a PCI bus via a bridge 125.

The operation unit 128 is composed of the changeover switch 81 to the EPG button 98 shown in FIG. 4, and is operated when the user inputs various commands to the remote controller 6, and the encoder 130 outputs a signal corresponding to the operation. Output.

The A / D converter 129 converts an analog signal corresponding to the voice uttered by the user, which is input from the microphone 83 of FIG. 4, into a digital signal and outputs the digital signal to the encoder 130. The encoder 130 multiplexes and encodes a signal corresponding to the operation of the operation unit 128 input from the operation unit and an audio signal composed of a digital signal input from the A / D converter 129 to encode the signal.
It outputs to the signal transmission part 131 via 27 and the external bus 126. The signal transmission unit 131 transmits the encoded multiplexed signal input from the encoder 130 to the personal computer 1.

Next, referring to the flow chart of FIG.
The audio program selection process will be described. In step S1, it is determined whether or not the favorite button 94 of the remote controller 6 has been pressed for a long time, and the process is repeated until it is determined that the button has been pressed for a long time. When it is determined that the button has been pressed for a long time, the process is executed. , And proceeds to step S2.

In step S2, the encoder 130
Transmits the audio signal input from the microphone 83 and the signal indicating that the favorite button 94 has been long-pressed and the selection of the program is designated, and the signal is multiplexed and encoded.
Output to.

In step S3, the transmitter 131
The encode signal transmitted from the encoder 130 is transmitted to the personal computer 1.

In step S21, the receiver 3 determines whether or not a signal is transmitted from the remote controller 6, and repeats the processing until the signal transmitted from the remote controller 6 is received. When a signal is transmitted from the remote controller 6 by the process of S3, the process is performed in step S22.
Proceed to.

In step S22, the decoding program 41a decodes the signal received by the receiving unit 3 and outputs it to the voice recognition program 41b and the command interpretation program 41c.

In step S23, the voice recognition program 41b recognizes the voice as text data and stores it in the selection data 41d.
1c recognizes the command of the decoded signal and activates the selection display program 41e.

The selection display program 41e determines whether or not voice is input based on the text information converted from voice. For example, when it is determined that voice is input, the process is as follows. It proceeds to step S25.

In step S25, the selection display program 41e searches the program related to the keyword from the EPG based on the recognized text (keyword). That is, as described above, since the EPG is text data, it searches for a program including the corresponding keyword.

In step S26, the selection display program 41e determines whether or not the program to be searched is detected. If it is determined that the program to be searched is detected, the process proceeds to step S27.

In step S27, the selection display program 41e collates the text data related to the searched program with the selection data, and selects the program corresponding to the frequency of the selected keyword in the selection data 41d of each program. The priority order is determined and the program is displayed on the monitor 40.

That is, as shown in FIG. 9, the selection data 41d is information consisting of the keyword and the frequency with which the keyword is detected on the EPG. The selection data 41d of FIG. 9 is configured based on the EPG text data of FIG. 6, “sports” is registered as a keyword, and “15” is recorded as the selection frequency thereof. Indicates that a program including "sports" has been selected 15 times. Below that, "variety" is registered as a keyword, and "4" is recorded as the selection frequency of the keyword.
The above text data indicates that a program including "variety" has been selected four times. Below, "Drama", "Western movies", "Huge", "Marine", "Bulbs", "Japan", "US", "Baseball", "Soccer", "Relay",
"Cooking", "Meat Jaga", "Enthusiasm", "Hobby", "Encyclopedia", "Monday", "Road Show", "Rambu",
“Time”, “news”, “weather”, “sign language”, “people”, “guy”, and “Edo Komon” are registered as keywords, and the selection frequency of each is “10”, “2”,
"15", "6", "5", "8", "4", "1"
7 ”,“ 10 ”,“ 20 ”,“ 3 ”,“ 4 ”,“ 3 ”,
"2", "5", "4", "3", "1", "10",
It is recorded as "22", "31", "2", "10", "10", and "15".

At this time, for example, the user is "sports"
In step S23, the voice recognition program 41b recognizes "sports" as text data, and in step S25, the selection display program 41e searches the EPG for a program corresponding to "sports". To do. In this case, for example, the time at that time is 19: 0
If it is 0 to 20:00, the program including "Sports" is CH1
Will be searched for a baseball relay and a CH4 soccer relay (the genre of the program is "sports"). further,
This baseball relay contains "baseball", "giant", and "marine" as text data contained on the EPG, and the soccer relay contains "soccer", "US", and "Japan". "It is included. The selection frequency of these text data is "17" for "baseball" and "giant".
"15", "Marine""6","Soccer""1"
“0”, “US” are recorded as “4”, and “Japan” is recorded as “8”. Therefore, the selection display program 41e sets the baseball relay including the most frequently selected (17 times) "baseball" to the first priority, and then includes the most frequently selected (10 times) "soccer". The soccer relay is set in the second priority, and the baseball relay program with the first priority is displayed. In addition, "giant" is more important than "soccer"
Although the selection frequency is high, it is not included in the determination of the priority because it is included in the baseball relay with the highest priority.

In step S28, the selection display program 41e determines whether the reject button 95 has been pressed.

At this time, in the remote controller 6,
In step S4, it is determined whether or not the rejection button 95 has been pressed. If it is determined that the rejection button 95 has not been pressed, it is determined in step S5 whether or not a predetermined time has elapsed, and the predetermined time has not elapsed. When it is determined that
The process returns to step S4, and when a predetermined time has elapsed, the process ends. That is, the rejection button 95 can be pressed until a predetermined time elapses, and the process repeats steps S4 and S5, and when the rejection button 95 is not pressed within the predetermined time, The process ends.

When the reject button 95 is not pressed in this way, it is determined in step S28 that the reject button 95 is not pressed, that is, in the present case,
Since the "baseball relay" is displayed on the monitor 40, it is considered that the desired program is displayed, and the processing is
It proceeds to step S29.

In step S29, it is determined whether or not a predetermined time has elapsed. If it is determined that the predetermined time has not elapsed, the process returns to step S28. That is,
The processes of steps S28 and S29 are repeated until the predetermined time has elapsed. When a predetermined time has elapsed in step S29, a keyword is detected from the text data of the program in step S30, the selection frequency of the selection data 41 is updated, and the process is ended. At this time, the selection display program 41e resets the record of the number of rejections of the selected program, which will be described later.

That is, in the present case, it is included in the baseball broadcast.
"Baseball", "Huge", which is text data on EPG,
The selection frequencies of "Marine" and "Sports" are incremented by 1, and "18", "16", and
It is updated to "7" and "16".

With the above-described processing, the user searches for a program simply by pressing the favorite button 94 and saying "sports", and the desired program can be displayed without executing the processing of selectively displaying the program. Can be displayed.

If it is determined in step S24 that no voice is input, that is, if the user simply presses the favorite button 94, the selection display program 41 is selected in step S31.
The e selects a preset program as a favorite program, displays it on the monitor 40, and ends the processing.

At step S28, the rejection button 95
Is determined, that is, in step S4 of the remote controller 6, the reject button 95 is pressed.
Is determined to have been pressed, and when a signal indicating that the reject button 95 has been pressed is output from the transmission unit 131 to the personal computer 1 in step S6, the process proceeds to step S32.

In step S32, it is determined whether or not a rating is set for the program. In this case, since it is a baseball relay and the rating is not set as shown in FIG. 6, it is determined that the rating is not set, and the process proceeds to step S33.

In step S33, the selection display program 41e counts the number of times of refusal and stores the program and data corresponding to the number of times of refusal in the selection data 41d. In step S34, the selection display program 41
The e determines whether or not the number of rejections is three times or more in succession. For example, when it is three times or more in succession, the process proceeds to step S35.

In step S35, the selection display program 41e sets the rating for children to the currently selected program in the selection data 41d. That is,
R-6 (recommended program for children under 6 years old) will be set, which corresponds to R-12 as set on the Monday road show of CH3.

In step S36, it is determined whether or not the number of rejections is 5 or more consecutive times. For example, if the number of rejections is 5 or more consecutively, the process proceeds to step S37. In step S37, the selection display program 4
1e sets the youth rating for the program currently selected in the selection data 41d. That is, that is, as set for the Monday road show of CH3
R-12 (recommended TV program recommended for children under 12 years old) corresponding to R-12 is set.

In step S38, it is determined whether or not the currently displayed program is the lowest in the priority order. For example, if it is determined that it is not the lowest, the process proceeds to step S39.

In step S39, the program having the next priority order to the program currently displayed is displayed, and the processing proceeds to step S29, and the processing thereafter is repeated. That is, in this case, the soccer relay program whose priority is set to the second place is selected and displayed on the monitor 40.

In step S32, for example, when the selected program is CH3 Monday road show, the rating is set as R-12, so it is determined that the rating has already been set. The process proceeds to step S38, and the subsequent processes are executed. That is, the preset rating for the program is
It is applied as it is.

If the number of rejections is not three or more in succession in step S34, the process proceeds to step S3.
Go to 8. If it is determined in step S36 that the number of rejections is not 5 or more consecutive times, the process proceeds to step S38, and the subsequent processes are repeated. If it is determined in step S38 that the displayed program has the lowest priority, the process ends.

That is, by the above processing, if the number of times of refusal is 3 or more consecutively, the rating for the child (that is, R-6) is set to the program, and the number of consecutively 5 or more times. In this case, you can set the youth rating of the program (ie, R-12). As a result, even if a rating is not set for the program broadcast from the broadcasting station 11, it is set according to the frequency with which the refusal button 94 is pressed, so that, for example, a program that is harmful to children and the like. Even in such cases, the parental lock can be set to limit viewing according to the number of consecutive refusals, and the rating level for limiting viewing depending on the number of times the refusal button 94 is pressed is increased. be able to.

The rating may be set for other ages. Further, in the above description, the personal computer 1 has been described as an example of displaying a program transmitted from the broadcasting station 11, but it is sufficient if it can be operated by the remote controller 6, and it goes without saying. It may be a television receiver that can be operated by the remote controller 6.

Further, in the above example, the process of displaying the program based on the EPG text data has been described. However, for example, a volume setting process may be performed. In this case, the user may use the above-described embodiment. By installing the volume control program corresponding to the selected display program 41e in the HDD 41 in advance, the volume control program can be activated by inputting "volume up" or "volume down" into the microphone 83 of the remote controller 6. The volume may be adjustable. Further, in the case where music reproducing software is installed in the personal computer 1 in correspondence with the selection display program 41e, the user performs an operation indicating reproduction, and the desired music genre, artist name, and album. The music content may be reproduced based on the text corresponding to the word recognized by the software by uttering the name or the song name as a voice. Further, in the same manner, the operation of stopping the reproduction of the DVD may be controlled by the remote controller 6.

Further, as a communication method used for realizing the present invention, IEEE802.11a, IEEE802.11b, FM, or the like may be used.

According to the above, the user can cause the electronic device to perform a desired operation by a simple operation by operating the remote controller while uttering a word designating a desired operation as a voice. Becomes

The series of processes described above can be executed not only by hardware but also by software. When a series of processes is executed by software, various functions can be executed by installing a computer in which a program configuring the software is incorporated in dedicated hardware or various programs. It is installed from a recording medium into a possible general-purpose personal computer or the like.

As shown in FIG. 2, this recording medium is not limited to the HDD 41 in which the program is recorded, which is provided to the user in the state where it is pre-installed in the personal computer 1 as shown in FIG. A magnetic disk 47 (including a flexible disk) on which the program is recorded, which is distributed to provide the program, an optical disk 48 (CD-ROM (Compact Disk-Read Onl
y Memory), DVD (including Digital Versatile Disk)),
It is composed of a package medium including a magneto-optical disk 49 (including MD (Mini-Disc) (registered trademark)) or a semiconductor memory 50 (including Memory Stick).

In the present specification, the steps for writing the program recorded on the recording medium are not limited to the processes performed in time series in the order described, but not necessarily in time series. , Which include processes executed in parallel or individually.

Further, in the present specification, the system means
It represents the entire apparatus composed of a plurality of devices.

[0125]

According to the operating device, the operating method, and the program of the present invention, a voice is input, a command is input to an electronic device, the voice and the command are multiplexed, and a multiplexed signal is generated and multiplexed. The signal is transmitted to the electronic device.

According to the electronic apparatus, the operation control method, and the program of the present invention, the multiplexed signal is received, the voice and the command are separated from the received multiplexed signal, the separated voice is recognized, and the recognized recognition is performed. The operation of itself is controlled according to the content and the separated command.

According to the electronic equipment operating system, operating method, and program of the present invention, the operating device inputs a voice, inputs a command to the electronic equipment, multiplexes the voice and the command, and generates a multiplexed signal. Then, the multiplexed signal is transmitted to the electronic device, the electronic device receives the multiplexed signal, separates the voice and the command from the received multiplexed signal, recognizes the separated voice, and recognizes the recognized content, and , It now controls its own actions in response to the separated commands.

As a result, in any case, the user operates the remote controller while uttering a word designating the desired operation as a voice, thereby causing the electronic device to execute the desired operation with a simple operation. Is possible.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of an embodiment of a broadcasting system to which the present invention is applied.

FIG. 2 is a block diagram showing the configuration of the personal computer shown in FIG.

FIG. 3 is a diagram showing a configuration of the image processing board of FIG.

FIG. 4 is a schematic view of the remote controller of FIG. 1.

FIG. 5 is a diagram showing a parental lock setting dialog.

FIG. 6 is a diagram showing a display example of an EPG.

FIG. 7 is a block diagram showing the configuration of the remote controller of FIG.

FIG. 8 is a flowchart illustrating program selection display processing.

FIG. 9 is a diagram showing a configuration example of selection data.

[Explanation of symbols]

1 personal computer, 2 antennas, 3 receiver, 4 set top box, 5 antennas, 6 remote controller, 11 broadcasting stations, 12 antennas,
13 satellites, 41 HDD, 41a decoding program, 41b voice recognition program, 41c command interpretation program, 41d selection data, 41e selection display program, 82 transmitter, 83 microphone, 9
4 Favorite button, 95 reject button, 96 parental lock button, 98 EPG button, 129 A / D converter, 130 encoder, 131 transmitter

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04Q 9/00 301 H04Q 9/00 341Z 311 G10L 3/00 551G 341 561C F term (reference) 5C056 AA05 CA01 DA01 EA05 5D015 KK01 LL02 LL05 5K048 AA04 BA03 CA05 DA01 DB01 DB04 DC01 DC02 EB02 EB14 FB10 FC01 GC05 HA01 HA02 HA13 HA22 HA23

Claims (14)

[Claims] 1. An operating device for operating an electronic device, wherein voice input means for inputting voice, command input means for inputting a command to the electronic device, multiplexing the voice and the command, and outputting a multiplexed signal. An operating device comprising: a multiplexing unit that generates the signal; and a transmitting unit that transmits the multiplexed signal to the electronic device. 2. The operating device according to claim 1, wherein the transmitting unit transmits the multiplexed signal to the electronic device by infrared communication. 3. The operating device according to claim 1, wherein the transmitting unit transmits the multiplexed signal to the electronic device by Bluetooth. 4. A method of operating an operating device for operating an electronic device, comprising: a voice input step of inputting a voice; a command input step of inputting a command to the electronic device; multiplexing the voice and the command; An operation method comprising: a multiplexing step of generating a multiplexed signal; and a transmitting step of transmitting the multiplexed signal to the electronic device. 5. A voice input control step for controlling voice input to a computer controlling an operating device for operating an electronic device, a command input control step for controlling input of a command to the electronic device, and the voice. A program for executing a multiplexing control step of multiplexing the command and controlling generation of a multiplexed signal, and a transmission control step of controlling transmission of the multiplexed signal to the electronic device. 6. An electronic device that operates based on a multiplexed signal transmitted from an operating device, comprising: receiving means for receiving the multiplexed signal; voice and a command based on the multiplexed signal received by the receiving means. Separating means for separating the sound, speech recognition means for recognizing the sound separated by the separating means, recognition content recognized by the speech recognition means, and
An electronic device comprising: an operation control unit that controls its own operation in response to the command separated by the separation unit. 7. The electronic device according to claim 6, wherein the receiving unit receives the multiplexed signal by infrared communication. 8. The electronic device according to claim 6, wherein the receiving unit receives the multiplexed signal via Bluetooth. 9. The storage device further stores the recognition content together with the number of times the recognition has been performed in the past, and the operation control means includes the recognition content, the number of times the recognition content has been recognized in the past, and the command. The electronic device according to claim 6, wherein the electronic device controls its own operation in response to the above. 10. An operation control method for an electronic device, which operates based on a multiplexed signal transmitted from an operating device, comprising: a receiving step of receiving the multiplexed signal; and the multiplexing received in the process of the receiving step. Than the signal
A separation step of separating a voice and a command, a voice recognition step of recognizing the voice separated in the processing of the separation step, a recognition content recognized in the processing of the voice recognition step, and a separation in the processing of the separation step. An operation control step of controlling the operation of the electronic device in response to the received command. 11. A computer for controlling an electronic device that operates based on a multiplexed signal transmitted from an operating device, wherein a computer controls a reception of the multiplexed signal, and a reception control step is performed to receive the multiplexed signal. , A separation control step of controlling separation of a voice and a command from a controlled multiplexed signal; a voice recognition control step of controlling recognition of the voice separated in the processing of the separation control step; and a processing of the voice recognition step. A program for executing an operation control step of controlling its own operation in response to the recognition content whose recognition is controlled in step S1 and the command whose separation is controlled in the processing of the separation control step. 12. An electronic device operating system comprising an electronic device and an operating device for controlling the operation thereof, wherein the operating device is a voice input means for inputting a voice, and a command input means for inputting a command to the electronic device. And a transmitter that multiplexes the voice and the command to generate a multiplexed signal, and a transmitter that transmits the multiplexed signal to the electronic device, the electronic device receiving the multiplexed signal. Receiving means, a separating means for separating the voice and the command from the multiplexed signal received by the receiving means, a voice recognizing means for recognizing the voice separated by the separating means, and the voice recognizing means. Recognized content, and
An electronic equipment operating system, comprising: an operation control means for controlling the operation of itself in response to the command separated by the separating means. 13. An operating method of an electronic device operating system comprising an electronic device and an operating device for controlling the operation thereof, wherein the operating device operating method comprises a voice input step of inputting a voice, and a command to the electronic device. A command input step of inputting, a multiplexing step of multiplexing the voice and the command to generate a multiplexed signal, and a transmission step of transmitting the multiplexed signal to the electronic device, the operation of the electronic device A control method is a receiving step of receiving the multiplexed signal, and a multiplexed signal received in the process of the receiving step,
A separation step of separating the voice and the command, a voice recognition step of recognizing the voice separated by the processing of the separation step, a recognition content recognized by the processing of the voice recognition step, and a processing of the separation step The operation method of the electronic device operation system, comprising: an operation control step of controlling the operation of the electronic device in response to the commands separated by. 14. A voice input control step of controlling voice input to a computer controlling an electronic device operating system comprising an electronic device and an operating device controlling operation thereof, the computer controlling the operating device. A command input control step of controlling input of a command to the electronic device; a multiplexing control step of controlling multiplexing of the voice and the command and generation of a multiplexed signal; and a multiplexing signal of the multiplexed signal to the electronic device. And a reception control step of controlling the reception of the multiplexed signal by a computer controlling the electronic device, and a multiplexing control of the reception in the processing of the reception control step. From the signal, the separation is controlled by the separation control step for controlling the separation of the voice and the command, and the processing of the separation control step. In response to the voice recognition control step for controlling the recognition of the controlled voice, the recognition content whose recognition is controlled by the processing of the voice recognition control step, and the command whose separation is controlled by the processing of the separation control step. , A program for executing an operation control step for controlling its own operation.