JP2004254006A - Electronic equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic equipment which enables not only a healthy person but also a visually and auditorily disabled person to recognize whether or not the electronic equipment operates as he/she intends and to easily operate the electronic equipment in order to improve the usability of the electronic equipment from the viewpoint of universal design. <P>SOLUTION: This electronic equipment is provided with a notifying means for notifying that an instruction inputted to the electronic equipment has been performed by voices or at least one of the voices. This enables even the visually and auditorily disabled person to easily operate the electronic equipment because he/she can recognize whether or not the electronic equipment operates as he/she intends. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to electric appliances such as TVs, radios, radio-cassettes, air conditioners, refrigerators, DVD recording / reproducing devices, information devices such as mobile phones, PDAs and personal computers, office machines such as copiers and fax machines, and the like. In particular, the present invention relates to an electronic device that provides operation guidance by voice.
[0002]
[Prior art]
2. Description of the Related Art With the recent advancement of digital technology and network technology, home appliances have become multifunctional. For example, in a television, a recording reservation using an EPG (Electronic Program Guide) or the like, a search of a currently broadcast program, and the like can be performed.
[0003]
In such a television, when the user presses, for example, a menu key on a remote controller, a program navigation screen shown in FIG. 6 is displayed on the television screen. As shown in FIG. 6, the program navigation screen includes a program table item 501, a counter program item 502, a genre search item 503, a program reservation item 504, a reservation list item 505, an information item 506, a pointer 521, a cross key, and the like. The operation unit is displayed.
[0004]
For example, when making a recording reservation, the user looks at the program navigation screen, moves the pointer 521 to the genre search item 503 using the cross key of the remote control, and presses the enter key of the remote control.
[0005]
When the enter key is pressed, a genre search screen shown in FIG. 7 is displayed on the television screen. As shown in FIG. 7, the genre search screen includes a news / report item 601, a sports item 602, a culture / entertainment item 603, a drama item 604, a music item 605, a variety item 606, a movie item 607, an animation / special effects item 608, Other items 609, a pointer 621, and an operation unit such as a cross key are displayed. When the genre search screen is displayed, the user moves the pointer 621 to a desired genre and presses the enter key, and a list of television programs of the designated genre is displayed on the television screen, and the user can select a desired program. Is specified. The television records the program specified here.
[0006]
[Patent Document 1]
JP 05-40589 A
[Patent Document 2]
JP-A-08-166867
[Patent Document 3]
JP-A-06-295228
[0007]
[Problems to be solved by the invention]
When the user is a healthy person, the user can see whether the television is operating as intended by seeing changes in the screen displayed on the monitor or the like. However, the user of the television may be not only a healthy person but also a visually impaired person such as a low-vision person, a totally blind person, and an elderly person with poor vision (cataract). Even such a visually impaired person can enjoy the program by listening to the sound of the program, so that the visually impaired person may make a reservation for recording the program. However, if the user is a visually impaired person, the visually impaired person cannot recognize whether or not the television has operated as intended by seeing changes in the screen displayed on the monitor, etc. Can not operate.
[0008]
In order to improve the usability of the electronic device from the viewpoint of universal design, the present invention enables not only healthy persons but also visually impaired persons to recognize whether the electronic apparatus is operating as intended and to easily operate the electronic apparatus. It is an object of the present invention to provide an electronic device that can be used for a computer.
[0009]
[Means for Solving the Problems]
An electronic device according to the present invention includes: an event processing unit that can receive a command from a user in a plurality of input forms; an execution unit that executes a command based on the command received by the event processing unit; Notification means for notifying, by sound or voice, that the execution means has executed the command received by the event processing means in an input form.
[0010]
When the notification unit receives a command in a predetermined input form, the notification unit notifies the user that the command has been received by sound or voice so that even a visually impaired person can issue a command in a predetermined form so that the command is issued. It is possible to recognize whether the electronic device has been accepted.
[0011]
The above-mentioned predetermined form is a voice often used by a visually handicapped person to operate an electronic device, an operation of a remote controller, and the like.
[0012]
BEST MODE FOR CARRYING OUT THE INVENTION
(Embodiment 1)
(Description of device configuration)
The electronic apparatus of the present invention is an electronic product such as a digital TV, a copier, a facsimile, an air conditioner, a personal computer, a car navigation system, a mobile phone, and a mobile device such as a PDA (Personal Digital Assistants). Hereinafter, a case where the electronic device is the digital TV 100 will be described.
[0013]
The digital TV 100 shown in FIG. 1 can provide a user with a recording reservation function using an EPG. The digital TV 100 receives program data and EPG transmitted by broadcasting or the Internet by a receiving unit 107 provided in the digital TV 100. The receiving means 107 transfers the received program data to the recording / playback means 153 of the execution means 105 and the EPG to the EPG storage means 108. When the program data is transferred, the recording / reproducing means 153 reproduces the program using the monitor 103 and the speaker 104 serving as a notifying means based on the program data, and the recording / reproducing means 153 further transfers the program. If the program data is program data of a program reserved for recording, the program is recorded on the recording medium 110.
[0014]
The EPG is information about a program such as a broadcast channel 201, a broadcast date and time 202, and a program name 203 of the program as shown in FIG.
[0015]
The user basically operates the digital TV 100 with the remote controller 300 shown in FIG. When a key provided on the remote controller 300 such as the cross key 301 or the enter key 302 is pressed, the type of the pressed key is transmitted to the event processing unit 102 provided in the digital TV 100.
[0016]
In order for a visually impaired person to operate the remote controller, it is necessary to store the correspondence between the position of each key of the remote controller 300 and the operation content, and it is not always easy to operate the digital TV 100 with the remote controller 300. Therefore, the digital TV 100 is operated not only by the remote controller 300 but also by voice.
[0017]
The voice uttered by the user is received by the voice conversion means 101 provided in the digital TV 100, converted into an electric signal corresponding to the voice by the voice conversion means 101, and transferred to the event processing means 102.
[0018]
(Explanation of specific operation)
Here, the operation will be described in detail below on the assumption that a visually impaired person makes a recording reservation for a soccer game when a television program is displayed on the screen.
[0019]
The “program navigation” as a start instruction of the setting mode issued by a visually impaired person is converted into an electric signal by the voice conversion unit 101 and transferred to the event processing unit 102. When the visually impaired person presses the menu key 303 of the remote controller 300 instead of issuing “program navigation”, the fact that the menu key 303 has been pressed is transmitted from the remote controller 300 to the event processing means 102.
[0020]
The event processing unit 102 recognizes that the “program navigation” transferred from the audio conversion unit 101 or the menu key 303 transmitted from the remote controller 300 has been pressed as a start instruction of the setting mode. Then, the event processing means 102 transfers, to the hierarchy shifting means 151 of the execution means 105, whether the instruction from the user has been received via the voice conversion means 101 or directly from the remote controller 300 together with the start instruction. (FIG. 5, S531).
[0021]
When the path of the start instruction and the path of the instruction from the user are transferred, the hierarchy shifting unit 151 starts the program navigation mode A of the highest hierarchy of the setting mode having the hierarchical structure shown in FIG. S501). When the program navigation mode A is activated, the hierarchy shifting means 151 causes the in-hierarchy processing means 152 to execute the processing in the program navigation mode A.
[0022]
First, when the program navigation mode A is activated, the in-hierarchical processing means 152 displays the program navigation screen shown in FIG. As shown in FIG. 6, the program navigation screen includes a program table item 501, a counter program item 502, a genre search item 503, a program reservation item 504, a reservation list item 505, an information item 506, a pointer 521, a cross key 301, and the like. Is displayed, and the user can obtain what to do next only from the visual information.
[0023]
If the user is a healthy person, the user sees the program navigation screen, and as a next operation, moves the pointer 521 to a desired item using the cross key 301 and presses the enter key 302 to select the item. It can be determined that it is specified.
[0024]
However, if the user is visually impaired, the user cannot see the program navigation screen, and thus does not know whether the program navigation is actually running or what operation should be performed next.
[0025]
In consideration of the fact that the user often operates the digital TV 100 by voice when the user is visually impaired, the layer shift unit 151 determines whether the instruction from the user is transferred via the voice conversion unit 101. Then, the program navigation mode A is activated, and the notification sound data indicating that the program navigation mode A is activated is transferred to the speaker 104, and the notification sound is reported from the speaker 104 (FIG. 5, S502 → S503). The notification sound is, for example, a synthetic sound such as “bean” or a chime sound such as “ping-pong”. The type of sound, for example, frequency, timbre, pattern, volume, etc., is changed between when the setting mode is started or ended and when the hierarchy in the menu is moved. The melody sound and the notification sound may be properly used. For example, when the setting mode is activated or terminated, a long sound of “Peen” is given, and when the setting mode is moved within a hierarchy, “Ping-Pong”, “Ping-Ping”, or the like is used.
[0026]
When going deeper into the hierarchy, use "ping-pong" from high pitches to low pitches, and conversely, use "pong-pong" from low pitches to high pitches when going shallow, to impress the user with directionality and quickly understand the state of the device. Help. For a user who is accustomed to the operation to some extent, the user can reach the target layer by the number of floors pressed and the sound without having to listen to the voice guidance of each layer, thereby reducing the operation time. In addition, even when using a shortcut by voice input (shortcut function will be described later), the notification sound is generated by the number of advanced layers, and the execution sound of the device can be intuitively grasped by the pattern sound indicating the direction. Users can be relieved.
[0027]
The device is equipped with an on / off switching function so that the user can select on / off of voices and sounds emitted from the device according to his / her preference and learning degree of operation.
[0028]
By hearing the notification sound, even if the user is visually impaired, it is possible to recognize that the program navigation mode A has been activated and to recognize that the digital TV 100 is operating as intended. it can.
[0029]
When the above-mentioned notification sound is notified, the above-mentioned layer shift means 151 instructs the above-mentioned in-layer processing means 152 to notify the voice guidance of the program navigation mode A.
[0030]
In response to the instruction, the in-hierarchical processing means 152 displays the program navigation screen on the monitor 103, and outputs the voice guidance data for the visually impaired person to recognize what to do next. And the voice guidance is notified from the speaker 104. The voice guidance starts with, for example, “Program navigation mode has been activated. Please specify the item.” The name of each item displayed on the program navigation screen (program listing, back program, genre search, program reservation) , Reservation list, and information) in this order.
[0031]
When the in-hierarchy processing means 152 notifies that "the program navigation has started. Please specify the item.", Then, the speaker 104 notifies the "program table" which is the name of the first item of the program navigation screen. (FIG. 5, S504 → S507).
[0032]
As a method of deciding an item, both a method of inputting with a button of the remote controller 300 and a method of inputting by voice are provided.
[0033]
There are at least the following three types of voice guidance output from the device when the user moves into a certain hierarchy and switches the screen. There are three types of guidance: a guidance indicating what screen to do, a guidance to guide the user on what to do on the screen, and a guidance for presenting options that the user can select.
[0034]
For example, when entering the program navigation mode A, there are three types of voice guidance: "Entered the program navigation", "Please select an item", and "Program guide" which is the guidance for presenting the next choice. Voice guidance appears. At this time, the user can select an item by moving the cursor to a target item on the screen using the cross key of the remote controller 300 and pressing the enter button. A user with normal vision can determine items by this method, but this method may be difficult for a visually impaired person. In this case, a method of deciding items by voice guidance and the remote controller 300 is used. As a method of guidance by voice, first, all the item names are sequentially read out by the device by voice inputting “all” or the like to know the items on the screen, and thereafter, the target items are displayed on the remote controller 300. A method of selecting with the enter key 302 is possible. When the cursor is moved between items on the screen using the cross key 301, the user can determine the item name at which the cursor is located by reading the item name at which the cursor is located. By pressing the key 302, a predetermined item is selected. When all the items are read out, the next item is read out after a predetermined time (for example, one second) elapses after one item is read out from the device. Thus, the user can select an item by pressing the enter key 302 while the target item is being read out or before the next item is read out.
[0035]
As a method of determining an item, it is also possible to provide guidance by voice and perform an operation such as determination by voice.
[0036]
In this case, first, the operation guidance and selection items as options are read aloud by voice, and if it is recognized by voice recognition that a predetermined keyword such as “determine” or “return” has been uttered, the remote control The same operation as pressing the operation button 300 is performed. If a desired item name is input by voice, a shortcut function works regardless of whether the item exists in the hierarchy or not, and the item can be directly selected by skipping the middle hierarchy.
[0037]
The voice recognition function may be provided in the main body of the digital TV 100. However, by incorporating a microphone and a voice recognition circuit inside the remote controller 300, a signal equivalent to a button operation is generated. Is also good.
[0038]
Here, when the user utters “decision” toward the digital TV 100 before the next item “back program” is read out after the “program table” is notified, the item is the currently notified item. "Program guide" is determined. In this way, the item can be selected by saying "decision" when the item is presented (when it is read out), but instead of saying "decision", by saying the item name, You can also choose directly. The timing of uttering the item name does not need to be after the item name is presented from the device side, that is, may be uttered at any stage of the hierarchy. As a result, the operation in the middle of the hierarchy can be skipped by directly selecting the item without having to follow the hierarchy of the menu screen as in the related art.
[0039]
This function is called "shortcut" in this specification.
[0040]
Alternatively, the user can perform the determination operation by pressing the determination key 302 of the remote controller 300 instead of speaking.
[0041]
When the operation of “determination” is received by the above utterance or the button operation of the remote control, the event processing unit 102 transfers the “determination” to the in-layer processing unit 152.
[0042]
However, in the present embodiment, since the purpose of the user is to activate the genre search mode B in which the recorded program can be searched, the user can perform the predetermined time while the “program table” is being notified and for a predetermined time after the notification. The user does not say “enter” or press the enter key 302 until the time has elapsed.
[0043]
When a predetermined time elapses after notifying the “program table”, the in-hierarchical processing means 152 determines whether there is an item to be notified next (S508 in FIG. 5). Here, since there is a “back program” which is an item to be reported after the “program table”, the in-hierarchical processing means 152 sets the “back program” when a predetermined time elapses after the “program table” has been reported. Is notified (FIG. 5, S504).
[0044]
At this time, the user does not say “enter” nor press the enter key 302. When a predetermined time elapses after the notification of the “back program” has been completed, the in-hierarchy processing means 152 determines whether there is an item to be notified next (FIG. 5, S505 → S508). Here, since there is "genre search" which is an item to be notified after "back program", the in-layer processing means 152 notifies "genre search" next (FIG. 5, S504).
[0045]
For example, the user says “determined” to the digital TV 100 while “genre search” is informed.
[0046]
The “decision” issued by the user is received by the event processing unit 102 via the voice conversion unit 101. Then, upon receiving the decision, the event processing means 102 transfers the decision to the in-layer processing means 152 (FIG. 5, S532).
[0047]
When the “decision” is received while the “genre search” is informed and before a predetermined time elapses, the in-layer processing unit 152 recognizes that the genre search mode B has been designated by the user ( (FIG. 5, S505). The in-layer processing means 152 notifies the tier moving means 151 that the genre search mode B has been designated.
[0048]
Upon recognizing the notification as an instruction to activate the genre search mode B, the hierarchy shifting unit 151 activates the genre search mode B (FIG. 5, S511 → S512).
[0049]
If it is troublesome to notify the “program guide” or the “back program” until the “genre search” is notified as described above, the user is notified of the “program table” or the “back program”. Occasionally, the user may say “next” or press the down arrow key 301 of the remote controller 300. The “next” issued by the user is received by the in-layer processing means 152 as a selection instruction via the voice conversion means 101 and the event processing means 102. Further, the fact that the downward cross key 301 has been pressed is received by the in-layer processing means 152 as a selection instruction via the event processing means 102 (FIG. 5, S533).
[0050]
Upon receiving the selection instruction, the in-hierarchical processing means 152 stops the notification of the currently notified item and, if there is an item to be notified next, notifies the item (FIG. 5, S506 → S508 → S504). ).
[0051]
That is, when the "program guide" is notified, the notification of the "program guide" is stopped and the "counter program" is notified, and when the "counter program" is notified, the notification of the "counter program" is performed. Is stopped and “genre search” is notified. Therefore, immediately after the program navigation mode A is started, the user says “next” twice, so that the “genre search” is notified immediately after the program navigation mode A is started.
[0052]
If the user does not say "OK" or press the enter key 302 until a predetermined time has elapsed since the last item (information) to be announced by the voice guidance, the in-hierarchical processing means 152 Determines that there is no item to be notified next, and waits for specification of an item (FIG. 5, S509).
[0053]
As described above, when the in-hierarchy processing unit 152 is in a waiting state, that is, when an item is designated after the voice guidance has been notified to the end, the user designates the name of the item to be designated (in the present embodiment, “genre search”). )) To the digital TV 100. The "genre search" issued by the user is converted into an electric signal by the voice conversion means 101 and transferred to the event processing means 102.
[0054]
When the event processing means 102 receives the "genre search" from the voice conversion means 101, the event processing means 102 transfers the "genre search" to the in-layer processing means 152 (FIG. 5, S534). Upon receiving the “genre search”, the in-layer processing means 152 notifies the above-mentioned layer shifting means 151 that the genre search mode B has been designated.
[0055]
When the notification that the genre search mode B has been designated as described above is received as an instruction to activate the genre search mode B, the hierarchy shifting means 151 determines the genre which is a lower hierarchy of the program navigation mode A as shown in FIG. The search mode B is activated (FIG. 5, S511 → S512).
[0056]
When the genre search mode B is activated, the hierarchy shift unit 151 determines a lower level than the setting mode activated immediately before, in consideration of the case where the user is visually impaired, as in the activation of the program navigation mode A. A notification sound indicating that the hierarchy setting mode has been activated is provided by the speaker 104 (FIG. 5, S503).
[0057]
Note that the lower-level setting mode is activated during the activation of the predetermined-level setting mode such as when the genre search mode B is activated, and the setting mode is activated as when the program navigation mode A is activated. It is desirable to make the volume, frequency, timbre, notification time, rhythm, melody sound, and the like of these notification sounds different so that the notification sound can distinguish that the setting mode of the predetermined hierarchy has been activated from the absence state. For example, the notification sound indicating that the setting mode of the lower hierarchy has been activated during the activation of the setting mode of the predetermined hierarchy is set to “ping-pong”, and the notification indicating that the setting mode of the predetermined hierarchy has been activated from the state where the setting mode has not been activated. Make the sound "bean".
[0058]
Upon notifying the notification sound, the layer shift unit 151 instructs the in-layer processing unit 152 to notify the voice guidance in the genre search mode B. When the voice guidance is instructed, the in-layer processing unit 152 displays the genre search screen shown in FIG.
[0059]
As shown in FIG. 7, the genre search screen includes a news / report item 601, a sports item 602, a culture / entertainment item 603, a drama item 604, a music item 605, a variety item 606, a movie item 607, an animation / special effects item 608, Other items 609, a pointer 621, and an operation unit such as a cross key 301 are displayed, and the user can obtain what to do next only from the visual information.
[0060]
Further, following the notification sound, the in-hierarchical processing means 152 notifies the voice guidance for causing the visually impaired person to recognize what to do next from the speaker 104 (FIG. 5, S504).
[0061]
The voice guidance starts with, for example, “Genre search mode B has been activated. Please specify an item.” The name of each item displayed on the genre search screen (news / report, sports, culture / entertainment, Drama, music, variety, movie, animation / sFX, etc.).
[0062]
In the same manner as when the genre search item is specified on the program navigation screen, since the soccer is included in the sport, for example, a predetermined time elapses while the “sports” of the voice guidance is announced and after the announcement. By then, say "decision" toward digital TV 100. Note that when designating “sports”, the user may say “sports” to the digital TV 100 after the voice guidance has been notified to the end and the in-hierarchy processing unit 152 is in a waiting state as described above. . In addition, as described above, the user may use the “next” or down arrow key 301 to stop the notification of news / reporting on the way, and may promptly notify “sports”.
[0063]
The “decision” issued by the user is received by the event processing unit 102 via the voice conversion unit 101. Upon receiving the decision from the voice conversion means 101, the event processing means 102 transfers the decision to the in-hierarchy processing means 152 (FIG. 5, S532).
[0064]
Upon receiving the decision, the in-layer processing means 152 recognizes that the sports sub-genre mode C has been specified by the user (FIG. 5, S505). When recognizing that the sports sub-genre mode C has been selected, the in-layer processing means 152 notifies the layer shifting means 151 that the sports sub-genre mode C has been designated.
[0065]
Then, when recognizing the above determination as a start instruction of the sports sub-genre mode C, the hierarchy shifting means 151 starts the sports sub-genre mode C which is a lower hierarchy of the genre search mode B shown in FIG. 4 (FIG. 5). , S511 → S512). When the user activates the sub-genre mode C in consideration of the case where the user is a visually impaired person, the above-mentioned hierarchy shifting means 151 informs that the setting mode of the lower hierarchy than the genre search mode B has been activated. "Ping-pong" is notified from the speaker 104 (FIG. 5, S503).
[0066]
Upon notifying the notification sound, the layer shift unit 151 instructs the in-layer processing unit 152 to notify the voice guidance in the sub-genre mode C of sports.
[0067]
When the voice guidance is instructed, the in-layer processing means 152 displays the sport sub-genre mode C screen shown in FIG.
[0068]
As shown in FIG. 8, on the screen, all the operation units such as an item 701, a baseball item 702, a soccer item 703, a golf item 704, a public competition item 705, other items 706, a pointer 721, and a cross key 301 are displayed. Displayed, again allowing the user to get what to do next only from visual information.
[0069]
Further, in consideration of the case where the user is a visually impaired person, the in-hierarchical processing means 152 notifies the speaker 104 of voice guidance for causing the visually impaired person to recognize what to do next.
[0070]
The voice guidance starts with, for example, "Sports subgenre mode has been activated. Please specify the item." The name of each item displayed on the sports screen (all, baseball, soccer, golf, public sports) , Etc.) in sequence (FIG. 5, S504). Here, in order to reserve the recording of the soccer program, for example, the user says “decision” to the digital TV 100 while “soccer” is informed. The “decision” is converted into an electric signal by the voice conversion unit 101 and transferred to the event processing unit 102.
[0071]
Upon receiving the decision from the voice conversion means 101, the event processing means 102 transfers the decision to the in-hierarchy processing means 152 (FIG. 5, S532). The in-layer processing means 152 notifies the above-mentioned layer shifting means 151 that the soccer mode has been designated.
[0072]
When the notification is received as a soccer mode activation instruction, the layer shifting means 151 activates a soccer mode that is a lower layer of the sports sub-genre mode C shown in FIG. 4 (FIG. 5, S511 → S512). In addition, when the soccer mode is activated in consideration of the case where the user is visually impaired, the above-mentioned hierarchy shifting means 151 informs the user of the notification sound “ping-pong” indicating that the setting mode of the lower hierarchy than the sports sub-genre mode C has been activated. Is notified from the speaker 104 (FIG. 5, S503).
[0073]
Upon notifying the notification sound, the layer shift unit 151 instructs the in-layer processing unit 152 to notify the voice guidance in the soccer mode.
[0074]
When the voice guidance is instructed, the in-hierarchical processing means 152 notifies the voice guidance “Soccer mode has been activated. A soccer program is being searched.” From the speaker 104.
[0075]
Then, the in-layer processing means 152 recognizes “soccer” as a soccer program search command, and searches the EPG stored in the EPG storage means 108 for a program whose name 203 includes soccer. Then, as shown in FIG. 9, the in-hierarchical processing means 152 displays on the monitor 103 a soccer program list screen in which the broadcast date / time 202, the program name 203, and the broadcast channel 201 of the program whose title 203 includes soccer are displayed. .
[0076]
Again, in consideration of the case where the user is visually impaired, the in-hierarchical processing means 152 notifies the speaker 104 of a notification sound indicating that the search has been completed, and the broadcast date and time 202 of the program displayed on the monitor 103. , The program name 203 and the broadcast channel 201 (FIG. 5, S504).
[0077]
By the way, since it takes a certain amount of time to search for a program, it may take a long time from when the user says "soccer" to when a notification sound indicating that the search has been completed is issued. For this reason, the user may misunderstand that the digital TV 100 has been frozen, or may be uneasy that “soccer” has not been received by the digital TV 100.
[0078]
Therefore, when the search for the soccer program is started, the in-hierarchy processing means 152 may notify the search execution status of the soccer program by sound or voice. For example, while searching for a soccer program, the user is repeatedly notified by voice of "I'm searching for a soccer program", and as the search progresses, the frequency of the notification sound is raised, lowered, and the volume is increased. , Make it smaller or change the tone or melody.
[0079]
By notifying the search execution status of the soccer program as described above, the visually impaired person can be prevented from being misunderstood or anxious as described above. Of course, the in-layer processing means 152 may notify the execution status not only of the search for the soccer program but also of any processing.
[0080]
Also, in order to prevent misunderstanding or anxiety, instead of notifying the search execution status as described above, the in-hierarchical processing means 152 executes the following. Is also good.
[0081]
When performing a time-consuming process such as a program search, a voice guidance such as "Immediate execution of the command. Please wait for a while." Or a notification sound or melody sound indicating that the command is being executed is always provided. Alternatively, if the command cannot be completed within a predetermined time from the start of execution of the command, a voice guidance such as "Please wait a moment." Or a notification sound indicating that the command is being executed is always provided.
[0082]
When the desired soccer program is notified by the in-layer processing means 152 as described above, the visually impaired person says “decision” at that time. The "decision" is converted into an electric signal by the voice conversion means 101 and transferred to the event processing means 102.
[0083]
Upon receiving the decision, the event processing means 102 transfers the decision to the in-layer processing means 152 (FIG. 5, S532). The in-hierarchy processing means 152 determines whether the program that is currently being broadcast is a program that is currently being broadcast or a program that is broadcast at an earlier time, and a program that is broadcast at an earlier time is a reservation target program. Recognize. In the present embodiment, since only one target program can be specified in the soccer mode, if a currently broadcast program is selected, the setting mode ends and the program is displayed on the screen. In the case of a program to be reserved, the in-layer processing means 152 notifies the recording target program specified to the layer shifting means 151.
[0084]
When the notification is received as an instruction to activate the reservation mode, the layer shift unit 151 activates the reservation mode for setting details of the recording reservation of the program (FIG. 5, S511 → S512). In addition, when the reservation mode is activated in consideration of the case where the user is visually impaired, the layer shift unit 151 outputs a notification sound “ping-pong” indicating that the setting mode of the lower layer than the soccer mode has been activated to the speaker 104. (S503 in FIG. 5). From the notification sound, the visually impaired person recognizes that the “decision” has been received by the digital TV 100 and the reservation mode has been activated.
[0085]
Upon notifying the notification sound, the layer shift unit 151 instructs the in-layer processing unit 152 to notify the voice guidance in the reservation mode.
[0086]
When there is an instruction to notify the voice guidance, the in-layer processing means 152 displays the reservation screen shown in FIG. On the reservation screen, as shown in FIG. 10, an operation unit such as an item 910 for specifying a recording method, an item 920 for specifying a recording medium 110, an item 930 for specifying whether or not to make a reservation, a pointer 921, a cross key 301, etc. Is displayed, and also on the reservation screen, the user can obtain what to do next only from the visual information.
[0087]
Further, the in-layer processing means 152 notifies the following voice guidance from the speaker 104 so that the visually impaired person can recognize what to do next.
[0088]
The in-hierarchical processing means 152 provides a voice guidance of “Please select a reservation method. Do you want to make a viewing reservation? Do you want to make a recording reservation” to ask the user whether to make a viewing reservation or a recording reservation. The notification is made from 104 (S504 in FIG. 5). The viewing reservation means that the program is reproduced on the monitor 103 and the speaker 104 without recording, and the recording reservation means that only the recording is performed without reproducing the program.
[0089]
For example, while the user is informed of “Do you want to make a recording reservation?”, If the user says “decision” to the digital TV 100, “decision” is sent to the event processing unit 102 via the audio conversion unit 101. Received. Upon receiving the “decision”, the event processing means 102 transfers the decision to the in-layer processing means 152 (FIG. 5, S532).
[0090]
Upon receiving the decision, the intra-layer processing means 152 recognizes that the recording reservation has been designated (S505 in FIG. 5).
[0091]
In the reservation mode, items that can be specified include, in addition to the reservation method, specification of the recording medium 110 and specification of whether or not to register the reservation. Therefore, when recognizing that the recording reservation has been specified, the in-layer processing means 152 notifies the voice guidance “Please specify a recording medium. Hard disk, DVHS, DVD” (FIG. 5, S504).
[0092]
For example, the user may say “OK” to the digital TV 100 while “DVD” is being notified. Then, “decision” is received by the event processing unit 102 via the voice conversion unit 101. Upon receiving the “decision”, the event processing means 102 transfers the decision to the in-layer processing means 152 (FIG. 5, S532).
[0093]
Upon receiving the decision, the in-layer processing means 152 recognizes that a DVD has been designated (FIG. 5, S505). Further, the in-layer processing means 152 notifies the voice guidance of "designate whether or not to register the reservation. Do not reserve, reserve" (FIG. 5, S504).
[0094]
For example, while the user is informed of “reserve”, saying “decision” toward the digital TV 100, the “decision” is received by the event processing means 102 via the voice conversion means 101. Upon receiving the decision, the event processing means 102 transfers the decision to the in-layer processing means 152 (FIG. 5, S532). Upon receiving the decision, the in-layer processing means 152 recognizes that the reservation of the soccer program specified in the soccer mode has been registered (S505 in FIG. 5).
[0095]
When recognizing that the reservation has been registered, the in-hierarchy processing means 152 sends the broadcast time, broadcast date and time, the reservation method and the recording medium of the soccer program selected in the soccer mode to the recording and reproducing means 153. register.
[0096]
Based on this registration, the recording / playback means 153 records the soccer program specified by the user on the registered recording medium.
[0097]
As described above, at the time when the user “decides” while “reserve” is informed, all the items that can be specified in the reservation mode have been specified. The broadcast date and time of the soccer program are registered in the recording / reproducing means 153, and a notification sound indicating that the setting of the recording reservation has been completed or a sound such as "recording reservation has been completed" is issued from the speaker 104. Then, upon receiving the notification that the reservation completion has been registered in the hierarchical shifting means 151, the in-tier processing means 152 returns to the soccer program list screen. Thus, the user can continue operations such as making a reservation for another program or searching for a program of another genre.
[0098]
Upon receiving the notification that the reservation completion has been registered as an instruction to end the setting mode, the layer shifting means 151 ends the setting mode (S511 → S513 in FIG. 5). At the same time as ending the setting mode, the layer shifting means 151 issues a notification sound indicating that the setting mode has been ended. Following the notification sound, the layer shift unit 151 may output a voice guidance that “the setting mode has ended”.
[0099]
In addition, the end of the setting mode and the start of the setting mode from the state in which the setting mode has not been started such as when the program navigation mode A has been started can be distinguished by the notification sound so that these notification sounds can be distinguished. It is desirable to make the volume, frequency, tone, notification time, rhythm, melody sound, and the like different.
[0100]
In this way, the state of the digital TV 100 and what to do next are notified from the speaker 104 by the notification sound or the voice guidance, so that even if the user is a visually impaired person, the operation is not lost.
[0101]
Since the user may mistakenly specify the setting mode, the layer shifting means 151 is provided by the user's instruction so as to be one level higher than the currently activated setting mode so that the setting mode can be specified again. Can be activated, or the operation itself can be canceled to return to the level at which the operation was performed. In order to perform the “return” operation, the user may press the “return” button 305 of the remote controller 300 or input a voice of “return”. The device has a function that allows the user to select whether to return to the immediately higher hierarchy or to the previous operation. In addition to "return", the device accepts words that match the user's image, such as "cancel" and "cancel", as well as words used for voice input, and words that have the same role as the back button. The user can register.
[0102]
For example, when a user makes a reservation for recording a soccer program, if the user selects the baseball item 702 on the screen shown in FIG. 8, the baseball mode is activated, and the voice "Baseball mode has been activated. Searching for baseball program." Guidance is announced.
[0103]
When the user recognizes that the user has mistakenly selected the baseball item 702 by the voice guidance, the user says, for example, “return” to the digital TV 100. "Return" is transferred to the event processing means 102 via the voice conversion means 101.
[0104]
When the event processing unit 102 receives “return” from the voice conversion unit 101, the event processing unit 102 transfers the reception of the “return” to the layer shift unit 151.
[0105]
When the event processing unit 102 transfers that “return” has been received, the hierarchy shifting unit 151 determines that the subordinate of the upper-level sport in the baseball mode is one level higher than that of the baseball mode even while the baseball program is being searched. The genre mode C is activated.
[0106]
Then, the above-mentioned layer shifting means 151 issues a notification sound indicating that the setting mode of one higher layer has been activated in the same manner as described above. Further, the hierarchy shifting means 151 instructs the in-hierarchy processing means 152 to notify the voice guidance of the sports sub-genre mode C. Further, for example, when the user voice-inputs "baseball" in the program navigation mode, the shortcut function is activated and the search for the baseball program is executed directly. Even while the search is being executed, the user inputs the return button 305 or “returns” by voice, thereby canceling the item selection operation itself of “baseball” and returning to the hierarchy at the time of the operation, that is, the program navigation mode screen. be able to. Accordingly, even if the user does not understand the structure of the hierarchical structure, the user can directly perform the operation again by using the voice input, and the number of operation procedures can be reduced.
[0107]
When the voice guidance is instructed, the in-hierarchical processing means 152 displays the sports screen and displays "Sports sub-genre mode has been activated. Please specify the item. All. Baseball, soccer, golf. .Public competition.Others "is notified using the speaker 104.
[0108]
Thus, the user can select the soccer item 703.
[0109]
It should be noted that, in order to distinguish between the setting mode that has been started up to immediately before and the setting mode of the upper layer and the setting mode of the lower layer that have been started, the volume of these notification sounds, The frequency, timbre, time, rhythm, melody, etc. may be different.
[0110]
When “return” is received, the setting mode activated by the above-mentioned layer shifting means 151 is not limited to the setting mode of one layer higher than the currently activated mode, and may be a setting mode of a plurality of layers higher. . For example, when the event processing unit 102 receives “return” regardless of the setting mode of any layer, the layer shift unit 151 starts the program navigation mode A of the highest layer of the setting mode. You may.
[0111]
As described above, when the setting mode of a plurality of layers higher is activated, the above-mentioned layer shifting means 151 issues a notification sound for notifying the user how many higher layers of the setting mode have been activated. For example, the above-mentioned layer shifting means 151 notifies the same number of notification sounds as the difference between the number of layers of the setting mode activated just before and the number of layers of the newly activated setting mode.
[0112]
In the above description, the case where "return" is input by voice to the digital TV 100 has been described, but when the return button 305 of the remote controller 300 is pressed, for example, the above-mentioned layer shifting means 151 activates the setting mode of one higher layer. You may make it.
[0113]
Further, instead of “return”, if the user speaks of a setting mode that the user wants to activate, the above-mentioned hierarchy shifting means 151 may activate the setting mode. In this case, the user may refer to not only the setting mode of the higher hierarchy than the currently activated setting mode, but also the setting mode of the lower hierarchy. For example, if the user says “soccer” when the program navigation mode A is running, the hierarchy shifting unit 151 starts the soccer mode. As shown in FIG. 4, the soccer mode is a setting mode three levels lower than the program navigation mode A. Therefore, when the soccer mode is activated, the soccer mode starts to emit a notification sound indicating that the lower layer setting mode has been activated. Notify three times.
[0114]
However, when the setting mode specified by the user is activated as described above, if there are a plurality of setting modes having similar names, the setting mode that the user does not intend due to a mistake by the user or a conversion error of the voice conversion unit 101. Mode may be activated. For example, it is assumed that there is a soccer mode in the lower hierarchy of the sports sub-genre mode C, and there is a soccer program list mode in the lower hierarchy of the reservation list mode. In this case, when the sports sub-genre mode C is activated, it is assumed that the user intends to search for a soccer program and calls it “soccer program list”.
[0115]
Then, contrary to the user's intention, the above-mentioned layer shifting means 151 starts the soccer program list mode of the lower layer of the reservation list mode. As described above, when starting a setting mode other than the sub-setting mode composed of the currently activated genre search mode B and the setting mode of the lower hierarchy, the hierarchy shifting unit 151 differs from the currently activated setting mode. The in-hierarchy processing means 152 is notified that the setting mode belonging to the sub-setting mode has been activated.
[0116]
When the notification is received, the in-hierarchical processing means 152 performs notification for surely informing the user that the setting mode belonging to the different sub-setting mode has been activated. For example, the sound frequency of the voice guidance "Soccer program list has started. Searching for reserved soccer program" is higher, lower, or louder than normal voice guidance. .
[0117]
Thus, the user can reliably recognize that the unintended setting mode has been activated. In such a case, the user sends “return” to the digital TV 100 as described above to specify the setting mode again.
[0118]
In addition, the in-hierarchy processing means 152 includes, in the voice guidance to be notified, in addition to the activated setting mode name, a sound or a sound that specifies the setting mode of the upper layer such as the setting mode name or abbreviation of the upper layer of the setting mode. The voice guidance may be notified. For example, when the soccer mode is activated, the in-hierarchy processing means 152 notifies the voice guidance “Soccer mode of the sports sub-genre mode has been activated ....” and activates the soccer program list mode. The voice guidance of "The soccer program list mode in the reservation list mode has been activated."
[0119]
By notifying the setting mode name and the like of the upper hierarchy as described above, the user can surely recognize that the unintended setting mode has been activated.
[0120]
In the above description, a case has been described in which the user activates the program navigation mode A by saying “program navigation”. However, the user activates the program navigation mode A using the menu key 303 of the remote controller 300 to perform recording. A reservation may be set. For example, when a TV program is being reproduced on the monitor 103 and the speaker 104, a healthy person presses the menu key 303 when making a reservation for recording a soccer program. The fact that the menu key 303 has been pressed is transmitted from the remote controller 300 to the event processing means 102.
[0121]
When the fact that the menu key 303 has been pressed is transmitted, the event processing means 102 transfers the fact that the instruction from the user has been directly received from the remote controller 300 together with the activation instruction to the hierarchy shifting means 151 (FIG. 5, S531).
[0122]
When the start instruction is transferred, the hierarchy shifting means 151 starts the program navigation mode A (S501 in FIG. 5). However, when the program navigation mode A is activated by pressing the menu key 303, the hierarchy shifting unit 151 does not emit the notification sound as described above. Similarly, the in-hierarchical processing means 152 also waits for the user to specify an item displayed on the program navigation screen without informing the voice guidance (FIG. 5, S502 → S521). It is normal for a healthy person to activate the program navigation mode A using the menu key 303, and the normal person can see what he / she does by looking at the screen even if the notification sound and voice guidance are not notified. This is because it is possible to recognize the feeling.
[0123]
When the program navigation screen is displayed, the user presses the cross key 301 of the remote controller 300 in a predetermined direction to move the pointer 521. The fact that the cross key 301 has been pressed is transmitted from the remote controller 300 to the event processing means 102. The event processing means 102 transfers the received press of the cross key 301 to the in-layer processing means 152. The in-hierarchy processing means 152 grasps the position indicated by the current pointer 521 based on the fact that the transferred cross key 301 has been pressed. Then, the in-layer processing means 152 displays the pointer 521 at the grasped position.
[0124]
The user presses the enter key 302 when the pointer 521 moves to a desired item. The fact that the enter key 302 has been pressed is transmitted from the remote controller 300 to the event processing means 102. When the remote controller 300 transmits that the decision key 302 has been pressed, the event processing means 102 transfers the fact that the decision key 302 has been pressed to the intra-layer processing means 152 (FIG. 5, S534).
[0125]
When the event processing means 102 transmits that the decision key 302 has been pressed, the in-layer processing means 152 informs the above-mentioned hierarchy shifting means 151 that the user has designated the item currently pointed to by the pointer 521. Notice. The hierarchy shift unit 151 activates a setting mode corresponding to the notified item (FIG. 5, S522 → S523 → S524). In the reservation mode, when "reserve" is designated by pressing the enter key, the layer shift unit 151 ends the setting mode (FIG. 5, S522 → S523 → end).
[0126]
Even when the program navigation mode A is activated by the menu key 303 in this way, the hierarchical transition means 151 can send the item to be activated to the digital TV 100 instead of the cross key 301 or the enter button 302, and May be activated. However, even when the predetermined setting mode is activated by using voice, if the program navigation mode A is activated by the menu key 303, the above-mentioned hierarchy shifting means 151 and the above-mentioned in-hierarchy processing means 152 provide the notification sound. And voice guidance are not announced.
[0127]
When the visually impaired person activates the program navigation mode A using the menu key 303, the visually impaired person cannot grasp the item pointed to by the pointer 521. When the item pointed by changes, the item pointed to by the pointer 521 may be notified by voice.
[0128]
Further, instead of the cross key 301, the pointer 521 may be moved by a user's voice. For example, when the program navigation screen is activated, the in-hierarchy processing means 152 displays a pointer 521 at a position indicating the program guide item 501. When the user says “below”, the “below” is received by the in-layer processing means 152 via the voice conversion means 101 and the event processing means 102. When receiving the lower part, the in-hierarchical processing means 152 may move the pointer 521 to the counterprogram item 502 displayed immediately below the program table item 501.
[0129]
If it is assumed that even a visually impaired person is likely to operate the remote controller, even if the program navigation mode A is activated by pressing the menu key 303, the above-mentioned hierarchy shifting means is used. 151 or the in-hierarchy processing means 152 may notify the notification sound or the voice guidance.
[0130]
Instead of the remote controller 300, a keyboard, a braille keyboard, or keys provided on the digital TV 100 may be used as the cross key 301, the enter key 302, the menu key 303, and the return key 305.
[0131]
【The invention's effect】
The notification means notifies the status of the electronic device using sound and voice, so that not only healthy people but also visually impaired people can grasp the status of the electronic device and the operation procedure and operate as intended. Since it is possible to recognize whether or not the electronic device can be used, it is possible to provide an electronic device that is easy to use for not only healthy persons but also visually impaired persons. Therefore, an electronic device with high usability can be provided from the viewpoint of universal design.
[0132]
In addition, since the electronic device is notified by sound or voice whether it is operating as intended, not only the visually impaired but also the healthy can operate the electronic device without looking at the screen. .
BRIEF DESCRIPTION OF THE DRAWINGS FIG.
FIG. 1 is a block diagram of an electronic device of the present invention.
FIG. 2 is a conceptual diagram of an EPG.
FIG. 3 is a schematic diagram of a remote controller.
FIG. 4 is a conceptual diagram of a setting mode.
FIG. 5 is a flowchart showing a procedure for recording reservation;
FIG. 6 is a schematic diagram of a program navigation screen.
FIG. 7 is a schematic diagram of a genre search screen.
FIG. 8 is a conceptual diagram of a sports sub-genre screen.
FIG. 9 is a schematic diagram of a screen on which a list of searched programs is displayed.
FIG. 10 is a conceptual diagram of a reservation setting screen.
[Explanation of symbols]
100 digital TV
102 Event processing means
104 speaker
105 Execution means

Claims (10)

Event processing means capable of accepting instructions in a plurality of input forms;
Executing means for executing an instruction based on the instruction received by the event processing means;
An electronic device, comprising: a notifying unit for notifying, by sound or voice, that the execution unit has executed the command received by the event processing unit in a predetermined input form. The instruction is a start instruction for starting a setting mode for setting an operation state, or an end instruction for ending the setting mode,
The execution means starts the setting mode when receiving the start instruction, and ends the setting mode when receiving the end instruction,
2. The electronic apparatus according to claim 1, wherein the notifying unit notifies that the setting unit has started or ended the setting mode. The execution means is constituted by a hierarchy transition means and an in-tier processing means, and the setting mode has a hierarchy structure;
The execution means activates the setting mode of the other layer when the event processing means receives a start instruction of the setting mode of the other layer during the activation of the setting mode of the predetermined layer.
3. The electronic device according to claim 2, wherein the notifying unit notifies that the execution unit has started a setting mode of another layer. The other layer setting mode is a higher layer setting mode or a lower layer setting mode with respect to the predetermined layer setting mode,
4. The electronic device according to claim 3, wherein the notification unit differs in a notification mode when the setting mode of the upper hierarchy is activated and when the setting mode of the lower hierarchy is activated. The notification means differs in a notification mode when the setting mode is activated or terminated by the activation instruction or the termination instruction and when the setting mode of the other layer is activated by the activation instruction of the setting mode of another layer. The electronic device according to claim 3. The electronic device according to claim 2, wherein the notification unit has a different notification mode when the setting mode is activated by the activation instruction and when the setting mode is terminated by the termination instruction. The setting mode of the other layer is a setting mode different from the setting mode being started by a plurality of layers,
When the setting mode of the other layer is started, the notifying unit notifies the start of the setting mode of the other layer and the difference in the number of layers between the setting mode of the other layer and the setting mode being started. The electronic device according to claim 3 or 4, wherein The above setting mode is composed of a plurality of sub setting modes,
The execution means, when the event processing unit receives a start instruction of another sub-setting mode from the user during the start of the predetermined sub-setting mode, starts the other sub-setting mode,
3. The electronic apparatus according to claim 2, wherein the notifying unit notifies that the execution unit has activated the other sub-setting mode. The notification means, when the setting mode of the predetermined hierarchy is activated by the execution means, notifies at least one of the setting mode and a sound or a voice specifying the setting mode of a higher hierarchy than the setting mode. Item 4. The electronic device according to item 3. The electronic device according to claim 1, wherein the notifying unit notifies the execution state of the command by the execution unit by at least one of sound and voice.

Images