WO1999030253A2 - System for obtaining assistance in operating an apparatus - Google Patents

System for obtaining assistance in operating an apparatus Download PDF

Info

Publication number
WO1999030253A2
WO1999030253A2 PCT/IB1998/001936 IB9801936W WO9930253A2 WO 1999030253 A2 WO1999030253 A2 WO 1999030253A2 IB 9801936 W IB9801936 W IB 9801936W WO 9930253 A2 WO9930253 A2 WO 9930253A2
Authority
WO
WIPO (PCT)
Prior art keywords
operator
display system
communication network
conceived
operator terminal
Prior art date
Application number
PCT/IB1998/001936
Other languages
French (fr)
Other versions
WO1999030253A3 (en
Inventor
Leonarda J. M. Vriens
Henricus J. C. Kuijpers
Marc G. D. Steen
Original Assignee
Koninklijke Philips Electronics N.V.
Philips Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V., Philips Ab filed Critical Koninklijke Philips Electronics N.V.
Priority to KR1019997007264A priority Critical patent/KR100609251B1/en
Priority to EP98954699A priority patent/EP1019854B1/en
Priority to JP53047099A priority patent/JP2001514835A/en
Priority to DE69838140T priority patent/DE69838140D1/en
Publication of WO1999030253A2 publication Critical patent/WO1999030253A2/en
Publication of WO1999030253A3 publication Critical patent/WO1999030253A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H04N21/6547—Transmission by server directed to the client comprising parameters, e.g. for client setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards

Definitions

  • the present invention relates to a help system for obtaining assistance in operating an apparatus, comprising a display system, a communication network .and an operator terminal, the display system being provided with operator call means for establishing a connection to the operator terminal via the communication network in response to a user command.
  • Such a system is k . nown from the English abstract of JP 62-127967.
  • an audio and video connection is established with a help-desk operator.
  • the video connection enables the operator to support his explanation by gestures and pictures.
  • a disadvantage of the known system is that expensive hardware is required and in most cases the bandwidth needed for transporting the video information is not available.
  • An objective of the present invention is to provide a help system which offers some of the benefits of a video connection without the need for expensive hardware and a broadband network.
  • the help system according to the invention is characterized in that the display system is conceived to store and display a picture of control means of the apparatus, and to visualize an operation upon the control panel in response to control signals obtained from the communication network, the operator terminal being conceived to generate said control signals and send the control signals via the communication network to the display system.
  • the bandwidth required for tr.ansport.uig the control signals is much smaller than the bandwidth which would have been required for sending a video recording of the control p.anel which is operated by a help-desk operator.
  • the display system may comprise a microphone for enabling a user of the apparatus to verbally communicate a problem to the operator terminal.
  • the operator terminal may be equipped with a further microphone, enabling the operator to verbally communicate with the user.
  • the operator terminal could be equipped with a speech recognition system and an automatic answering system, enabling the operator terminal to respond automatically to spoken messages from the user.
  • Microphones may be dispensed with at all when the dialog is fully automated, e.g. involving screen menus or numeric key selections.
  • Features of the visualization may be the usage of a pointer for indicating a particular control, and highlighting or animation techniques which .are well .known from graphical computer applications.
  • An embodiment of the help system is characterized in that the display system comprises permanent storage means for storing the picture, .and that the display system is conceived to show the stored picture upon receiving an identification signal from the communication network, the operator terminal being conceived to generate the identification signal and send the identification signal via the communication network to the display system.
  • the operator terminal is conceived to send the picture via the communication network to the display system, the display system being conceived to receive the picture from the communication network .and store the picture in volatile storing means.
  • a further embodiment of the help system is characterized in that the display system comprises further storage means for storing an image of an operator, and that the display system is conceived to show the image of the operator which is stored in the further storage means. This feature gives the user an additional indication that a connection with a help-desk operator has been established.
  • a further embodiment of the help system is characterized in that the further storage means comprise a permanent memory for storing the image of the operator, and that the display system is conceived to show the image upon receiving a further identification signal from the communication network, the operator terminal being conceived to generate the further identification signal and send the further identification signal via the communication network to the display system.
  • the operator terminal could comprise additional means for sending a selection code, enabling the operator to choose the pictorial representation, e.g. a female face.
  • a further embodiment of the help system is characterized in that the operator terminal is conceived to send the image of the operator via the communication network to the display system, the display system being conceived to receive the image of the operator from the communication network .and store it in the further storage means. In this way, resemblance between the picture .and the operator can be guaranteed.
  • a further embodiment of the help system is characterized in that the further storage means contains a plurality of pictures, and that the display system comprises animation means for animating the image of the operator by alternately showing one of at least two of said pictures.
  • the suggestion is strengthened that it belongs to the interlocutor.
  • the .animation means are conceived to be controlled by at least the sound level of a sound signal obtained from the operator terminal, and that the animation means are conceived to alternate at least two pictures of an operator which differ at least in the state of the mouth of the operator.
  • Techniques for animating pictures which are stored locally are .known from teleconferencing systems, see for instance US 5,347,306.
  • a further embodiment of the help system is characterized in that the operator terminal comprises controlling means for controlling the display system by sending further control signals via the communication network to the display system, and that the display system is conceived to receive and interpret the further control signals and operate accordingly.
  • the operator terminal comprises controlling means for controlling the display system by sending further control signals via the communication network to the display system, and that the display system is conceived to receive and interpret the further control signals and operate accordingly.
  • a further embodiment of the help system is characterized in that the display system is a television receiver.
  • the TV receiver is characterized in that the television receiver is conceived to mute the TV sound automatically during a communication between a user and an operator. This enhances the intelligibility of the operator's voice.
  • the invention further relates to a display system for use in a help system according to the invention, and to a method of obtaining assistance in operating an apparatus, comprising a step of establishing a connection to an operator terminal.
  • Figure 1 shows a diagram of a help system according to the invention
  • Figure 2 shows a diagram of a display system according to the invention
  • Figure 3 shows pictures of an operator's face to be used for animation.
  • Figure 1 shows .an embodiment of a help system according to the invention. It comprises a display system 1 which is connected to a communication network 10 and an operator terminal 2.
  • the display system 1 comprises a television receiver 3, which is provided with a microphone 4 and an antenna 5.
  • the television receiver 3 can be operated by means of the remote control 8, which comprises a help button 9 as an embodiment of the operator call means.
  • Another embodiment could be a menu item in .an on-screen menu, or any other mechanism for entering user commands.
  • image 6 being an animation of an operator's face
  • image 7 being a picture of a control panel, e.g. the remote control 8.
  • the operator terminal 2 comprises a computer 12 which is provided with a microphone 11 and connected to the communication network 10.
  • a keyboard 13 is connected to the computer 12.
  • Figure 2 shows a diagram of the television receiver 3.
  • the signal obtained from the antenna 5 is processed by the tuner 15 .and split into .an audio signal and a video signal.
  • the audio signal is further processed by an audio processor 16 and a loudspeaker 17.
  • the video signal is further processed by a video processor 18 and presented on a screen 19.
  • Communication means 20 are conceived to send audio signals to the communication network 10 and to the audio processor 16.
  • the communication means 20 can receive audio signals from the communication network 10 and from the microphone 4, and image and control signals from the communication network 10.
  • Animation means 21 can load pictures from first storage means 22 and second storage means 23 and send them to the video processor 18.
  • the television receiver 3 When a user presses the help button 9, the television receiver 3 establishes a connection to a help-desk operator via the communication network 10. If no connection can be established a message is presented on the screen 19.
  • the operator is equipped with the computer 12. From the start of the communication between the user and the operator, they can talk to each other, using the microphones 4 .and 11. At the start of the communication, three picmres are sent from the operator terminal 2 via the communication network 10 to the television receiver 3, which stores them in the second storage means 23.
  • the pictures represent three images of the operator's face, as shown in Figure 3.
  • Picture 24 shows the operator with the mouth closed
  • picmre 25 shows the operator with the mouth half open
  • picmre 26 shows the operator with the mouth open.
  • the animation means 21 cause the picmres to be presented in an alternating way as the image 6 on the screen 19.
  • the alternation is controlled by the volume of the sound produced by the operator's voice. If the volume is high, picmre 26 is shown, if the volume is low, picmre 25 is shown, while during silence picmre 24 is shown.
  • the image may be composed of a static part, e.g. a background picmre, and two or more dynamic parts which are alternately projected into the image.
  • the picmres are stored permanently in permanent storage means, replacing the second storage means 23. As a result, it is no longer necessary to send the picmres via the communication network 10. In this embodiment resemblance of the picmres to the operator's face cannot be guaranteed.
  • the operator terminal 2 could be provided with additional means (not shown) for generating an identification signal for activating one of various pre-defined sets of picmres. For example, if the operator is a woman, she can activate a set of picmres which represent a woman's face.
  • the help system enables a picmre 7 of a control panel to be shown on the screen 19.
  • This can be the control panel of another apparatus, e.g. a VCR or a microwave oven, or a control panel of the television receiver 3 itself, e.g. the remote control 8.
  • the operator can enter an identification code, identifying a particular control panel.
  • a picmre of that particular control panel is then sent from the operator terminal 2 via the communication network 10 to the television receiver 3, which stores the picmre in the storage means 22.
  • the animation means 21 " can send the picmre to the video processor 18, which causes it to be presented on the screen 19 as the image 7.
  • the animation means 21 can perform animation techniques on the picmre of the control panel, such as moving a cursor over the picmre and visualizing the pressing of a button on the control panel, e.g. by highlighting techniques, which are well known from graphical computer programs.
  • This animation is controlled by control signals which are generated by the operator using the keyboard 14, or any other input means, while inspecting .an image 14 on the screen of the computer 12 which is substantially identical to the image 7 on the screen 19 of the television receiver 3.
  • assistance can only be obtained for a predefined set of devices of which the control panels are stored permanently in the storage means 22. In that embodiment only the control signals for controlling the animation need be sent via the communication network 10 to the television receiver 3.
  • the operator terminal could be provided with control means (not shown) for controlling the operation of the television receiver 3 by means of control signals which are sent via the communication network 10.
  • control means for controlling the operation of the television receiver 3 by means of control signals which are sent via the communication network 10.
  • This enables the operator, besides explaining how a certain goal is achieved, to show the effect of the operations required for achieving the goal. Especially for complex tasks this could be a useful addition.
  • Connections which would be established by accidentally pressing the operator call button can be avoided by asking the user for confirmation, e.g. by means of a screen message which aslcs the user to press the operator call button a second time. Other procedures, such as a time-out on the operator call button, or an interactive conversation using the screen, are well known and can be applied as well. If the television receiver 3 is producing sound just before the connection established, the sound is muted partially or completely, in order to enhance the intelligibility of the operator's voice.
  • the invention relates to a system for obtaining assistance in operating an apparams.
  • a television receiver is provided with a microphone and a dedicated operator call button and connected to a communication network.
  • a connection is established to a help desk operator, enabling the user and the operator, to speak to each other.
  • the operator can make the television receiver show a picmre of the control panel of the apparams for which assistance is requested, and generate control signals for visualizing operations on the control panel.
  • An animated image of the operator is shown on the television receiver, controlled by the sound level of the operator's voice, in order to elucidate the source of the voice speaking to the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to a system for obtaining assistance in operating an apparatus. A television receiver is provided with a microphone and a dedicated operator call button and connected to a communication network. When a user presses the button, a connection is established to a help desk operator, enabling the user and the operator to speak to each other. The operator can make the television receiver show a picture of the control panel of the apparatus for which assistance is requested, and generate control signals for visualizing operations on the control panel. An animated image of the operator is shown on the television receiver, controlled by the sound level of the operator's voice, in order to elucidate the source of the voice speaking to the user.

Description

System for obtaining assistance in operating an apparatus.
The present invention relates to a help system for obtaining assistance in operating an apparatus, comprising a display system, a communication network .and an operator terminal, the display system being provided with operator call means for establishing a connection to the operator terminal via the communication network in response to a user command.
Such a system is k . nown from the English abstract of JP 62-127967. Upon pressing an operator call button of the .known system, an audio and video connection is established with a help-desk operator. The video connection enables the operator to support his explanation by gestures and pictures.
A disadvantage of the known system, however, is that expensive hardware is required and in most cases the bandwidth needed for transporting the video information is not available.
An objective of the present invention is to provide a help system which offers some of the benefits of a video connection without the need for expensive hardware and a broadband network. To that end, the help system according to the invention is characterized in that the display system is conceived to store and display a picture of control means of the apparatus, and to visualize an operation upon the control panel in response to control signals obtained from the communication network, the operator terminal being conceived to generate said control signals and send the control signals via the communication network to the display system. The bandwidth required for tr.ansport.uig the control signals is much smaller than the bandwidth which would have been required for sending a video recording of the control p.anel which is operated by a help-desk operator. The display system may comprise a microphone for enabling a user of the apparatus to verbally communicate a problem to the operator terminal. Similarly, the operator terminal may be equipped with a further microphone, enabling the operator to verbally communicate with the user. Alternatively, the operator terminal could be equipped with a speech recognition system and an automatic answering system, enabling the operator terminal to respond automatically to spoken messages from the user. Microphones may be dispensed with at all when the dialog is fully automated, e.g. involving screen menus or numeric key selections.
Features of the visualization may be the usage of a pointer for indicating a particular control, and highlighting or animation techniques which .are well .known from graphical computer applications.
An embodiment of the help system is characterized in that the display system comprises permanent storage means for storing the picture, .and that the display system is conceived to show the stored picture upon receiving an identification signal from the communication network, the operator terminal being conceived to generate the identification signal and send the identification signal via the communication network to the display system. By storing the picture of the control panel permanently in the display system, no video information need be sent via the communication network, only control signals. A further embodiment of the help system is characterized in that the operator terminal is conceived to send the picture via the communication network to the display system, the display system being conceived to receive the picture from the communication network .and store the picture in volatile storing means. This solution is more flexible, because also pictures of control panels can be shown which are not known in advance. This is particularly useful if the assistance concerns the operation of an apparatus other than the display system itself, e.g. a VCR or a microwave oven.
A further embodiment of the help system is characterized in that the display system comprises further storage means for storing an image of an operator, and that the display system is conceived to show the image of the operator which is stored in the further storage means. This feature gives the user an additional indication that a connection with a help-desk operator has been established.
A further embodiment of the help system is characterized in that the further storage means comprise a permanent memory for storing the image of the operator, and that the display system is conceived to show the image upon receiving a further identification signal from the communication network, the operator terminal being conceived to generate the further identification signal and send the further identification signal via the communication network to the display system. By storing the image of the operator permanently in the display system, no video information need to be sent via the communication network. Of course, resemblance between the image and the operator cannot be guaranteed in this way. To alleviate this drawback, the operator terminal could comprise additional means for sending a selection code, enabling the operator to choose the pictorial representation, e.g. a female face.
A further embodiment of the help system is characterized in that the operator terminal is conceived to send the image of the operator via the communication network to the display system, the display system being conceived to receive the image of the operator from the communication network .and store it in the further storage means. In this way, resemblance between the picture .and the operator can be guaranteed.
A further embodiment of the help system is characterized in that the further storage means contains a plurality of pictures, and that the display system comprises animation means for animating the image of the operator by alternately showing one of at least two of said pictures. By animating the picture of the operator, the suggestion is strengthened that it belongs to the interlocutor. A preferred embodiment is characterized in that the .animation means are conceived to be controlled by at least the sound level of a sound signal obtained from the operator terminal, and that the animation means are conceived to alternate at least two pictures of an operator which differ at least in the state of the mouth of the operator. Techniques for animating pictures which are stored locally are .known from teleconferencing systems, see for instance US 5,347,306.
A further embodiment of the help system is characterized in that the operator terminal comprises controlling means for controlling the display system by sending further control signals via the communication network to the display system, and that the display system is conceived to receive and interpret the further control signals and operate accordingly. This is advantageous when the assistance concerns the operation of the display system itself, particularly if the display system is combined with another complex apparatus, e.g. a television receiver. Operations demonstrated by the operator need not be imitated by the user, but are executed automatically, which quickens the communication.
A further embodiment of the help system is characterized in that the display system is a television receiver. As a result, it is not necessary to purchase a dedicated help system, because TV-receivers are available in most homes. In a preferred embodiment, the TV receiver is characterized in that the television receiver is conceived to mute the TV sound automatically during a communication between a user and an operator. This enhances the intelligibility of the operator's voice.
The invention further relates to a display system for use in a help system according to the invention, and to a method of obtaining assistance in operating an apparatus, comprising a step of establishing a connection to an operator terminal.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
In the drawings:
Figure 1 shows a diagram of a help system according to the invention,
Figure 2 shows a diagram of a display system according to the invention, and
Figure 3 shows pictures of an operator's face to be used for animation.
Figure 1 shows .an embodiment of a help system according to the invention. It comprises a display system 1 which is connected to a communication network 10 and an operator terminal 2. The display system 1 comprises a television receiver 3, which is provided with a microphone 4 and an antenna 5. The television receiver 3 can be operated by means of the remote control 8, which comprises a help button 9 as an embodiment of the operator call means. Another embodiment could be a menu item in .an on-screen menu, or any other mechanism for entering user commands.
On the screen of the television receiver 3 two images 6 and 7 can be presented, image 6 being an animation of an operator's face and image 7 being a picture of a control panel, e.g. the remote control 8.
The operator terminal 2 comprises a computer 12 which is provided with a microphone 11 and connected to the communication network 10. A keyboard 13 is connected to the computer 12. On the screen of the computer 12 an image 14 of a control panel can be presented. Figure 2 shows a diagram of the television receiver 3. The signal obtained from the antenna 5 is processed by the tuner 15 .and split into .an audio signal and a video signal. The audio signal is further processed by an audio processor 16 and a loudspeaker 17. The video signal is further processed by a video processor 18 and presented on a screen 19. Communication means 20 are conceived to send audio signals to the communication network 10 and to the audio processor 16. The communication means 20 can receive audio signals from the communication network 10 and from the microphone 4, and image and control signals from the communication network 10. Animation means 21 can load pictures from first storage means 22 and second storage means 23 and send them to the video processor 18. When a user presses the help button 9, the television receiver 3 establishes a connection to a help-desk operator via the communication network 10. If no connection can be established a message is presented on the screen 19. The operator is equipped with the computer 12. From the start of the communication between the user and the operator, they can talk to each other, using the microphones 4 .and 11. At the start of the communication, three picmres are sent from the operator terminal 2 via the communication network 10 to the television receiver 3, which stores them in the second storage means 23. The pictures represent three images of the operator's face, as shown in Figure 3. Picture 24 shows the operator with the mouth closed, picmre 25 shows the operator with the mouth half open, and picmre 26 shows the operator with the mouth open. After receiving the three picmres, the animation means 21 cause the picmres to be presented in an alternating way as the image 6 on the screen 19. The alternation is controlled by the volume of the sound produced by the operator's voice. If the volume is high, picmre 26 is shown, if the volume is low, picmre 25 is shown, while during silence picmre 24 is shown. Instead of alternating complete picmres, the image may be composed of a static part, e.g. a background picmre, and two or more dynamic parts which are alternately projected into the image. In an alternative embodiment the picmres are stored permanently in permanent storage means, replacing the second storage means 23. As a result, it is no longer necessary to send the picmres via the communication network 10. In this embodiment resemblance of the picmres to the operator's face cannot be guaranteed. The operator terminal 2 could be provided with additional means (not shown) for generating an identification signal for activating one of various pre-defined sets of picmres. For example, if the operator is a woman, she can activate a set of picmres which represent a woman's face.
The help system according to the invention enables a picmre 7 of a control panel to be shown on the screen 19. This can be the control panel of another apparatus, e.g. a VCR or a microwave oven, or a control panel of the television receiver 3 itself, e.g. the remote control 8. After informing the operator as to which apparatus assistance is requested for, the operator can enter an identification code, identifying a particular control panel. A picmre of that particular control panel is then sent from the operator terminal 2 via the communication network 10 to the television receiver 3, which stores the picmre in the storage means 22. The animation means 21" can send the picmre to the video processor 18, which causes it to be presented on the screen 19 as the image 7. The animation means 21 can perform animation techniques on the picmre of the control panel, such as moving a cursor over the picmre and visualizing the pressing of a button on the control panel, e.g. by highlighting techniques, which are well known from graphical computer programs. This animation is controlled by control signals which are generated by the operator using the keyboard 14, or any other input means, while inspecting .an image 14 on the screen of the computer 12 which is substantially identical to the image 7 on the screen 19 of the television receiver 3. In an alternative embodiment assistance can only be obtained for a predefined set of devices of which the control panels are stored permanently in the storage means 22. In that embodiment only the control signals for controlling the animation need be sent via the communication network 10 to the television receiver 3. In the most restricted case, only assistance concerning the television receiver 3 can be obtained, but in that case the operator terminal could be provided with control means (not shown) for controlling the operation of the television receiver 3 by means of control signals which are sent via the communication network 10. This enables the operator, besides explaining how a certain goal is achieved, to show the effect of the operations required for achieving the goal. Especially for complex tasks this could be a useful addition. Connections which would be established by accidentally pressing the operator call button can be avoided by asking the user for confirmation, e.g. by means of a screen message which aslcs the user to press the operator call button a second time. Other procedures, such as a time-out on the operator call button, or an interactive conversation using the screen, are well known and can be applied as well. If the television receiver 3 is producing sound just before the connection established, the sound is muted partially or completely, in order to enhance the intelligibility of the operator's voice.
In summary, the invention relates to a system for obtaining assistance in operating an apparams. A television receiver is provided with a microphone and a dedicated operator call button and connected to a communication network. When a user presses the button, a connection is established to a help desk operator, enabling the user and the operator, to speak to each other. The operator can make the television receiver show a picmre of the control panel of the apparams for which assistance is requested, and generate control signals for visualizing operations on the control panel. An animated image of the operator is shown on the television receiver, controlled by the sound level of the operator's voice, in order to elucidate the source of the voice speaking to the user.

Claims

CLAIMS:
1. A help system for obtaining assistance in operating an apparams, comprising a display system, a communication network and an operator terminal, the display system being provided with operator call means for establishing a connection to the operator terminal via the communication network in response to a user command, characterized in that the display system is conceived to store and display a picmre of control means of the apparams, and to visualize an operation on the control panel, in response to control signals obtained from the communication network, the operator terminal being conceived to generate said control signals and send the control signals via the communication network to the display system.
2. A help system according to claim 1, characterized in that the display system comprises a microphone, the display system being adapted to send signals obtained from said microphone via the communication network to the operator terminal.
3. A help system according to claim 2, characterized in that the operator terminal comprises a further microphone, the operator terminal being adapted to send signals obtained from said further microphone via the communication network to the display system.
4. A help system according to any one of claims 1 to 3, characterized in that the operator terminal comprises a speech recognition system for recognizing speech input from the display system and an automatic answering system for generating an answer in response to said speech input, the operator terminal being adapted to send said answer via the communication network to the display system.
5. A help system according to claim 1, characterized in that the control signals define the position of a cursor in the picture.
6. A help system according to claim 1 or 2, characterized in that the control signals define temporary changes in at least parts of the picmre.
7. A help system according to any of the claims 1 to 3, characterized in that the display system comprises permanent storage means for storing the picmre, and that the display system is conceived to show the stored picmre upon receiving an identification signal from the communication network, the operator terminal being conceived to generate the identification signal and send the identification signal via the communication network to the display system.
8. A help system according to any of the claims 1 to 3, characterized in that the operator terminal is conceived to send the picture via the communication network to the display system, the display system being conceived to receive the picmre from the communication network and store the picmre in volatile storing means.
9. A help system according to any of the claims 1 to 5, characterized in that the display system comprises further storage means for storing an image of an operator, and that the display system is conceived to show the image of the operator which is stored in the further storage means.
10. A help system according to claim 6, characterized in that the further storage means comprise a permanent memory for storing the image of the operator, and that the display system is conceived to show the image upon receiving a further identification signal from the communication network, the operator terminal being conceived to generate the further identification signal and send the further identification signal via the communication network to the display system.
11. A help system according to claim 6, characterized in that the operator terminal is conceived to send the image of the operator via the communication network to the display system, the display system being conceived to receive the image of the operator from- the communication network and store it in the further storage means.
12. A help system according to any of the claims 6 to 8, characterized in that the further storage means contains a plurality of picmres, and that the display system comprises animation means for animating the image of the operator by alternately showing one of at least two of said picmres.
13. A help system according to claim 9. characterized in that the animation means are conceived to be controlled by at least the sound level of a sound signal obtained from the operator terminal, and that the animation means are conceived to alternate at least two picmres of an operator which differ at least in the state of the mouth of the operator.
14. A help system according to any of the claims 1 to 10, characterized in that the operator terminal comprises controlling means for controlling the display system by sending further control signals via the communication network to the display system, and that the display system is conceived to receive and interpret the further control signals and operate accordingly.
15. A display system conceived to be used in a help system according to any of the claims 1 to 11, comprising operator call means and a microphone, and conceived to be connected to a communication network and to show a picture of at least a part of a control panel of an apparams and to visualize an operation on the control panel, the visualization being controlled by control signals obtained from the communication network.
16. A display system according to claim 12, characterized in that the display system is a television receiver.
17. A television receiver according to claim 13, characterized in that the television receiver is conceived to mute the TV sound automatically during a communication between a user and an operator.
18. A method of obtaining assistance in operating an apparams, comprising the step of establishing a connection to an operator terminal, characterized in that the method further comprises the steps of: showing a picmre of at least a part of a control panel of the apparams, visualizing an operation on the control panel, the visualization being actuated by control signals which are sent by the operator terminal.
19. A method according to claim 15, characterized in that the method further comprises the step of showing an image of an operator.
20. A method according to claim 16, cb.aracter.ized in that the method further comprises the step of animating the image of the operator, controlled by at least the sound level of a sound signal obtained from the operator terminal.
PCT/IB1998/001936 1997-12-11 1998-12-03 System for obtaining assistance in operating an apparatus WO1999030253A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
KR1019997007264A KR100609251B1 (en) 1997-12-11 1998-12-03 System for obtaining assistance in operating an apparatus
EP98954699A EP1019854B1 (en) 1997-12-11 1998-12-03 System for obtaining assistance in operating an apparatus
JP53047099A JP2001514835A (en) 1997-12-11 1998-12-03 System to get support for device operation
DE69838140T DE69838140D1 (en) 1997-12-11 1998-12-03 SYSTEM FOR OBTAINING SUPPORT WHEN OPERATING A DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP97203892.1 1997-12-11
EP97203892 1997-12-11

Publications (2)

Publication Number Publication Date
WO1999030253A2 true WO1999030253A2 (en) 1999-06-17
WO1999030253A3 WO1999030253A3 (en) 1999-08-26

Family

ID=8229044

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB1998/001936 WO1999030253A2 (en) 1997-12-11 1998-12-03 System for obtaining assistance in operating an apparatus

Country Status (6)

Country Link
US (1) US6397187B1 (en)
EP (1) EP1019854B1 (en)
JP (1) JP2001514835A (en)
KR (1) KR100609251B1 (en)
DE (1) DE69838140D1 (en)
WO (1) WO1999030253A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2822009A1 (en) * 2001-03-07 2002-09-13 Hewlett Packard Co SYSTEM AND METHOD FOR PROVIDING CUSTOMER SUPPORT

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6408272B1 (en) 1999-04-12 2002-06-18 General Magic, Inc. Distributed voice user interface
US20050261907A1 (en) 1999-04-12 2005-11-24 Ben Franklin Patent Holding Llc Voice integration platform
JP4557331B2 (en) * 1999-05-20 2010-10-06 キヤノン株式会社 Information processing apparatus, information processing system, operation control method, and computer-readable recording medium
US20010033243A1 (en) 2000-03-15 2001-10-25 Harris Glen Mclean Online remote control configuration system
US8531276B2 (en) 2000-03-15 2013-09-10 Logitech Europe S.A. State-based remote control system
GB0030078D0 (en) * 2000-12-09 2001-01-24 Hewlett Packard Co Voice service system and method
US7085259B2 (en) * 2001-07-31 2006-08-01 Comverse, Inc. Animated audio messaging
US20040070616A1 (en) * 2002-06-02 2004-04-15 Hildebrandt Peter W. Electronic whiteboard
EP1477908A1 (en) * 2003-05-14 2004-11-17 Wilfried Beck Communication system and method for improved use of electrical device
GB2420211A (en) * 2004-11-12 2006-05-17 Next Generation Kiosk Ltd Kiosk
DE102006018238A1 (en) 2005-04-20 2007-03-29 Logitech Europe S.A. Remote control system for home theater system, analyzes log of events stored by remote controller to identify patterns of interest in logged use of remote controller
US8531613B1 (en) * 2005-08-19 2013-09-10 Nongqiang Fan Method of controlling computer using television screen
US20070094599A1 (en) * 2005-09-08 2007-04-26 Heidelberger Druckmaschinen Aktiengesellschaft Method and system for training an operator of a paper folding machine
US8536989B2 (en) * 2007-02-26 2013-09-17 Thomson Licensing Method and apparatus for providing a communication link
US8508401B1 (en) 2010-08-31 2013-08-13 Logitech Europe S.A. Delay fixing for command codes in a remote control system
US9503668B2 (en) * 2011-07-24 2016-11-22 Nongqiang Fan Interacting display device
JP6184083B2 (en) * 2012-11-30 2017-08-23 キヤノン株式会社 Image processing apparatus, control method, and computer program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5385475A (en) * 1993-04-01 1995-01-31 Rauland-Borg Apparatus and method for generating and presenting an audio visual lesson plan
US5491743A (en) * 1994-05-24 1996-02-13 International Business Machines Corporation Virtual conference system and terminal apparatus therefor
GB2306274A (en) * 1995-10-13 1997-04-30 Gilbert Cowie Video conference

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS62127967A (en) 1985-11-29 1987-06-10 Nec Corp Remote teaching system
US4884199A (en) * 1987-03-02 1989-11-28 International Business Macines Corporation User transaction guidance
US5309351A (en) * 1988-10-27 1994-05-03 Texas Instruments Incorporated Communications, information, maintenance diagnostic and training system
JPH0362800A (en) * 1989-07-31 1991-03-18 Toshiba Corp Voice remote controller
US5548632A (en) * 1993-11-30 1996-08-20 Lawrence Steelman Safe alert emergency alerting system for remotely located sites
US5347306A (en) 1993-12-17 1994-09-13 Mitsubishi Electric Research Laboratories, Inc. Animated electronic meeting place
US5727950A (en) * 1996-05-22 1998-03-17 Netsage Corporation Agent based instruction system and method
CA2287975C (en) * 1997-04-30 2006-11-14 Oce Printing Systems Gmbh Method for operating a high-performance printer or a copier with assistance given malfunctions

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5385475A (en) * 1993-04-01 1995-01-31 Rauland-Borg Apparatus and method for generating and presenting an audio visual lesson plan
US5491743A (en) * 1994-05-24 1996-02-13 International Business Machines Corporation Virtual conference system and terminal apparatus therefor
GB2306274A (en) * 1995-10-13 1997-04-30 Gilbert Cowie Video conference

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2822009A1 (en) * 2001-03-07 2002-09-13 Hewlett Packard Co SYSTEM AND METHOD FOR PROVIDING CUSTOMER SUPPORT

Also Published As

Publication number Publication date
KR100609251B1 (en) 2006-08-04
JP2001514835A (en) 2001-09-11
EP1019854A2 (en) 2000-07-19
EP1019854B1 (en) 2007-07-25
US6397187B1 (en) 2002-05-28
WO1999030253A3 (en) 1999-08-26
KR20000070998A (en) 2000-11-25
DE69838140D1 (en) 2007-09-06

Similar Documents

Publication Publication Date Title
US6397187B1 (en) System for obtaining assistance in operating an apparatus
US7376441B2 (en) Apparatus and method of interacting with a mobile phone using a TV system
US5999207A (en) Method and apparatus for implementing a user interface for a videophone in a cable television network
JPH07336778A (en) Remote controller, information portable terminal and audio visual equipment
JP2002525690A (en) System including a remotely controlled device and device for remote control based on audio of the device
US6396514B1 (en) Communication system for transmitting a plurality of images and audio information
JP2000196776A (en) Display device with video telephone function, control method of the same and storage medium
US5850265A (en) Intelligent television receiver and method of processing data therein
JP2000236585A (en) Apparatus control method and device and control server
JP2010044776A (en) Method for modifying user interface of consumer electronic apparatus, corresponding apparatus, signal, and data carrier
CN116114251A (en) Video call method and display device
JP4605028B2 (en) Remote control system, remote control communication device, and controlled communication device
US20070171307A1 (en) Media playback system with real-time camera image display and method thereof
JPH07123376A (en) Teletext broadcasting receiver
CN113938634A (en) Multi-channel video call processing method and display device
JPH11327867A (en) Personal computer control unit using set top box
JP2003215707A (en) Presentation system
JPH098938A (en) Dialogue type multimedia device including caller identification decoding characteristic
JPH1011399A (en) Personal computer remote support system
JP3589702B2 (en) Communication terminal device
JPH0635662A (en) Method and device for inputting and outputting terminal data
CN117812179A (en) Display equipment and incoming call response method
JP4676601B2 (en) Channel setting device
CN113938635A (en) Multi-channel video call processing method and display device
JPH0883158A (en) Method and device for information processing

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP KR

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

WWE Wipo information: entry into national phase

Ref document number: 1998954699

Country of ref document: EP

ENP Entry into the national phase

Ref country code: JP

Ref document number: 1999 530470

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1019997007264

Country of ref document: KR

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): JP KR

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

WWP Wipo information: published in national office

Ref document number: 1998954699

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1019997007264

Country of ref document: KR

WWG Wipo information: grant in national office

Ref document number: 1019997007264

Country of ref document: KR

WWG Wipo information: grant in national office

Ref document number: 1998954699

Country of ref document: EP