JP3277428B2 - Control system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control system suitable as an operation control system for various systems such as an AV system, home automation, and an automation system for an office / factory.

[0002]

2. Description of the Related Art Recently, VTRs, television receivers, C
A / V equipment such as D players, air conditioners,
2. Description of the Related Art Various electronic devices such as lighting devices can be remotely controlled using a remote commander. By the way, it is troublesome for a user to use a dedicated remote commander for each device, so that it is preferable that one remote commander can operate a plurality of types of electronic devices.

[0003] Therefore, the applicant of the present invention has previously described, as prior art,
For example, a method has been proposed in which various operation images are superimposed on a video and displayed on a screen of a CRT monitor or the like, and operations of various devices can be executed by selecting the images with a pointer or a cursor.

For example, when connecting a TV tuner, a laser disk player, a VTR, etc. to a CRT monitor device as an AV system, a control unit is connected. For example, when operating a TV tuner or a laser disk player, FIG. CRT as in 19 (a) (b)
Various operation images SD and a pointer P for selecting the images can be displayed on the monitor screen. As the operation image SD, for example, a display in which a plurality of buttons are arranged as illustrated is performed.

When a command code serving as position displacement information is output from the remote commander, for example, the pointer P is moved accordingly, and when the pointer P is on a certain button image in the operation image SD, the remote commander Is supplied from the control unit, a command code corresponding to the button image is output from the control unit to a predetermined device.

For example, as shown in FIG. 19A, the pointer P is moved to the position indicated by the broken line in the operation image SD, that is, the position of the button image of the channel down, and the enter operation is performed in this state. On the other hand, a command code for channel down is output from the control unit. Then, the TV tuner receives the command code, and switches the channel accordingly.

When the enter operation is performed in the state shown in FIG. 19B, a command code indicating the next fast-forward reproduction is output from the control unit to the laser disk player. Then, the laser disk player receives the command code and executes a fast-forward playback operation corresponding to the command code.

In this system, for example, the operation input means by the remote commander only needs to be able to perform the operation for moving the pointer P and the enter operation, and the simplicity of the operation is greatly improved.

[0009]

However, when the operation image SD is displayed on the monitor screen and is used for the operation as described above, the operation image SD is supplied from the laser disk player, VTR, TV tuner, or the like to the monitor screen. The displayed video is hidden behind the background of the operation image SD, and the original video cannot be seen at that portion.

At this time, if the area to be displayed on the screen as the operation image SD is reduced, the video portion hidden behind the operation image SD can be reduced, but the pointer P is moved to a required button image of the operation image SD. For this reason, it is easier to operate the button image if the button image is enlarged to a certain extent. Therefore, considering the operability, the operation image SD must be enlarged. As a result, for example, as shown in FIGS. 19A and 19B, the operation image SD occupies a large area on the screen, and the original image is almost invisible.

In many cases, the user wants to view the entire image while the operation image SD is being displayed and performing the operation. Further, for example, the user is caused to perform fast-forward reproduction by a laser disk player to advance the image. If you want to search for a desired scene while watching the video,
In the state shown in (b), almost no image can be confirmed.
It will not be possible to perform a skillful operation.
The same applies to a case where a user wants to search for a desired program while switching channels of the TV tuner. That is, there is a problem in that the operation image SD hides the original video and causes inconvenience.

In addition, the operation of selecting a button image on the screen by a pointer does not actually press the button mechanically, and thus there is a problem that it is difficult for the user to intuitively understand the operation.

[0013]

SUMMARY OF THE INVENTION The present invention has been made in consideration of the above-mentioned problems, and enables an original image to be confirmed even when an operation image is displayed over a wide area on a screen. It is an object of the present invention to make the operation using a user easy to understand.

For this reason, operation input means (such as a remote commander or a touch panel operation unit) capable of transmitting or outputting at least position displacement information or enter information according to an operation in a wired or wireless manner as input information, and storing various command codes. Display means for displaying an operation image corresponding to all or a part of various command codes stored in the storage means and a position designation image (pointer or the like) based on input information transmitted from the operation input means. A command generating means for reading out and outputting a command code corresponding to the operation image specified by the position specifying image from the storage means based on the input information transmitted from the operation input means; The command code output from the means is transmitted to the operated device or Transmission means for, you build control system comprises a.

[0015] As the display control means, a three-dimensional expression is not provided.
The operation image as a button frame image
Display three-dimensional operation images on the monitor screen.
When the enter information is transmitted from the operation input means,
Is the three-dimensional image of the button frame image
Button pressed by changing the target expression
If you can represent are those images that both a background of the operation image is to be viewed.

In addition, as the three-dimensional expression of the button frame image, the display control means realizes the required portion of the button frame image by shading, and inverts the non-shadow expressing portion of the button frame image to shading expression. In addition, the state where the button is pressed is expressed by inverting the shade expression portion to the non-shade expression.

[0017]

By using a button frame image as an operation image, that is, by superimposing only the frame line portion (and the description of the button content) on the video, the background other than the description of the frame and the button content is displayed on the monitor as the background. You can see the video. In other words, a state in which the transparent button is displayed is eliminated, and the background image is not hidden by the operation image.

[0018] Then, by performing the three-dimensional representation, etc. to ensure that shade expression is made to the required position the button frame image, the button frame image visually, a display such as that emerged from the video background As described above, the display state is such that the image can be seen through the background of the button frame image , and it is possible to prevent the button frame image from being difficult to see.

[0019] Moreover, in accordance with the enter operation, for example, more and this performing shading position change is allowed button frame display actually mechanically button though no line image representation as pressed, user interaction Sometimes the operation can be easily understood.

[0020]

Embodiments of the present invention will be described below. 1 and 2 show the configuration of a remote control system according to an embodiment. FIG. 1 is an explanatory diagram of an example of an AV system employing the remote control system according to the embodiment.
FIG. 2 is a block diagram as a remote control system.

In FIG. 1, 10 is an AV selector amplifier, 61 is a VTR, 62 is a CD player, 63 is a TV tuner, 64 is an LDP (laser disk player), 7
0 indicates a monitor device, and 71 indicates a speaker.

The VTR 61, the CD player 62, the TV tuner 63, and the LDP 64 have their audio / video signal outputs connected to the AV selector amplifier 10, and the audio / video signals selected by the AV selector amplifier 10 are transmitted from the monitor 70 and the speaker 71. Connected to output. In addition, the VTR 61, the CD player 62, the TV tuner 63, and the LDP 64 are respectively provided with infrared receiving units 61a,
62a, 63a, and 64a are provided, and can be remotely controlled by an infrared command signal output from a dedicated remote commander. However, in this embodiment, the operation for each device can be executed by one remote commander R.

The remote control system according to the present embodiment comprises the remote commander R and a control unit (described in FIG. 2) built in the AV selector amplifier 10. The remote commander R is, for example, x , Y-coordinate, and only information that can output position displacement information and enter information, such as one provided with only a shuttle ball S as an operation unit as shown in FIG. 1, an angular velocity sensor, and an acceleration sensor Direction keys such as four-way or eight-way, which can output position displacement information by means of a mouse or the like, which can output trackball rotation information like a mouse on a personal computer (not shown), can output operation direction information with a joystick, etc. What is necessary is just to be what provided with etc. That is, it is not necessary to provide many operation keys. The signal transmission method may be any of infrared, radio wave, and wire transmission.

For example, in the case of the remote commander R using the shuttle ball S, when the user rotates the shuttle ball S, the displacement information in the x and y directions is output, for example, as an infrared modulation signal, and when the shuttle ball S is pressed. Enter information is output.

In this embodiment, a remote commander R using an angular velocity sensor is used, and the remote commander R will be described with reference to FIGS.

FIG. 4 shows an angular velocity sensor using the vibrating gyroscope 2. The vibrating gyroscope has a characteristic that when a rotational angular velocity is applied to a vibrating object, a Coriolis force is generated in a direction perpendicular to the vibration. The Coriolis force F is expressed as follows. F = 2mvω (m: mass, v: velocity, ω: angular velocity) Therefore, the angular velocity ω is proportional to the Coriolis force F, and the rotational angular velocity can be detected by detecting the Coriolis force F.

A driving piezoelectric ceramic 2a and a detecting piezoelectric ceramic 2b are attached to the vibrating gyroscope 2, and an alternating signal which is an oscillation output of the oscillator 1 is applied to the driving piezoelectric ceramic 2a. In FIG. 4, when the vibration gyro 2 is rotated in the Ω ₀ direction, the detecting piezoelectric ceramic 2b
Is applied, and a voltage corresponding to the Coriolis force F is generated. The minute voltage obtained from the detection piezoelectric ceramic 2b is amplified by the amplifier 3 and supplied to the A / D converter 4, where it is converted into digital data (voltage value E).

The angular velocity ω applied to the vibrating gyroscope 2 and the output voltage E are in a proportional relationship as shown in FIG. 5, and therefore, for example, by comparing the voltage value E with the voltage values Va, Vb, Vc and Vd, It is possible to detect the operation of the device equipped with the vibration gyro 2 (for example, the operation of shaking the remote commander left and right).

For example, in the remote commander R,
Vibratory gyroscope 2 (2X, 2Y), as in FIG. 6 when placing, as an output of the vibration gyro 2X, the voltage E raised by the angular velocity omega _X when swung remote commander R to the left, shook rightward Voltage E by the angular velocity ω _X
Of the remote commander R can be detected. That is, if the voltage E output from the vibrating gyroscope 2X is Vc <E <Vd, it can be detected that the remote commander R has been swung to the left, and if Va <E <Vb, it has been detected that the remote commander R has been swung to the right. it can.

The output of the vibrating gyroscope 2Y is an angular velocity ω _Y when the remote commander R is swung upward.
Causes the voltage E to rise, and the angular velocity ω when swinging downward
_Y causes the voltage E to drop, whereby the vertical operation of the remote commander R can be detected. That is, the voltage E output from the vibrating gyroscope 2Y is Vc <
If E <Vd, it can be detected that the input device 1 has been swung upward, and if Va <E <Vb, it can be detected that it has been swung downward.

When the voltage value E satisfies Vb ≦ E ≦ Vc, the input device 1 is set as a dead zone so that when the user touches or carries around the input device 1 for a short time, the motion is not detected. is there.

FIG. 7 shows a configuration of a remote commander R using such angular velocity sensors (vibrating gyroscopes) 2X and 2Y. The output voltage from the angular velocity sensor 2X is supplied to the amplifying unit 3X, amplified, and set to an optimal level as an input to the A / D converter 4X. The voltage amplified by the amplifier 3X is output as a voltage value EX digitized by the A / D converter 4X. Further, the output voltage from the angular velocity sensor 2Y is supplied to the amplifier 3Y, amplified, and
The optimum level is set as the input to the D converter 4Y. The voltage amplified by the amplifier 3Y is output as a voltage value EY digitized by the A / D converter 4Y.

5 is a CPU 5a, ROM 5b, RAM 5c
Is shown, and a command signal to be transmitted is stored in the ROM 5b or the RAM 5c. Reference numeral 6 denotes a clock oscillator. The control unit 5 receives the voltage value E from the A / D converter 4X.
X and a voltage value EY from the A / D converter 4Y. The voltage values EX and EY are values corresponding to the motion of the remote commander R swung in the X and Y directions.
It becomes the moving motion information in the Y direction.

Reference numeral 7 denotes an enter operation key.
Is provided on the remote commander R as shown in
When the user presses the enter operation key 7, a command code serving as enter information (determination information) is output from the remote commander 1.

The control unit 5 reads an X-direction command (right movement command or left movement command) from the ROM 5b or RAM 5c according to the input voltage value EX, and reads a Y-direction command from the ROM 5b or RAM 5c according to the voltage value EY. (Upward movement command or downward movement command) is read out and supplied to the transmission unit 8 as a command code.

That is, the control unit 5 performs the processing of FIG. 8 to generate a command signal. In response to the input of the voltage value EX, a command signal (rightward movement command or leftward movement command) corresponding to the value is output (F202), and in response to the input of the voltage value EY, a command signal (upward movement) corresponding to the value is output. Command or downward movement command) (F203). When the enter key 7 is pressed, the enter command is read from the ROM 5b or the RAM 5c and output (F201 → F204).

The command code generated from the control unit 5 in this way is subjected to a predetermined modulation process in the transmission unit 8 and output to a predetermined device as a radio wave or an infrared signal. Note that the transmission unit 8 may be of a type that transmits a command signal to a predetermined device by wire. Also,
An x, y displacement information may be similarly generated by using an acceleration sensor, a tilt sensor, a geomagnetic sensor, or the like instead of the angular velocity sensor.

From such a remote commander 1,
Enter command, X direction movement command (up direction /
Although only three types of command codes of the down direction) and the Y direction movement command (up direction / down direction) are output, in the case of this embodiment, the AV selector amplifier 10 in the system of FIG. By doing so, various types of operations can be performed.

In FIG. 2, reference numeral 11 denotes an audio input selector unit, and VTRs 61 and C connected as external devices.
An input audio signal is alternatively selected from audio signals supplied from the D player 62, the TV tuner 63, and the LDP 64. The audio signal selected by the audio input selector unit 11 is supplied to the amplifier 13 via the volume control unit 12, amplified, supplied to the connected speaker 71, and output as audio.

Reference numeral 14 denotes a video input selector.
An input video signal is selected from video signals supplied from a VTR 61, a CD player 62, and a TV tuner 63 connected as external devices. The video signal selected by the video input selector unit 14 is supplied to a monitor device 70 connected as a display device via the video switching unit 15 and output as a video.

As described above, in addition to the function part as the AV selector amplifier, the control unit 2 corresponding to the command code as the position displacement information (x, y displacement information and enter information) transmitted from the remote commander R.
0 is provided.

Reference numeral 21 denotes a radio wave receiving unit that receives and demodulates a command code transmitted from the remote commander 1 by radio waves, and 22 denotes an infrared receiving unit that receives and demodulates a command code transmitted by infrared rays. Of course, either of them may be provided only in accordance with the transmission method employed in the remote commander R. It is unnecessary in the case of wired transmission. Hereinafter, description will be made on the assumption that the remote commander R in the embodiment outputs a command code by a radio wave method.

Reference numeral 23 denotes a CPU 23a, ROM 23b, RA
M23c is a control unit formed by a microcomputer having a remote commander R supplied from the infrared receiving unit 22 as described later.
In addition to performing control as various remote control systems in accordance with the operation information of, it also functions as a control unit of an AV selector amplifier. That is, the audio input selector unit 11,
The switching control of the video input selector unit 14, the volume control of the volume control unit 11, the switching control of the video switching unit 15, and the like are executed according to the user's operation input, operation mode, and the like.

Reference numeral 24 denotes a panel operation unit provided with various operation keys. Operation information from the panel operation unit 24 is supplied to the control unit 23. The panel operation unit 24 includes a control unit 23
A function switching key, a volume up / down key, and the like for executing switching control of the audio input selector unit 11 and the video input selector unit 14 are provided. Also, similar to the operation by the remote commander R,
Operation keys and enter keys for movement information in the X and Y directions may be provided.

25 is a graphic controller,
A predetermined character video signal is generated in response to an instruction from the control unit 23, and is superimposed on the video signal selected by the video input selector unit 14 and output by the high-speed switching operation of the video switching unit 15.
To supply. As shown in FIG. 1, the display contents of the character image include an operation image SD indicating operation contents in a plurality of button frame displays according to various devices, and an operation image SD displayed as a position designation image. A display of a finger image indicating the specific button frame image, an arrow, and the like (hereinafter, referred to as a pointer P) is prepared. The operation image SD including one or a plurality of button frame images is set, for example, corresponding to each device. For example, as the operation image SD for the VTR 61, button frame images such as reproduction, recording, stop, fast forward, and rewind are set.

The ROM 23b or RA in the control unit 23
The M23c stores, in addition to the control data for the functional part as the AV selector amplifier, various command codes for electronic devices such as the VTR 61 connected to the AV selector amplifier and external electronic devices that are completely unrelated. When one of these command codes is specified on the screen by a user's operation of the remote commander R described later, the command code is read and supplied to the infrared transmission unit 26. Alternatively, the read command code is supplied to the terminal 27 and supplied to a predetermined external device or an internal circuit system by wire. When a system bus line is established between the devices, command transmission may be performed by a bus.

The infrared transmitter 26 performs a predetermined modulation process on the supplied command code, and transmits the command code to the outside of the device as an infrared signal. The infrared transmitting unit 26 is provided as a non-directional infrared output unit, for example, as shown in FIG. 1, and therefore, the infrared signal output from the infrared transmitting unit 26 is used for various types of signals arranged around the AV selector amplifier. It can be received by an infrared receiver in an electronic device (such as the VTR 61). Note that a command code transmission unit using radio waves may be provided instead of or in combination with the infrared transmission unit.

The switching control of the video switching unit 15 is executed in response to a switching control signal Y _S output by the graphic controller 25 based on a signal from the control unit 23. For example, when the switching control signal Y _S is at the H level is connected to the terminal T _g, is output character image from the graphic controller 25, also, is when the switching control signal Y _S is the L-level terminal T _t Connected, the video from the video input switching unit 14 is output.

Therefore, when an image from a VTR or the like is being output, CRT scanning is performed by the graphic controller 25.
Character image (operation image SD, pointer P)
The switching control signal Y _S is set to the H level when it comes to the area to be output, and the switching control signal Y _S is set to the L level when scanning other areas. 15, the operation image S
A superimposed display of D and pointer P is made.

The operation of the thus configured remote control system will be described below with reference to FIG. 3 and FIGS. FIG. 9 is a flowchart showing a process executed by the control unit 23 based on the position designation information (x, y displacement information, enter) transmitted from the remote commander 1.

As described above, the ROM 23b or the RAM 2
Command codes for performing various operations on various devices are stored in 3c, and operation images are set corresponding to these. And, for example, in this embodiment,
Supports operation images corresponding to various command codes such as playback, stop, and recording for the VTR 61, operation images corresponding to various command codes such as playback and stop for the CD player 62, and command codes such as channel switching for the TV tuner 63. , An operation image corresponding to various command codes such as reproduction and stop for the LDP 64, and an operation image corresponding to command codes such as input switching and volume for the AV selector amplifier are switched and displayed. Shall be.

In the operation of the embodiment described below, the current AV
The operation related to the device selected and input by the selector amplifier 10 can be easily executed, and the operation image SD related to the currently selected device is displayed as the operation image SD. For example, if a VTR is selected in the audio input selector section 11 and the video input selector section 14, an operation image SD relating to VTR operation is displayed first. Then, at this time, the pointer P is moved on the screen by the x, y displacement information from the remote commander R, and at a position where a certain button frame image (for example, a button frame image for VTR playback) is shown, the pointer P is moved from the remote commander R. When the enter command is supplied, a command code (“VTR playback”) corresponding to the entered operation image is read from the ROM 23b or the RAM 23c, and output from the infrared transmitting unit 26.

Further, during such an operation, the display of the operation image SD does not obscure the original image supplied from the VTR 61 or the like,
The operability is further improved.

The operation when the operation information is input by the remote commander R will be specifically described below with reference to the flowchart of FIG.

When the power of the AV selector amplifier 10 is turned on, the TV tuner 63
It is assumed that is input selected. The control unit 23 first switches the switching control signal Y _S = L via the graphic controller 25.
(F101). Then, the data of the operation image is transferred to the graphic controller 2 according to the current input function.
It is set to 5 (F102). At this time, since the input function is the TV tuner 63, the TV tuner 63
The operation image data is set. However, since the switching control signal Y _S = L at this time, the display of the operation image SD is not performed, and the video signal from the TV tuner 63 selected by the input function is supplied to the monitor device 70. Is displayed.

Here, the process waits until the display of the operation image SD is started (F103). For example, it is assumed that the user operates the remote commander R, and starts displaying the operation image SD at the time when some command code is transmitted and taken into the control unit 23 from the radio wave receiving unit 21.

In this case, the process proceeds to step F104 when the user operates the remote commander R, and first, the display mode of the operation image SD is determined. In this embodiment, the user can select a normal mode or a see-through mode as a display mode of the operation image SD.

In the case of the normal mode, for example, FIG.
(A) As shown in (b), the operation image S is placed in front of the original video.
D appears, and the original video is hidden in that part. On the other hand, in the case of the see-through mode, as shown in FIGS. 10 and 11, the operation image SD is displayed in a transparent state, and even if the operation image SD is displayed, the original image can be seen as the background. Is what you do.

In step F104, in accordance with the determination of the mode state, the process proceeds to step F105 or F106 to display the operation image SD. That is, the control unit 23 performs high-speed switching control of the terminals Tt and Tg of the video switching unit 15 (high-speed switching of Y _S = H / L), and combines the output of the graphic controller 25 with the video signal from the video input selector unit 14. And supplied to the monitor device 70.

Therefore, when the normal mode is set, the pointer P and the TV are set in step F106 as shown in FIG.
An operation image SD relating to the tuner 63 is displayed. The operation image SD is formed by a plurality of button images. In the case of the see-through mode, at step F105 FIG.
As shown in (a), the operation image SD relating to the pointer P and the TV tuner 63 is displayed. In this case, the operation image SD is obtained by displaying a plurality of buttons as button frame images. The background image can be seen even in the SD display area.

[0061] the display of the normal mode and the see-through mode is achieved by high-speed switching system configuration of the switching control signal Y _S. FIG. 12A is an explanatory diagram in the case where the operation image SD is formed by a button frame image in the see-through mode, and shows one button frame image in an enlarged manner. on the other hand,
FIG. 16A shows an operation image SD in the normal mode.
Is an explanatory diagram in the case where is formed with a button image, and one button image is shown in an enlarged manner.

[0062] In the case of see-through mode of FIG. 12 (a), high-speed switching of the video switch 15 by the switching control signal Y _S is performed as shown in the lower part with respect to one button frame image. That is, only the notation indicating the contents of the frame and the button (in this case, the number “1”) is used as a character image, and the Tg terminal is connected only at the scanning timing (the arrow indicates one horizontal scan). Therefore, as shown in the figure, the display is such that the background image is visible as if the button frame image is transparent.

In the case of the normal mode shown in FIG.
Fast switching of the video switch 15 by the switching control signal Y _S is performed as shown in the lower part for one button image,
The entire button is a character image, and the Tg terminal is connected during the scanning timing. Therefore, the background image of the button image cannot be seen as illustrated.

In either case of a button frame image or a button image, a character image is set so that the right and lower portions are shaded as shown in the figure, whereby the buttons are three-dimensionally displayed on the screen. Will appear to be emerging.

This embodiment is characterized in that such a display in the see-through mode is performed and a three-dimensional display is performed. Hereinafter, the description will be made with emphasis on the operation in the see-through mode.

At step F105, the display as shown in FIG. 10A is executed. At step F107, it is determined whether or not a command code has been received. If the operation image display start condition in step F103 is command reception as described above, the process directly proceeds to step F108 when the operation image SD is displayed as shown in FIG. . In the subsequent loop processing, the process proceeds to step F108 in response to the command reception.

When the command code is input and the process proceeds to step F108, the timer is reset to start counting. Incidentally, the timer count is intended to be erased when unnecessary display of the operation image SD and the pointer P, then finally some command from the remote commander R is transmitted (i.e. the switching control signal Y _S fast switching by over operation Medium), the operation image SD and the pointer P are erased when no command is transmitted for a certain period of time (F107 → F122 → F10).
1) This is a process for eliminating troublesomeness caused by the operation image SD and the pointer P being displayed on the screen unnecessarily forever.

Next, it is determined whether the content of the input command code is x, y displacement information or an enter command (F109). If the information is x, y displacement information, the pointer P is moved on the screen in accordance with the information (→ F110).

For example, the pointer P is moved from the screen shown in FIG. 10A as shown in FIG. 10B. This movement processing is performed by adding a new pointer P according to the x, y displacement information.
Is calculated, and the control unit 23 sends data to the graphic controller 25 so that the pointer P moves to the calculated position on the screen to realize the movement on the display.

For this purpose, the CPU 23a has an xy coordinate system corresponding to the screen of the monitor 70,
As a result, the position, movement, and operation image S of the pointer P
The correspondence with D is determined. That is, as shown in FIG. 3, a coordinate system of, for example, 255 dots in the x direction and 192 dots in the y direction is constructed corresponding to the display screen, and the position P _{0 of the} pointer P is grasped as the coordinate values. Then, when the x, y displacement information is input, the x, y displacement information is added to the coordinate value of the position P ₀ of the pointer P so far, and a new position of the pointer P is calculated.

For example, if the current position P ₀ of the pointer P is xy
When (x, y) = (128, 66) in coordinates, +5 is given as displacement information in the x direction from the remote commander R.
Assuming that a numerical value of +30 is sent as displacement information in the 0 and y directions, the position P ₁ of the new pointer P is (x,
y) = (178,96) calculated as, the data is sent to the graphic controller 25, the pointer P on the screen is moved to the position P _1. If x <0 when the x and y displacement information are added, x = 0, x>
When it becomes 255, it is assumed that x = 255, and y <0
When y = 0 and y> 192, y
= 192.

Since the position of the pointer P is grasped in such a coordinate system, when the user performs an enter operation from the remote commander R and an enter command is input to the control unit 23, the operation image SD Since the display position of each button frame image in is also grasped by the numerical value indicating the area on the xy coordinates in the CPU 23a, the button (operation content) selected (entered) can be determined by matching the coordinate values. It is.

If the user has performed the enter operation using the remote commander R, the processing proceeds from step F109 to F1.
Proceed to 11 to check the coordinate position of the pointer P at that time.
If, for example, the pointer P is not inside the button frame image of the operation image SD as shown in FIG. 10A, the enter operation is invalidated and steps F104, F105, F107, F
It returns to the command reception waiting loop of 122.

By moving the pointer P, FIG.
As shown in (b), the pointer P is moved to the position of the button frame image indicating "10 channels" in the operation image SD for the TV tuner 63, and the user performs an enter operation from the remote commander R here. It is assumed that an enter command has been input to the control unit 23. In this case,
The enter operation is expressed to the user by inverting the shaded expression of the button frame image (or the peripheral portion of the button image in the case of the normal mode) as the operation of pressing the “10 channel” button.

FIG. 12 shows a state where the shade expression is inverted.
(B) and FIG. 16 (b). In this way, a three-dimensional motion expression is made as if the button surface were pressed. Therefore, when the enter operation is performed in the state of FIG. 10B, the operation image SD is changed as shown in FIG. 10C.

Thereafter, the contents of the operation entered in steps F113 and F114 are determined. That is, the coordinate position of the pointer P at the time of the enter operation is compared with the coordinate position of each button frame display of the operation image SD, and “which button has been pressed” is determined.
Is determined.

For example, in the case of the "10 channel" button, the operation is not for switching the displayed operation image SD to another operation image SD, but for an external device (TV tuner 63 in this case). Therefore, the process proceeds to Step F115. Here, the command code corresponding to the entered operation (button frame display),
That is, the command code indicating “switch to channel 10” for the TV tuner 63 is stored in the ROM 23b or the RAM 2
3c, and transmitted from the infrared transmitter 26 to the TV tuner 63 (F115).

Then, when the enter operation is turned off, that is, the pressing of the enter operation key 7 of the user remote commander R is terminated, and the reception of the enter command is terminated (F11
6), the shaded representation of the button frame image is shown in FIGS.
As shown in (a), the image is returned to the original state (F117), and the expression in which the button press is ended is performed. That is, from FIG. 10C to FIG.
It returns to the state of (b).

As described above, the inverted expression of the button being pressed is maintained while the user is pressing the enter operation key 7 with the remote commander R. It is more suitable as an operation expression in conjunction with.

By the way, a menu calling operation and a page turning operation for switching to a menu screen or an operation image SD corresponding to another device are also prepared.
A menu button or the like is prepared as exemplified in the operation image SD (not shown, but a page turning button or the like may be prepared).

When the pointer P is moved and entered in these button frame images, steps F113 to F118
The other operation image SD is set in the graphic controller 25 according to the operation, and the process proceeds to step F105.
(Or F106).

For example, LDP6 as shown in FIG.
The display is switched to the operation image S for four or the like. If the enter is performed in the state shown in FIG. 11B as in the case described above, the state in which the button is pressed as shown in FIG. 11C is expressed, and the command code corresponding to the button is changed to the infrared ray. The data is sent from the transmission unit 26 to the LDP 64.

The operation image SD shown in FIG. 11 is expressed by an operation panel or the like so that the operation image SD can be seen more three-dimensionally. Similarly, with regard to the operation image SD for the TV tuner 63, the character image data may be set so as to appear in a more multi-dimensional manner as shown in FIG. 17, for example.

Although the operation image SD exemplified in FIGS. 11 and 17 is to be displayed by closing most of the screen, it is illustrated by displaying in the see-through mode. Image SD for operation
The original image can also be visually recognized as the background of. In addition, since the operation image SD is displayed in a three-dimensional manner, it is possible to prevent the operation image SD from being difficult to see due to the influence of the background image.

In order to switch the input function, the operation image SD applied to the AV selector amplifier 10 is changed.
13 is also provided, for example, by operating the menu enter.
Is called up.

Then, for example, when the pointer P is moved and the enter operation is performed from the display state of FIG.
From step F119, and various controls are performed according to the position of the pointer P at that time (F119). For example, when the pointer P is moved on the button frame image of “volume down” and the enter operation is performed, the control unit sends a volume down command to the volume control unit 12 to perform volume control. Similarly, for example, when the pointer P is moved on the button frame image of “VTR” and the enter operation is performed, the control unit sends the audio input switching unit 11 and the video input switching unit 14
A command will be sent so that the VTR is selected.

Also, in this case, the inversion of the shaded expression of the button frame display during the enter operation period (F112) and the inversion of the inversion after the end of the enter operation (F120, F121) are performed, and a display such as a button press is made. Is performed.

In this embodiment, the display mode can be switched between the normal mode and the see-through mode as described above.
Figure 1 by enter operation on the button frame image of "S MODE"
The operation image SD for mode setting as shown in FIG. 4 is called so that mode setting can be performed.

In this operation image SD, "NORMAL" or "SE
By selecting and entering the button frame image of "E THRU", the control unit 23 sets the mode of the graphic controller 25, and the display mode of the subsequent operation image SD is set.

The display color of the operation image SD can be selected by "COLOR 1" and "COLOR 2", and for example, gray display and light color display can be switched. That is, the control unit 23 sets the information about the entered color in the graphic controller 25 and sets the information as the display color of the subsequent operation image SD.

As described above, in this embodiment, the operation image S
D is in a transparent state so that the original image can be visually recognized even when the operation image SD is displayed, so that the image is not unnecessarily obstructed by the operation image SD, and an operation while watching the image is performed. There is no hindrance. Further, for this reason, the character image as the operation image SD can be set large so that the operation of moving the pointer P into the button frame image can be facilitated.

Further, by rendering the operation image SD in a three-dimensional representation, the background image and the operation image SD can be clearly separated and visually recognized, and the transparent operation button display becomes difficult to see. Nor. In addition, during the enter operation, the shaded expression of the button frame image is inverted to display as if the button was pressed, so that the user can easily understand the operation intuitively.

The present invention is not limited to the above embodiment but can be variously modified. For example, various transmission methods of the command code of the control unit 20 using the display of the operation image SD and the pointer P can be considered in addition to the processing of FIG.
In particular, various hierarchical structures and types of various operation images SD, a calling method, and the like can be considered. Further, the display of the operation image may be started in response to a predetermined operation, a power operation, or the like, or the display of the operation image may be deleted by a user operation.

The display mode may be only the see-through mode, and the image may always be seen as the background of the operation image. Further, a see-through display may be performed as the outline display for the pointer P so that the background image of the pointer P can be seen.

In the embodiment, the button frame image is shaded so as to be seen three-dimensionally. However, for example, as shown in FIG. 18, the operation image SD may be stereoscopically represented as a perspective image. . In this case, the state in which the button is pressed can be represented as shown in FIG.

Further, the control unit 20
Although it is built in the selector amplifier 10, it is also possible to build it in another device, or to constitute the control unit as a single unit.

In addition to using the control system for the AV system, such a control system is used for a computer system,
It may be used as an operation means of a home automation system.

Although the operation input means has been described using a remote commander, for example, a touch panel provided on the housing of the control unit may be used as the operation input means. Of course, other operation input means than the remote method can be adopted.

[0099]

As described above, the control system of the present invention uses a button frame image as an operation image,
On the monitor, except for the notation of the frame and button contents,
Since the image is made visible as the background, the image is not unnecessarily obstructed by the operation image, and there is no problem with the operation while watching the image. Further, the display area as the operation image can be set to be large, so that the operability is greatly improved.

Also, by expressing the button frame image three-dimensionally by shading, etc., the button frame image can be visually displayed as if it were raised from the background image. There is also an effect that images can be easily identified.

Further, in response to the enter operation, for example, by displaying a button frame in which a shadow position is changed, an image expression as if a button was actually mechanically pressed is provided to assist the user in understanding the operation. It is possible to provide intuitively understandable operations.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of a configuration of an AV system employing an embodiment of the present invention.

FIG. 2 is a block diagram of a configuration of a control unit of the control system according to the embodiment.

FIG. 3 is an explanatory diagram of a pointer coordinate management mode according to the embodiment;

FIG. 4 is an explanatory diagram of an angular velocity sensor of the remote commander in the embodiment.

FIG. 5 is an explanatory diagram of an angular velocity detection operation of the remote commander in the embodiment.

FIG. 6 is an explanatory diagram of an arrangement state of an angular velocity sensor of the remote commander in the embodiment.

FIG. 7 is a block diagram of a remote commander in the embodiment.

FIG. 8 is a flowchart of a command transmission operation process of the remote commander in the embodiment.

FIG. 9 is a flowchart of an operation process of the control system according to the embodiment.

FIG. 10 is an explanatory diagram of an operation image display state in a see-through mode according to the embodiment.

FIG. 11 is an explanatory diagram of an operation image display state in a see-through mode according to the embodiment.

FIG. 12 is an explanatory diagram of a display operation in a see-through mode according to the embodiment.

FIG. 13 is an explanatory diagram of an operation image display state in a see-through mode according to the embodiment.

FIG. 14 is an explanatory diagram of an operation image display state in a see-through mode according to the embodiment.

FIG. 15 is an explanatory diagram of an operation image display state in a normal mode according to the embodiment.

FIG. 16 is an explanatory diagram of a display operation in a normal mode according to the embodiment.

FIG. 17 is an explanatory diagram of an operation image display state in a see-through mode according to the embodiment.

FIG. 18 is an explanatory diagram of an operation image display state according to another embodiment.

FIG. 19 is an explanatory diagram of a screen display example for operation in the prior art.

[Explanation of symbols]

 Reference Signs List 10 AV selector amplifier 15 Video switch 20 Control unit 21 Radio wave reception unit 23 Control unit 23a CPU 23b ROM 23c RAM 24 Operation unit 25 Graphic controller 26 Infrared transmission unit 28 Mode operation unit 61 VTR 62 CD player 63 TV tuner 64 LDP 70 Monitor device R Remote commander SD Operation image P Pointer

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N 5/00 H04Q 9/00

Claims (1)

(57) [Claims] 1. Operation input means capable of transmitting or outputting at least position displacement information or enter information in a wired or wireless manner in accordance with an operation as input information; storage means for storing various command codes; Based on the input information sent,
Display control means for outputting an operation image corresponding to all or a part of the various command codes stored in the storage means and a position designation image so as to be superimposed and displayed on a video on a monitor screen; Based on the input information transmitted from the operation input means,
A command generation unit that reads out and outputs a command code corresponding to the operation image specified by the position specification image from the storage unit, and outputs the command code output from the command generation unit in a wired or wireless manner to the operated device or the A transmission unit for transmitting to the operation unit; and the display control unit expresses a required portion of the button frame image as the operation image in a shade expression.
By doing so, a three-dimensional representation of the button frame image is performed, and when enter information is transmitted from the operation input means,
Is the non-shadow of the button frame image
Invert the shadow expression part to the shadow expression and change the shadow expression part
Button is pressed by inverting to non-shading expression
Is a three-dimensional representation, so that a three-dimensional operation image is displayed on a monitor screen, and a video as a background of the operation image can be visually recognized.