JP2003303092A - Application control display system on computer screen display, device and its method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To control an application on a screen from a computer device for a display device only by its input device, and reduce a data transfer volume at that time. <P>SOLUTION: An application control display system has a display device that receives and displays a screen from a computer device as a projected image signal, displays a cursor on the screen based on an execution command from an input device, transmits other execution commands and a cursor position information to the computer device, and receives and displays a screen which is repainted based on this information from a computer device as a projected image signal; a computer device which transmits a projected image signal in the screen to the display device repaint the screen based on other execution commands received from the display device and the cursor position information and transmits it to the display device; and an input device which inputs a variety of execution commands into the display device. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention controls an application on a computer screen transmitted from a computer device only by an input device of a display device, and at the same time, controls an application in a computer screen display for reducing the data transfer amount at that time. The present invention relates to a display system, an application control display device, and an application control display method.

[0002]

2. Description of the Related Art In recent years, a computer screen displayed by a computer device is displayed on a display device, and a presentation using the computer screen is widely performed. In this case, in order to easily control the display device and the application software of the computer device, it is desirable to control both the display device and the application software of the computer device by a remote controller of the display device.

However, when the output signals from the remote controller are divided into those for controlling the display device and those for controlling the computer device, respective cursors are displayed.
There was a problem that it was difficult to use. As means for performing display control of the display screen in such a presentation, for example, Japanese Patent Laid-Open No. 6-3484
No. 12, JP-A No. 9-62444, and No. 11
Examples thereof include those disclosed in JP-A-143629 and JP-A-2001-125738.

According to these methods, it is possible to input the position information and the command of the pointer by the pointing device with a video camera, analyze this by the computer device, and perform the corresponding processing. However, the pointing information or the like by the pointing device is received and analyzed by a video camera or the like, and a dedicated device is required. Therefore, it has been desired to control the content displayed on the display device with a simpler configuration.

It is also possible to use a means such as a so-called remote desktop in which a desktop screen of a computer device via a communication line is displayed on a separate computer device and controlled by this separate computer device. Is. According to such means,
In addition to being able to display the computer screen of a remote computer device on a display device connected to another computer device, to use many functions that can be controlled from the original computer screen as they are. Was possible.

[0006]

However, when the above-mentioned means is used, it is difficult to obtain a sufficient processing speed because the amount of data transmitted and received via the communication line is large, and it is suitable for presentations and the like. I couldn't say that. Also, when used for presentations, etc., the necessary functions are limited, so it is desirable to be able to control the applications on the computer screen with a simple configuration that can exert sufficient functions within that range. It was rare.

When the above means is used, it is necessary to prepare a computer device on the side that receives the computer screen, or to make the display device itself have the function of the computer device. It wasn't something.

The present invention has been made in view of the above circumstances, and controls the application on the computer screen transmitted from the computer device only by the input device of the display device and reduces the amount of data transfer at that time. It is an object of the present invention to provide an application control display system, a device, and a method thereof for displaying a computer screen.

[0009]

In order to achieve the above object, an application control display system according to claim 1 of the present invention controls a cursor and an application based on an execution command input from an input device to the display device. An application-controlled display system for computer screen display, which receives and displays a video signal of a computer screen from a computer device, displays a cursor on the computer screen based on an execution command input from an input device, and , Other execution commands entered from the input device,
And a display device for transmitting the cursor position information to the computer device and receiving and displaying a video signal of the computer screen redrawn based on another execution command and the cursor position information from the computer device, and a display device for displaying the video signal of the computer screen. A computer device that transmits to the device, redraws the computer screen based on another execution command and cursor position information received from the display device, and transmits the video signal of the redrawn computer screen to the display device,
The display device has an input device for inputting various execution commands.

With such a configuration of the application control display system, the application on the computer screen transmitted from the computer device can be controlled only by the input device of the display device. That is, the execution command input from the input device is transmitted to the computer device, and based on this, the redrawn computer screen is displayed on the display device, thereby displaying the application after control on the display device. You can

For example, it is assumed that the determination button of the cursor is pressed on the end button of the application on the computer screen displayed on the display device from the remote control device. At this time, an execution command indicating that the decision button has been pressed is transmitted to the computer device and processed, and the redrawn computer screen can be displayed on the display device.

At this time, since only one cursor can be displayed and controlled without displaying two cursors for the computer device and the display device, the operability can be improved. Further, the redrawing of the computer screen by the computer device is performed only for a predetermined execution command, and the simple movement of the cursor is performed only on the display device. Can be greatly reduced. As a result, the processing load on these devices can be reduced, and a high processing speed can be obtained, which makes it suitable for presentations.

Examples of the execution command input from the input device include a cursor display / non-display command, a cursor up / down / left / right direction movement command, a decision command, a cancel command, a movement command, and the like. Further, the computer screen means information of the entire screen displayed on the display device by the computer. Drawing means a process of creating a video signal for displaying a computer screen. Redisplay means adding the changed information and updating the display content being displayed on the display device.

An application control display system according to claim 2 of the present invention is an application control display system in computer screen display for controlling a cursor and an application based on an execution command input from an input device to the display device. Image data of a computer screen is received and displayed from the computer device, a cursor is displayed on the computer screen based on an execution command input from the input device, and another execution command input from the input device, and A display device that transmits cursor position information to a computer device and receives and displays image data of a computer screen redrawn based on another execution command and cursor position information from the computer device, and a display device. The video signal of the computer screen is converted into image data, this image data is transmitted to the display device, and the computer screen is redrawn based on other execution commands and cursor position information received from the display device, and the redrawn computer is displayed. It is configured to have a computer device for converting a video signal of a screen into image data and transmitting the image data to a display device, and an input device for inputting various execution commands to the display device.

With such a configuration of the application control display system, the computer screen from the computer device can be converted into image data instead of the image signal and transmitted to the display device. Therefore, it becomes possible to wirelessly transmit the computer screen data, and it is possible to retain high expandability in processing the computer screen in the display device.

In the application control display system according to claim 3 of the present invention, the computer device acquires frame information based on the execution command and cursor position information transmitted from the display device, and the frame information is displayed on the display device. The display device re-displays the computer screen based on the transmitted frame information, and re-displays the computer screen information based on the execution command input from the input device, the cursor position information and the frame information,
The execution command, the cursor position information and the frame information are transmitted to the computer device, the computer device redraws the computer screen based on the transmitted execution command, the cursor position information and the frame information, and the computer screen is displayed on the display device. The display device is configured to transmit and display the transmitted computer screen.

With such a configuration of the application control display system, it is possible to transmit the frame information of the application from the computer device to the display device and display the virtual frame on the display device. That is, the data transmitted from the computer device to the display device may be not only the computer screen data but also frame information. Then, it becomes possible to move the application on the display device based on the frame information.

When moving the application window on the display device, the computer device side does not need to perform any processing. Then, when the movement of the application is completed and a decision command is input from the input device, this is transmitted from the display device to the computer device, redrawing is performed, and the computer image after drawing is transmitted to the display device. Is displayed.

As described above, in the present invention, the computer device (server side) transmits the control information (frame information) for movement to the display device at the start of movement,
Nothing needs to be done during the move, just redraw at the end and send to the display device.

Further, the display device (client side) receives the control information for movement from the computer device at the time of starting the movement, performs the movement processing of the virtual frame using its own simple frame display function during movement, and ends the movement. Sometimes, the movement end control information is transmitted to the computer device, and the computer screen is received from the computer device.

Therefore, as compared with the conventional technique, both the processing of the server and the processing of the client are reduced. In the present invention, an application frame that can be operated only by the display device is called a virtual frame.

In the application control display system according to claim 4 of the present invention, the display device is a projector device, and the input device is a remote control device, a mouse, a pointing device or a control key of the display device main body.

If the application control display system is configured as described above, the computer screen of the computer device can be displayed on the projector and the remote control can be used for the presentation or the like.
By simply transmitting the input information to the projector, it becomes possible to control the application on the computer screen.

An application control display device according to a fifth aspect of the present invention displays a computer screen received from a computer device, transmits an execution command input from an input device to the computer device, and displays the redrawn computer screen. An application control display device in a computer screen display for receiving and displaying, which receives a video signal of a computer screen transmitted from a computer device, outputs the video signal to a signal processing unit, and from a control unit. A transmission / reception unit that transmits the input execution command and cursor position information to the computer device, and a signal processing unit that displays a computer screen on the display unit based on the video signal input from the transmission / reception unit or the cursor position information input from the control unit. And input from the input device By outputting the cursor position information to the signal processing unit according to the execution command, the computer screen is re-displayed on the display unit based on the cursor position information, and the execution command and the cursor position information input from the input device are transmitted to the transmission / reception unit. It is configured to have a control unit for outputting.

With such a configuration of the application control display device, by transmitting the execution command input from the input device to the computer device,
The redrawn computer screen can be displayed on a display device. Further, at this time, the cursor is moved only by the display device, and the computer device can execute the above processing in response to the transmission of the determination command after the cursor movement. Therefore, it is possible to reduce the amount of data transmission / reception between the computer device and the display device and to obtain a high processing speed. Further, it can be realized with a simple configuration, and the cost can be reduced.

An application control display device according to a sixth aspect of the present invention displays a computer screen received from a computer device, transmits an execution command input from an input device to the computer device, and displays the redrawn computer screen. An application control display device in a computer screen display for receiving and displaying, receiving image data of a computer screen transmitted from a computer device, outputting the image data to a control unit, and inputting from the control unit. A transmission / reception unit for transmitting the executed command and cursor position information to the computer device, and the image data input from the transmission / reception unit is converted into a video signal and output to the signal processing unit, thereby displaying a computer screen based on the video signal Displayed, and By outputting the cursor position information to the signal processing unit according to the execution command input from the device, the computer screen is redisplayed on the display unit based on the cursor position information, and the execution command and the cursor position information input from the input device are displayed. The configuration includes a control unit that outputs to the transmission / reception unit and a signal processing unit that displays a computer screen on the display unit based on image data or cursor position information input from the control unit.

If the application control display system is configured as described above, the computer screen from the computer device can be converted into image data instead of being a video signal and transmitted to the display device. It becomes possible to have high expandability.

In the application control display device according to claim 7 of the present invention, the transmission / reception unit receives the frame information acquired by the computer device based on the execution command and the cursor position information, and outputs the frame information to the control unit. Then, the control unit outputs the frame information to the signal processing unit, redisplays the computer screen on the display unit based on the frame information, and displays the cursor position information and the frame information according to the execution command input from the input device. Output to the signal processing unit, redisplay the computer screen on the display unit based on the cursor position information and frame information, and output the execution command, cursor position information and frame information to the transmission / reception unit, and the transmission / reception unit executes the execution command and cursor. Send position information and frame information to computer Then, a computer screen redrawn by the computer device based on the execution command, the cursor position information, and the frame information is received from the computer device, and when the received computer screen is image data, the computer screen is changed to the control unit. Through
The signal is converted into a video signal and output to the signal processing unit. If the signal is a video signal, the signal is directly output to the signal processing unit.
The computer screen is displayed on the display unit.

With such a configuration of the application control display device, the virtual frame can be displayed by transmitting the execution command to the computer device and receiving the frame information of the application from the computer device. Then, this virtual frame can be operated only by the display device.

That is, the application can be moved on the display device by using the conventional simple frame display function of the display device. Also, after the movement is completed, it is possible to input a decision command from the input device, send it to the computer device, redraw the computer screen, and display it on the display device.

An application control display method according to claim 8 of the present invention is an application control display method in a computer screen display for controlling a cursor and an application based on an execution command input from an input device to a display device. The computer device transmits the video signal of the computer screen to the display device, the display device displays the computer screen by the transmitted video signal, and the cursor is displayed on the computer screen based on the execution command input from the input device. Other execution command input from the input device and the cursor position information are transmitted to the computer device, and the computer device displays the computer based on the other execution command and the cursor position information. With redrawing surface, and transmits the video signal of redrawing a computer screen on the display device, a display device, there is a method of displaying a redrawn computer screen.

If the application control display method is such a method, the application on the computer screen transmitted from the computer device can be controlled only by the input device of the display device.

An application control display method according to claim 9 of the present invention is an application control display method in a computer screen display for controlling a cursor and an application based on an execution command input from an input device to the display device. The computer device converts the video signal of the computer screen into image data and transmits the image data to the display device, the display device displays the computer screen based on the transmitted image data, and based on the execution command input from the input device. , The cursor is displayed on the computer screen, and another execution command input from the input device and cursor position information are transmitted to the computer device, and the computer device displays another execution command and cursor position information. With redraw the computer screen based on the video signal of the redrawn computer screen by converting the image data transmitted to the display device, a display device, there is a method of displaying a redrawn computer screen.

By using such a method as the application control display method, the computer screen from the computer device can be converted into image data instead of the image signal and transmitted to the display device.

In the application control display method according to claim 10 of the present invention, the computer device creates frame information based on the execution command and the cursor position information transmitted from the display device, and the frame information is displayed on the display device. The display device re-displays the computer screen based on the transmitted frame information, and re-displays the computer screen information based on the execution command input from the input device, the cursor position information and the frame information, The execution command, the cursor position information and the frame information are transmitted to the computer device, and the computer device redraws the computer screen based on the transmitted execution command, the cursor position information and the frame information, and the computer screen is displayed. Transmitted to the spray device, a display device, there is a method of displaying a computer screen that has been transmitted.

If the application control display method is such a method, the frame information of the application can be transmitted from the computer device to the display device, and the virtual frame can be displayed on the display device. That is, by operating this virtual frame on the display device, it becomes possible to move the application. Then, after the movement is completed, by pressing the decision command, the information is transmitted to the computer device, redrawing is executed in the computer device, and this can be displayed on the display device.

[0037]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below.
A description will be given with reference to the drawings. First Embodiment First, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing a schematic configuration of an application control display system according to a first embodiment of the present invention, and FIG. 2 is a block diagram showing a configuration of an application control display system according to a first embodiment of the present invention. is there.

FIG. 3 is a diagram showing an example of a computer screen displayed in the application control display system according to the first embodiment of the present invention, and FIG.
It is a conceptual diagram of the cursor position information set in the same system. Further, FIG. 5 is a diagram showing an example of a computer screen in which a cursor is drawn in the system,
FIG. 6 is a diagram showing an example of a computer screen on which the command is similarly executed.

As shown in FIG. 1, the application control display system for computer screen display has a display device 10, a computer device 20 and an input device 30. The display device 10 is
The computer screen information transmitted from the computer device 20 is displayed, and can be a monitor device, a liquid crystal monitor device, a projector device, or the like.

The display device 10 includes a transmitting / receiving unit 1
1, a control unit 12, a storage unit 13, a signal processing unit 14, and a display unit 15. The transmission / reception unit 11 transmits / receives various data to / from the computer device 20. When a predetermined execution command is input from the input device 30, the control unit 12 acquires cursor position information and the like from the storage unit 13 and outputs these to the signal processing unit 14. Further, the control unit 12 may acquire cursor position information and the like from the storage unit 13 depending on the type of execution command, and may transmit / receive with the execution command the transmission / reception unit 11
Output to.

The storage unit 13 is a storage device for storing cursor position information, frame information and the like. This storage unit 13
When the cursor position information is acquired from the control unit 12 and the cursor position information is changed,
Receive updates of the changes. The signal processing unit 14 causes the display unit 15 to display a computer screen based on the input information from the computer device 20, or displays the cursor on the screen based on the input information from the control unit 12. The display unit 15 displays the input signal from the signal processing unit 14, and may be a CRT screen, a liquid crystal screen, an optical device, or the like.

The computer device 20 is connected to the display device 10 by wire or wirelessly, and the display device 1
It is an information processing device capable of transmitting the computer screen to 0 and displaying it. This computer device 20
Is a transmission / reception unit 21, a control information processing unit 22, and a storage unit 23.
have.

The transmission / reception unit 21 transmits / receives various data to / from the display device 10. The control information processing unit 22 performs processing on the data input from the display device 10 via the transmission / reception unit 21 according to the type of the data. At this time, necessary information can be acquired from the storage unit 23 and the computer screen can be redrawn. Then, these are output to the transmission / reception unit 21.

The input device 30 is the display device 10.
In addition, it is possible to input information by wire or wirelessly, and examples thereof include the remote control device 30a, the mouse 30b, other pointing devices, and control keys of the display body.

Next, the configuration of the present invention will be described in more detail with reference to FIG. In the figure, the display device 10 of the application control display system in the computer screen display of the present invention is a projector device 10a, and the input device 30 is a remote control device 30a.

The projector device 10a has the same configuration as that of the display device 10, and has a transmitting / receiving unit 11a, a control unit 12a, a storage unit 13a, a signal processing unit 14a, and a display unit 1.
5a. The transmission / reception unit 11a has a video signal reception unit 11a-1 and a control information transmission unit 11a-2.

The video signal receiving section 11a-1 receives the video signal from the computer device 20, and receives the video signal.
4a. The control information transmission unit 11a-2 transmits the execution command, cursor position information, etc. output from the control unit 12a to the computer device 20.

The control unit 12a includes the input information control unit 12a-
1, a cursor drawing control unit 12a-2 and a control information output unit 12a-3. Input information control unit 12a-1
Inputs the execution command output from the remote control device 30a, and depending on the type, executes the cursor drawing control unit 12a.
-2 or the control information output unit 12a-3.

For example, if the execution command is a cursor display / non-display command or movement command, this is output to the cursor drawing control unit 12a-2, and if the execution command is a decision command, this is output. Can be output to the control information output unit 12a-3.

The cursor drawing control section 12a-2 acquires necessary information from the storage section 13a according to the input execution command and outputs the acquired data to the signal processing section 14a. For example, when the execution command is a cursor display / non-display command, the cursor position information is stored in the storage unit 13a.
And outputs it to the signal processing unit 14a.

The control information output unit 12a-3 acquires necessary information from the storage unit 13a according to the execution command input from the input information control unit 12a-1, and acquires the acquired data and the execution command from the control information transmission unit. 11a-2.
For example, when the execution command is the determination command, the cursor position information is acquired from the storage unit 13a and is output to the control information transmission unit 11a-2. Storage unit 1
3a, the signal processing unit 14a, and the display unit 15a have the same functions as those in the display device 10 described above.

Transmission / reception section 2 in computer device 20
1 is a video signal transmitting unit 21-1 and a control information receiving unit 21.
-2. The video signal transmission unit 21-1 transmits the video signal input from the control information processing unit 22 to the projector device 10a.

That is, the video signal of the computer screen in the computer device 20 created in the control information processing section 22 is transmitted to the projector device 10a. This computer screen is based on the control information transmitted from the projector device 10a and is based on the control information processing unit 22.
It is updated at any time, is input to the video signal transmission unit 21-1, and is transmitted to the computer device 20.

The remote control device 30a is an input device capable of inputting a radio signal to the projector device 10a by electromagnetic waves, sound waves or the like, and the upward movement button 31.
a, leftward movement button 32a, rightward movement button 33
a, downward movement button 34a, display / non-display button 35
a and a decision button 36a.

The upward movement button 31a, the leftward movement button 32a, the rightward movement button 33a, and the downward movement button 34a transmit execution commands for moving the cursor and the like. The display / non-display button 35a is an execution command for switching display / non-display of the cursor. Further, the enter button 36a is an execution command for causing the computer device 20 to execute the corresponding process at the cursor position where the cursor is present.

For example, when the cursor is on the end icon of the application on the computer screen,
When the decision button 36a is pressed, the execution command and the like are transmitted to the computer device 20, and the control information processing unit 22 draws the computer screen after the application is terminated. Then, the redrawn computer screen transmitted to the projector device 10a via the video signal transmission unit 21-1 is displayed.

The execution command transmitted from the remote control device 30a to the display device 10 is not limited to the above, and the command necessary for controlling the application can be set appropriately. For example, when operating an application having a plurality of pages, it is possible to set left and right buttons and the like of the direction moving buttons as page moving buttons.

Next, the processing procedure of the application control display system in the computer screen display will be described with reference to FIG. First, the control information processing unit 22 of the computer device 20 transmits the video signal of the computer screen to the projector device 10a via the video signal transmitting unit 21-1.

The video signal receiving unit 11a-1 of the projector device 10a processes the transmitted video signal by the signal processing unit 1.
4a, and the signal processing unit 14a displays a computer screen on the display unit 15a based on this video signal.
FIG. 3 shows an example of the computer screen thus displayed.

In the figure, on the computer screen,
Two applications A41 and B
42 is displayed, and an end button 43 is provided at the right end of each title bar. Next, when the remote control device 30a transmits a cursor display / non-display command to the projector device 10a, the input information control unit 12a-1 of the projector device 10a receives the command and sends it to the cursor drawing control unit 12a-2. Output.

The cursor drawing control unit 12a-2 acquires cursor position information from the storage unit 13a and outputs this cursor position information to the signal processing unit 14a for setting. Figure 4
[Fig. 3] is a conceptual diagram of cursor position information set in this way. As an example, the figure shows that the position information of the cursor 44 is coordinates (400, 100),
The signal processing unit 14a is set to display the cursor 44 at the coordinates (400, 100) on the computer screen.

The signal processing unit 14a draws a cursor at a corresponding screen position on the video signal of the computer screen based on the set cursor position information, and outputs it to the display unit 15a for display. FIG. 5 shows an example of the computer screen on which the cursor 44 is displayed in this way.

Next, when the determination command is transmitted from the remote control device 30a to the projector device 10a, the input information control unit 12a-1 of the projector device 10a receives this and outputs it to the control information output unit 12a-3. . The control information output unit 12a-3 acquires the cursor position information from the storage unit 13a and transmits the determination command and the cursor position information to the computer device 20 via the control information transmission unit 11a-2.

Control information receiving section 2 of computer device 20
When the determination command and the cursor position information are received from the projector device 10 a, the 1-2 outputs this to the control information processing unit 22. The control information processing unit 22 displays the computer screen contents at the cursor position based on the input decision command and cursor position information, and the position information of the application currently displayed on the computer screen, which is stored in the storage unit 23. Analyze and calculate the processing when the execution command is applied to that position.

In FIG. 5, since the cursor is located on the end icon of the application A41, the control information processing section 22 redraws the screen in which the application A41 is erased from the computer screen and re-draws it. The signal is output to the signal transmission unit 21-1.

The video signal transmission unit 21-1 transmits the video signal of the computer screen in which the application A41 is deleted to the projector device 10a, and this computer screen is displayed on the video signal reception unit 11a- of the projector device 10a.
1. Displayed on the display unit 15a via the signal processing unit 14a. FIG. 6 shows the computer screen thus displayed. In the figure, application A
41 is terminated, the cursor 44 and application B
Only 42 is displayed.

By pressing the respective direction moving buttons of the remote control device 30a and transmitting the respective direction moving commands to the projector device 10a, the projector device 10a can be operated.
The cursor movement process can be performed on the computer screen displayed in. At this time, the execution command is input to the cursor drawing control unit 12a-2 via the input information control unit 12a-1. Then, the cursor drawing control unit 12a-2 calculates the position information after the movement and stores it in the storage unit 13a, and at the same time, the signal processing unit 1
The cursor after being set to 4a is displayed on the display unit 15a.

Second Embodiment Next, a second embodiment of the present invention will be described with reference to FIG. The same figure is a block diagram showing a configuration of an application control display system in a second exemplary embodiment of the present invention.

In the application control display system of this embodiment, the computer screen information transmitted from the computer device 20 to the projector device 10a is not converted into a video signal but is once converted into image data and then transmitted to the projector device 10a. The point is different from the first embodiment.

That is, in FIG. 7, the application control display system of the present embodiment is the video signal transmitting unit 2 of the computer device 20 in the first embodiment.
1-1 is the image data transmitting unit 21-3, and the video signal receiving unit 11a-1 of the projector device 10a is
It is the image data receiving unit 11a-3.

In addition to the configuration of the first embodiment, the control unit 12a of this embodiment has an image data control unit 12a.
-4, and the data input to the image data receiving unit 11a-3 is output to the signal processing unit 14a via the image data control unit 12a-4. Other configurations are the same as those of the respective constituent elements in the first embodiment, and the functions thereof are also the same as the functions in the first embodiment.

The image data transmission unit 21-3 transmits the image data created by the control information processing unit 22 to the projector device 10a. At this time, the control information processing unit 2
2 converts the video signal of the computer screen into image data, compresses it, and outputs it to the image data transmitting unit 21-3. This image data can include resolution information.
It should be noted that the image data transmitting unit 21-3 may be provided with the conversion function and the compression function of the video signal into the image data.

The image data receiving section 11a-3 receives the image data from the image data transmitting section 21-3 and outputs it to the image data control section 12a-4. The image data control unit 12a-4 expands (decompresses) the input image data and converts it into a video signal, which is processed by the signal processing unit 14a.
Output to. The image data developing function and the converting function may be provided to the image data receiving unit 11a-3.

As described above, according to this embodiment, the computer screen transmitted from the computer device 20 to the projector device 10a can be treated as image data instead of a video signal. Therefore, on the projector device 10a, it is possible to expect expandability in its use, and it becomes possible to wirelessly transmit computer screen data.

[Third Embodiment] Next, a third embodiment of the present invention will be described with reference to FIG. The same figure is a block diagram showing a configuration of an application control display system in the third exemplary embodiment of the present invention.

The application control display system of this embodiment differs from the second embodiment in that the input device 30 is a mouse 30b. Other configurations and functions are the same as those in the second embodiment. In the present embodiment, the execution command is input to the projector device 10a using the mouse 30b.

At this time, the input of the direction movement command in the second embodiment is input by the rotation of the rotating body of the mouse 30b. Enter button 3 in the second embodiment
6a can be performed by left-clicking the mouse 30b. The display / non-display button 35a is, for example,
The display can be switched by right-clicking or can be switched by clicking any button for a predetermined time or more.

Further, a mouse 30 is used as the input device 30.
Other than b, various pointing devices such as a pointer device and a touch pad, and control keys of the main body of the projector device 10a can be used. At this time, the pointing device can be operated in the same manner as the mouse 30b. Further, the operation using the control keys of the main body of the projector device 10a can be performed in the same manner as the remote control device 30a.

[Fourth Embodiment] Next, a fourth embodiment of the present invention will be described with reference to FIGS. Figure 9
FIG. 8 is a block diagram showing a configuration of an application control display system according to a fourth exemplary embodiment of the present invention.

FIG. 10 is a diagram showing an example of a computer screen displayed in the application control display system of the fourth embodiment of the present invention, and FIG.
FIG. 3 is a conceptual diagram of cursor position information set in the same system. Further, FIG. 12 is a diagram showing an example of a computer screen in which a cursor is drawn in the system, and FIG. 13 is a conceptual diagram showing frame information. FIG. 14 is a diagram showing the movement of the virtual frame,
FIG. 15 is a diagram showing an example of a computer screen on which a command is executed.

This embodiment is different from the second embodiment in that the application of the computer device 20 is moved on the projector device 10a. In FIG. 9, the projector device 10a has a frame information receiving unit 11a-4 in the transmission / reception unit 11a and a frame drawing control unit 12a- in the control unit 12a in addition to the configuration of the second embodiment.
Have five.

In addition to the configuration of the second embodiment, the computer device 20 has a frame information transmission section 21-4 in the transmission / reception section 21. In addition to the cursor position information, the storage unit 13a also stores frame information and the like. The remote controller 30a has a move button 37a and a cancel button 38a in addition to the configuration of the second embodiment. Other configurations and functions are the same as those in the second embodiment.

The frame information receiving section 11a-4 receives the frame information from the computer device 20 and outputs it to the frame drawing control section 12a-5. This frame information is information indicating that the title bar of the application placed at the cursor position has been selected, frame position information, and information such as the frame size of the application.

The information indicating that the title bar of the application placed at the cursor position is selected can be, for example, the application name. Alternatively, in more detail, flag information indicating selection, information indicating a title bar in an application, or the like may be included, and more detailed information is provided in accordance with the content of application control to be realized. be able to. It can also be omitted. The frame position information can be represented by, for example, the upper left and lower right coordinates of the frame. Further, the frame size can be expressed by the width and height of the frame.

Upon receiving the frame information from the frame information receiving unit 11a-4, the frame drawing control unit 12a-5 sets the cursor position information, the frame position information and the frame size in the signal processing unit 14a, and sets the set screen position. Draw a cursor and a frame on the display unit 15
Display on a. The frame information transmission unit 21-4 of the computer device 20 transmits the frame information input from the control information processing unit 22 to the projector device 10a.

Move button 37a of remote controller 30a
Is used when moving an application on a computer screen. Normally, when each direction change button is pressed, the cursor can be moved according to the pressing, but by moving the cursor to the title bar of the application and pressing the decision button 36a, the cursor is selected and moved. The application can be moved by pressing each direction change button after pressing the button 37a.

The cancel button 38a is an execution command that can release the cursor when the cursor selects the title bar of the application and the dragging is enabled. In addition, it is possible to add a function to cancel the executed command.

Next, the processing procedure of the application control display system in the computer screen display will be described with reference to FIG. First, the control information processing unit 22 of the computer device 20 converts the video signal of the computer screen into image data, compresses it, and outputs it to the image data transmitting unit 21-3.

The image data transmitting section 21-3 sends this image data to the image data receiving section 11 of the projector device 10a.
Send to a-3. It should be noted that the conversion function and the compression function are provided by the image data transmission unit 2 instead of the control information processing unit 22.
You may make it 1-3.

When the image data receiving section 11a-3 of the projector device 10a receives the image data, it outputs it to the image data control section 12a-4 of the control section 12a. Then, the image data control unit 12a-4 expands the input image data, converts it into a video signal, and outputs this to the signal processing unit 14a. Then, the signal processing unit 14a causes the display unit 15a to display this. At this time, the image data receiving unit 11a-3 may be provided with the expanding function and the converting function. FIG. 10 shows an example of the computer screen thus displayed. In the figure, an application A41 having a title bar 45 is displayed.

Next, when a cursor display command is input from the remote controller 30a, the input information control section 12a-
1 receives this and outputs it to the cursor drawing control unit 12a-2. The cursor drawing control unit 12a-2 includes a storage unit 13
The cursor position information is acquired from a and set in the signal processing unit 14a, and the signal processing unit 14a draws the cursor at the set screen position and displays it on the display unit 15a. FIG. 11 is a conceptual diagram of the cursor position information set in this way. In the figure, as an example, the cursor 44
Indicates that the position information is the coordinate (400, 100), and the signal processing unit 14a is set to display the cursor 44 at the coordinate (400, 100) on the computer screen.

The signal processing unit 14a draws a cursor at a corresponding screen position on the video signal of the computer screen based on the set cursor position information, and outputs it to the display unit 15a for display. FIG. 12 shows an example of the computer screen on which the cursor 44 is displayed in this way.

Next, in order to select the title bar 45 with the cursor 44, when the determination command is input from the remote control device 30a, the input information control section 12a-1 receives this and the control information output section 12a- Output to 3.
The control information output unit 12a-3 acquires the cursor position information from the storage unit 13a, outputs the cursor position information and the information of the decision command to the control information transmission unit 11a-2, and the control information transmission unit 11a-2 outputs the information. The computer device 20
Send to.

Control information receiving section 2 of computer device 20
The 1-2 receives the cursor position information and the information of the decision command from the projector device 10 a, and outputs them to the control information processing unit 22. The control information processing unit 22 confirms with the storage unit 13a whether or not an application exists at the input cursor position, and if there is, stores the frame position information, frame size information, etc. of the application A41. It is acquired from the part 13a. Then, the frame information is transmitted to the projector device 10a via the frame information transmitting unit 21-4.

The frame information receiving section 11a-4 of the projector device 10a receives the frame information and outputs it to the frame drawing control section 12a-5. The frame drawing control unit 12a-5 stores the frame information in the storage unit 13a and sets the frame information in the signal processing unit 14a. The cursor drawing control unit 12a-2 also acquires cursor position information from the storage unit 13a and sets it in the signal processing unit 14a.

Then, the signal processing section 14a draws a frame and a cursor at each screen position based on these pieces of information, and displays them on the display section 15a. FIG. 13 is a conceptual diagram of frame information set in the signal processing unit 14a in this way. In the figure, the frame A41a is set.

As shown in FIG. 10, the frame A41a has already been displayed as the application A41 on the projector device 10a first. However, at this point, the projector device 10a
The frame of the application A41 is not recognized, but only the entire computer screen is recognized as an image. In the present embodiment, the frame A41a is set in the signal processing unit 14a, so that the application A41 can be recognized independently. It becomes possible.

Therefore, although the computer screen displayed in this way is visually identical to the computer screen shown in FIG. 10, the computer screen displayed after setting the frame A41a is the application A41.
Is in a state where it can be controlled.

Next, as shown in FIG. 14, the frame A41
a is to be moved. At this time, the remote controller 3
Information for moving the frame A41a can be input to the projector device 10a by operating each direction movement command after inputting the movement command from 0a.

Then, based on the input execution command, the position information of the frame and the cursor after the movement is obtained through the input information control unit 12a-1, the cursor drawing control unit 12a-2, and the frame drawing control unit 12a-5. The frame and the cursor, which are set in the signal processing unit 14a and have been moved, are displayed on the display unit 15a.

Next, when a determination command is input from the remote controller 30a, this determination command is output to the control information output unit 12a-3 via the input information control unit 12a-1. Then, the control information output unit 12a-3 transmits this determination command to the computer device 20 via the control information transmission unit 11a-2 together with the cursor position information, frame information, etc. of the storage unit 13a.

Control information receiving section 2 of computer device 20
1-2 receives these, outputs them to the control information processing unit 22, stores them in the storage unit 23, redraws the computer screen based on these information, converts them into image data, and compresses them. It is output to the image data transmission unit 21-3. Then, the image data is transmitted from the image data transmitting unit 21-3 to the projector device 10a and is displayed in the same manner as the above case.

FIG. 15 shows an example of the computer screen displayed on the projector device 10a in this way. In the figure, the application A41 is displayed at a position moved from the position of FIG. 10 based on the execution command input to the projector device 10a from the remote control device 30a.

In this embodiment, the computer screen after the application A41 is moved is redrawn and displayed on the projector device 10a. However, this is the desktop screen under the application A41 before the movement. Data such as
It is because a does not own it.

Therefore, for example, first, the disk top screen of the computer screen is changed to the projector device 10a.
By sending it to and holding it,
It is also possible to omit the redrawing step. That is, the computer device 20 is based on the frame information after the movement transmitted from the projector device 10a.
The redrawing of the computer screen can be omitted only by updating the information in the storage unit 23 in FIG.

[Fifth Embodiment] Next, a fifth embodiment of the present invention will be described with reference to FIG. The same figure is a block diagram showing a configuration of an application control display system in a fifth exemplary embodiment of the present invention.

The application control display system of this embodiment is similar to the third embodiment in that the input device 3 is used.
0 is the mouse 30b, which is different from the fourth embodiment. Other configurations and functions are similar to those of the fourth embodiment. Further, as the input device 30, the mouse 3
In addition to 0b, it is possible to use various pointing devices such as a pointer device and a touch pad, and control keys of the main body of the projector device 10a.
This is similar to the third embodiment.

In the above-described embodiment, the application control is ended or moved, but other control, for example, in the case of an application having a plurality of pages, the page may be switched. it can. In this case, the remote control device 30a is given an execution command for "next page" or "previous page", and its control is controlled by the input information control unit 12a-1, the control information output unit 12a-3, and the computer device in the projector device 10a. This can be done by putting the control information processing unit 22 of 20 or the like.

The present invention is not limited to the above embodiment, and for example, by combining the first embodiment and the fourth embodiment, the computer screen is treated as a video signal,
And applications can be made mobile.
Further, the input device 30 can be made to be keyboard input, and characters can be input to the display device 10, and the design can be appropriately changed by adding special control.

[0110]

As described above, according to the present invention, it becomes possible to control the application transmitted from the computer device to the display device and displayed on the computer screen only by the input device of the display device.

Further, at this time, since it is possible to display and control only one cursor without displaying two cursors for the computer device and the display device, it is possible to improve operability. Furthermore, since the amount of data transmission / reception between the computer device and the display device can be reduced, a high processing speed can be obtained, which makes it suitable for presentations.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of an application control display system according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of an application control display system according to the first embodiment of the present invention.

FIG. 3 is a diagram showing an example of a computer screen displayed in the application control display system according to the first embodiment of the present invention.

FIG. 4 is a conceptual diagram of cursor position information set in the application control display system according to the first embodiment of the present invention.

FIG. 5 is a diagram showing an example of a computer screen in which a cursor is drawn in the application control display system according to the first embodiment of the present invention.

FIG. 6 is a diagram showing an example of a computer screen on which a command is executed in the application control display system according to the first embodiment of the present invention.

FIG. 7 is a block diagram showing a configuration of an application control display system according to a second embodiment of the present invention.

FIG. 8 is a block diagram showing a configuration of an application control display system according to a third exemplary embodiment of the present invention.

FIG. 9 is a block diagram showing a configuration of an application control display system according to a fourth exemplary embodiment of the present invention.

FIG. 10 is a diagram showing an example of a computer screen displayed in the application control display system according to the fourth embodiment of the present invention.

FIG. 11 is a conceptual diagram showing cursor position information set in the application control display system according to the fourth embodiment of the present invention.

FIG. 12 is a diagram showing an example of a computer screen on which a cursor is drawn in the application control display system according to the fourth embodiment of the present invention.

FIG. 13 is a conceptual diagram showing frame information in the application control display system according to the fourth embodiment of the present invention.

FIG. 14 is a diagram showing movement of frames in the application control display system according to the fourth embodiment of the present invention.

FIG. 15 is a diagram showing an example of a computer screen on which a command is executed in the application control display system according to the fourth embodiment of the present invention.

FIG. 16 is a block diagram showing a configuration of an application control display system according to a fifth exemplary embodiment of the present invention.

[Explanation of symbols]

10 Display device 10a projector device 11,11a Transceiver 11a-1 Video signal receiver 11a-2 control information transmitter 11a-3 Image data receiving unit 11a-4 Frame information receiving unit 12, 12a Control unit 12a-1 Input information control unit 12a-2 Cursor drawing control unit 12a-3 Control information output unit 12a-4 Image data control unit 12a-5 Frame drawing control unit 13, 13a storage unit 14, 14a Signal processing unit 15,15a Display section 20 Computer equipment 21 Transmitter / receiver 21-1 Video signal transmitter 21-2 Control information receiver 21-3 Image data transmitter 21-4 Frame Information Transmission Unit 22 Control information processing unit 23 Memory 30 input device 30a remote control device 30b mouse 31a Upward movement button 32a Left move button 33a Right move button 34a Downward movement button 35a display / non-display button 36a decision button 37a Move button 38a Cancel button 41 Application A 41a Frame A (before moving) 41b Frame A (after moving) 42 Application B 43 Finish button 44 cursor 45 title bar

Claims (10)

[Claims] 1. An application control display system in a computer screen display for controlling a cursor and an application based on an execution command input to a display device from an input device, wherein a video signal of a computer screen is received from the computer device. And displaying the cursor on the computer screen based on the execution command input from the input device, and executing another execution command input from the input device and cursor position information on the computer device. The display device for transmitting and receiving the video signal of the computer screen redrawn based on the other execution command and the cursor position information from the computer device and displaying the video signal of the computer screen. The computer, which transmits to the play device, redraws the computer screen based on the other execution command and the cursor position information received from the display device, and transmits the redrawn computer screen image signal to the display device. An application control display system for computer screen display, comprising: a device; and the input device for inputting the various execution commands to the display device. 2. An application control display system in a computer screen display for controlling a cursor and an application based on an execution command input to a display device from an input device, the image data of the computer screen being received from the computer device. And displaying the cursor on the computer screen based on the execution command input from the input device, and executing another execution command input from the input device and cursor position information on the computer device. The display device that transmits and receives the image data of the computer screen redrawn based on the other execution command and the cursor position information from the computer device and displays the image data of the computer screen. Data to the display device, and redraws the computer screen based on the other execution command and the cursor position information received from the display device, and transmits the image data to the display device. An application in computer screen display, comprising: the computer device for converting a video signal into image data and transmitting the image data to the display device; and the input device for inputting the various execution commands to the display device. Control display system. 3. The computer apparatus acquires frame information based on the execution command and cursor position information transmitted from the display apparatus, transmits the frame information to the display apparatus, and the display apparatus transmits the frame information. Redisplay the computer screen based on the frame information that has been performed, the execution command input from the input device, and redisplay the computer screen information based on the cursor position information and frame information, the execution command, The cursor position information and the frame information are transmitted to the computer device, and the computer device redraws the computer screen based on the transmitted execution command, the cursor position information and the frame information, and the computer Picture The transmitted to a display device, said display device, according to claim 1 or 2 application control display system in a computer screen display, wherein the displaying the transmitted by the computer screen has a. 4. The display device is a projector device, and the input device is a remote control device, a mouse, a pointing device, or a control key of the display device body. An application-controlled display system in the described computer screen display. 5. An application control in a computer screen display for displaying a computer screen received from a computer device, transmitting an execution command input from an input device to the computer device, and receiving and displaying a redrawn computer screen. A display device, which receives a video signal of a computer screen transmitted from the computer device, outputs the video signal to a signal processing unit, and outputs an execution command and cursor position information input from the control unit. A transmission / reception unit for transmitting to the computer device; a signal processing unit for displaying the computer screen on a display unit based on the video signal input from the transmission / reception unit or cursor position information input from the control unit; According to the execution command entered from the device By outputting the cursor position information to the signal processing unit,
A computer having the control unit that redisplays the computer screen on the display unit based on the cursor position information and outputs an execution command and cursor position information input from the input device to the transmission / reception unit. Application control display device for screen display. 6. An application control in a computer screen display for displaying a computer screen received from a computer device, transmitting an execution command input from an input device to the computer device, and receiving and displaying a redrawn computer screen. A display device, which receives image data of a computer screen transmitted from the computer device, outputs the image data to a control unit, and outputs an execution command and cursor position information input from the control unit. A transmitting / receiving unit for transmitting to the computer device, converting the image data input from the transmitting / receiving unit into a video signal and outputting the video signal to a signal processing unit, thereby displaying a computer screen on the display unit based on the video signal, and , The execution command input from the input device In accordance with,
By outputting the cursor position information to the signal processing unit, the computer screen is re-displayed on the display unit based on the cursor position information, and the execution command and the cursor position information input from the input device are transmitted to the transmission / reception unit. A computer screen characterized by having the signal processing unit for displaying the computer screen on the display unit, based on the image data input from the control unit, or the cursor position information. Application control display device in display. 7. The transmission / reception unit receives frame information acquired by the computer device based on an execution command and cursor position information, and outputs the frame information to the control unit, and the control unit controls the frame Information is output to the signal processing unit, the computer screen is re-displayed on the display unit based on the frame information, and the cursor position information and the frame information are processed according to the execution command input from the input device. The computer screen on the display unit again based on the cursor position information and the frame information, and outputs the execution command, the cursor position information and the frame information to the transmitting / receiving unit, The part includes the execution command, the cursor position information, and the frame. Information is transmitted to the computer device, the computer device receives a computer screen redrawn based on the execution command, the cursor position information, and the frame information from the computer device, and the received computer screen is image data. In some cases, this computer screen is converted into a video signal via the control unit and output to the signal processing unit. In the case of a video signal, the computer screen is directly output to the signal processing unit, and the signal processing is performed. 7. The application control display device for computer screen display according to claim 5, wherein the unit displays the computer screen on the display unit. 8. An application control display method in a computer screen display for controlling a cursor and an application based on an execution command input to a display device from an input device, wherein the computer device displays the video signal of the computer screen. Transmitting to a display device, the display device, while displaying a computer screen by the transmitted video signal, based on the execution command input from the input device, the cursor is displayed on the computer screen, and, The other execution command input from the input device and the cursor position information are transmitted to the computer device, and the computer device redraws the computer screen based on the other execution command and the cursor position information. At the same time, a video signal of the redrawn computer screen is transmitted to the display device, and the display device displays the redrawn computer screen. 9. An application control display method in computer screen display for controlling a cursor and an application based on an execution command input to a display device from an input device, wherein the computer device displays a video signal of a computer screen as an image. The data is converted into data and transmitted to the display device, the display device displays a computer screen based on the transmitted image data, and a cursor is displayed on the computer screen based on an execution command input from the input device. And the other execution command input from the input device and the cursor position information are transmitted to the computer device, the computer device based on the other execution command and the cursor position information. A computer characterized by redrawing a computer screen, converting a video signal of the redrawn computer screen into image data and transmitting the image data to the display device, and the display device displaying the redrawn computer screen. Application control display method in screen display. 10. The computer device creates frame information based on the execution command and cursor position information transmitted from the display device, transmits the frame information to the display device, and the display device transmits the frame information. Re-display the computer screen based on the frame information that has been, and re-display the computer screen information based on the execution command and cursor position information and frame information input from the input device, the execution command, The cursor position information and the frame information are transmitted to the computer device, the computer device redraws the computer screen based on the transmitted execution command, the cursor position information and the frame information, and the computer Send a surface to the display device, the display device, the application control display method in a computer screen display of claim 8 or 9, wherein the displaying the computer screen that has been transmitted.