JPH11338458A - Display unit, image displaying method, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a smooth and comfortable operation circumstance for a user in a meeting and presentation using a plurality of image sources. SOLUTION: This unit has a selecting means 102 for selecting an area to display an image input from an image source on an image plane of a display means 101, a communication means 104 for transmitting a selected information to a display main body, a detection means 105 for detecting an absolute position of a selected area on the image plane of the display means 101, and a display control means 106 for calculating a scaling variable power rate of an input image data to a display data, based on horizontal resolution a number of vertical lines of the input image data and a displaying position information to display the input image scaled to a size in response to the scaling variable power rate.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device, an image display method, and a storage medium, and more particularly to a method for providing a smooth and comfortable operation environment in a conference or presentation using a plurality of image sources. Display device, image display method, and storage medium.

[0002]

2. Description of the Related Art In recent years, image data created by a notebook personal computer (notebook PC) or the like is displayed on a large-sized display device, for example, a liquid crystal projector or a plasma display, and a presentation (a technique of persuasive explanation at a conference or the like) is made. Is increasing. On the other hand, in a conference, attendees have each saved data on a computer, browsed the data, and exchanged files on the spot. From such a background, the image display system needs a function of simultaneously displaying a plurality of image sources at a time and integrally controlling the information and each displayed image information.

However, in the conventional large display device for presentation, when a plurality of image sources are simultaneously displayed, the display position must be set in advance in order to determine the display layout on the screen of the large display device. Or, the presenter listens to the display format (number of display lines, number of dots, number of colors) of the image source of the meeting participants, and adjusts the display layout before the meeting through complicated manual setting of the display driver software before the meeting. I had to decide.

[0004] In addition, for a conference participant who looks at a large screen display device, there are many cases where characters and images cannot be seen in a display layout predetermined by a presenter depending on a seating position. Each time, or interrupt the meeting and check with the presenter what is being displayed, or in the worst case, the presenter has to redo the redisplay layout using the display driver software described above. Was.

[0005]

However, as in the above-mentioned prior art, it is difficult to determine the layout of a plurality of image sources via a display driver software before or during a conference or to redo the process, or to start over. Not only hinders the smooth progress of the conference, but also provides a more efficient overall meeting in a multi-display conferencing system whose original purpose is to provide an uncomfortable user interface that requires only a set time. Many problems have arisen, such as becoming endless.

The present invention has been made in view of the above points, and has a display device and an image display method capable of providing a user with a smooth and comfortable operation environment in a conference or presentation using a plurality of image sources. And a storage medium.

[0007]

According to one aspect of the present invention, there is provided a display device capable of simultaneously or independently displaying images input from a plurality of image sources, wherein the display device displays input images. Means for selecting which area on the screen of the means to display, detecting means for detecting the absolute position of the selected area on the screen, and input image data based on the input image data and the detected display position information. And display control means for displaying the image by scaling it to a predetermined size.

In order to achieve the above object, a second aspect of the present invention includes communication means for transmitting selection information by the selection means to a display device main body, wherein the display control means comprises a horizontal resolution and a vertical resolution of input image data. A scaling ratio of input image data to display data is calculated based on the number of lines and the detected display position information, and the input image is scaled to a size corresponding to the scaling ratio and displayed. .

To achieve the above object, the invention according to claim 3 is characterized in that the selection means can designate one of the diagonal lines of the rectangular frame as a start point and the other point as an end point as a display selection range on the screen. There is a feature.

In order to achieve the above object, the invention according to claim 4 has storage means for storing a layout frame indicating a display selection range, wherein the display control means stores display screen data when displaying on the screen. It is characterized in that the layout frame data is superimposed and displayed.

[0011] In order to achieve the above object, the invention according to claim 5 has a confirmation selecting means for allowing an operator to confirm and select whether or not to display in the display selection range when the display selection range is determined. Features.

In order to achieve the above object, according to a sixth aspect of the present invention, the confirmation selecting means includes an on-screen disp.
lay.

In order to achieve the above object, a seventh aspect of the present invention is characterized in that the confirmation selecting means is a voice information input / output means.

In order to achieve the above object, the invention according to claim 8 is characterized in that the display control means sets the size of the display selection range when the display selection range overlaps the display area of another input image already displayed. The display position is shifted and displayed without changing.

In order to achieve the above object, the invention according to claim 9 is characterized in that the display control means displays the virtual space when the display position is shifted and exceeds the boundary of the frame memory for the display screen. It is characterized by making it.

In order to achieve the above object, a tenth aspect of the present invention is characterized in that the display control means can determine in which area of the virtual display space the used memory space of the input image is mapped. .

According to another aspect of the present invention, there is provided a display device capable of simultaneously or independently displaying images input from a plurality of image sources, wherein the plurality of images are displayed on a display means. Selecting means for selecting desired image data from the data, distance measuring means for measuring an absolute distance between the selecting means and the selected image, and display controlling means for scaling and displaying the selected image to a predetermined size based on the measurement And characterized in that:

In order to achieve the above object, a twelfth aspect of the present invention includes communication means for transmitting distance measurement information from the distance measurement means to a display device main body, and the display control means includes a moving distance of the selection means. Calculating the scaling ratio of the selected image data to the display data based on the difference of the horizontal resolution and the number of vertical lines of the selected image data, and scaling the selected image to a size corresponding to the scaling ratio and displaying the selected image. Features.

In order to achieve the above object, a thirteenth aspect of the present invention is characterized in that the display control means calculates the scaling factor based on a lookup table indicating a relationship between a moving distance and a scaling factor. .

In order to achieve the above object, the invention of claim 14 is characterized in that the image source is a device such as a computer, a workstation, a digital television, a video, and the like.

In order to achieve the above object, the invention according to claim 15 is characterized in that the selecting means is provided with the distance measuring means and transmits information to a display device main body by infrared rays through the communication means. And

In order to achieve the above object, an invention according to claim 16 is an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources. A selection step of selecting which area on the screen of the display means to display using the selection means, a detection step of detecting an absolute position of the selected area on the screen, input image data and the detected A display control step of scaling and displaying the input image to a predetermined size based on the display position information.

In order to achieve the above object, the invention of claim 17 has a communication step of transmitting selection information in the selection step to a display device main body, and in the display control step, a horizontal resolution and a vertical resolution of input image data are set. A scaling ratio of input image data to display data is calculated based on the number of lines and the detected display position information, and the input image is scaled to a size corresponding to the scaling ratio and displayed. .

In order to achieve the above object, the invention according to claim 18 is characterized in that in the selection step, one of the diagonal lines of the rectangular frame can be designated as a start point and the other point as an end point as a display selection range on the screen. There is a feature.

To achieve the above object, the invention of claim 19 has a storage step of storing a layout frame indicating a display selection range, wherein the display control step includes a step of storing display screen data when displaying on the screen. It is characterized in that the layout frame data is superimposed and displayed.

[0026] In order to achieve the above object, the invention of claim 20 has a confirmation selection step for allowing an operator to confirm and select whether or not to display in the display selection range when the display selection range is determined. Features.

[0027] In order to achieve the above object, the invention according to claim 21 is characterized in that in the confirmation selecting step, On Screen is selected.
The confirmation and the selection are performed using a display.

[0028] In order to achieve the above object, the invention of claim 22 is characterized in that, in the confirmation selecting step, the confirmation and selection are performed using a voice information input / output means.

According to a twenty-third aspect of the present invention, in the display control step, when the display selection range is overlapped with a display area of another input image already displayed, the size of the display selection range is increased. The display position is shifted and displayed without changing.

In order to achieve the above object, the invention according to a twenty-fourth aspect of the present invention is that, in the display control step, when the display position is shifted and displayed, when the display position exceeds a boundary of a frame memory for a display screen, a virtual space display is performed. It is characterized by making it.

In order to achieve the above object, a twenty-fifth aspect of the present invention is characterized in that in the display control step, it is possible to determine in which area of the virtual display space the used memory space of the input image is mapped. .

[0032] In order to achieve the above object, an invention according to claim 26 is an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources. A selection step of selecting desired image data from a plurality of displayed image data using a selection unit; a distance measurement step of measuring an absolute distance between the selection unit and the selected image; and a step of determining the selected image based on the measurement. And a display control step of displaying the image after scaling the size of the image.

In order to achieve the above object, the invention according to claim 27 has a communication step of transmitting the distance measurement information in the distance measurement step to a display device main body, and in the display control step, the moving distance of the selection means Calculating the scaling ratio of the selected image data to the display data based on the difference of the horizontal resolution and the number of vertical lines of the selected image data, and scaling the selected image to a size corresponding to the scaling ratio and displaying the selected image. Features.

In order to achieve the above object, the invention of claim 28 is characterized in that in the display control step, the scaling magnification is calculated based on a lookup table indicating a relationship between a moving distance and a scaling magnification. .

In order to achieve the above object, the invention according to claim 29 is characterized in that the image source is a device such as a computer, a workstation, a digital television, a video and the like.

In order to achieve the above object, the invention of claim 30 is characterized in that, in the selecting step and the distance measuring step, information is transmitted to the display device main body by infrared rays through the communication step.

[0037] In order to achieve the above object, the invention of claim 31 stores a program for executing an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources. A computer-readable storage medium, wherein the image display method includes:
A selection step of selecting which area on the screen of the display means to display the input image using the selection means, a detection step of detecting an absolute position of the selected area on the screen, and input image data and A display control step of scaling the input image to a predetermined size based on the detected display position information and displaying the input image.

[0038] In order to achieve the above object, the invention of claim 32 stores a program for executing an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources. A computer-readable storage medium, wherein the image display method includes:
A selection step of selecting desired image data from a plurality of image data displayed on the display means using a selection means; a distance measurement step of measuring an absolute distance between the selection means and the selected image; and a selection based on the measurement. A display control step of scaling the image to a predetermined size and displaying the image.

[0039]

Embodiments of the present invention will be described below with reference to the drawings.

[1] First Embodiment FIG. 1 shows a configuration of a main part of a multi-display system according to a first embodiment of the present invention and a second embodiment to be described later, and claims. It is a functional block diagram corresponding to the range. The multi display system according to the first embodiment of the present invention includes a display unit 101, a selection unit 102, and a distance measurement unit 1.
03, communication means 104, detection means 105, display control means 106, and storage means 107. In the drawing, 111-1, 111-2,... 111-n indicate image sources.

The function of each section will be described.
01 displays an image under the control of the display control means 106. The selection means 102 includes the image sources 111-1 and 11-1.
1-2,..., 111-n, to select an area on the screen of the display unit 101 to display the image. The distance measuring unit 103 measures an absolute distance between the selecting unit 102 and the selected display image, and is provided in a multi-display system according to a second embodiment described later. The communication unit 104 transmits information selected by the selection unit 102 to the display device main body. The detecting means 105 detects the absolute position of the selected area on the screen of the display means 101.

The display control means 106 calculates the scaling ratio of the input image data to the display data based on the horizontal resolution and the number of vertical lines of the input image data and the detected display position information, and converts the input image to the scaling ratio. The image is displayed after being scaled to an appropriate size (first embodiment). Also, the display control means 106
A reference table showing the scaling ratio of the selected image data to the display data based on the difference in the moving distance of the selecting means 102 measured in step 2 and the horizontal resolution and the number of vertical lines of the selected image data, and the relationship between the moving distance and the scaling ratio. , And the selected image is scaled to a size corresponding to the scaling magnification and displayed (second embodiment). The storage unit 107 stores a layout frame indicating a display selection range, and is provided separately from the storage unit that stores display data.

The display means 101 is the display device 31 shown in FIG.
3, the selecting means 102 corresponds to the display pointer controller 321 in FIG. 2, the distance measuring means 103 corresponds to the distance measuring sensor 539 in FIG. 5, the communication means 104 corresponds to the infrared light emitting section 330 in FIG. The detection unit 105 corresponds to the position sensors 322 and 323 in FIG. 2, the display control unit 106 corresponds to the control unit 260, the overlay data controller 280,
The storage unit 107 corresponds to the output display format conversion unit 311 and the display drive controller 312, and the storage unit 107 corresponds to the superimposition data store memory 310 in FIG. The illustration of the confirmation selecting means in the claims is omitted.

FIG. 2 is a block diagram showing a basic configuration of the multi display system according to the first embodiment of the present invention.
The multi-display system according to the first embodiment of the present invention displays, for example, four independent image sources on one monitor, and monitors input / output devices of each image source, such as a mouse, a keyboard, a remote controller, and a speaker. Control in conjunction with the image data displayed on the
One image source can realize an optimum mapping display in a desired area of the monitor. These image sources may be more than four or less.

The multi display system 331 according to the first embodiment of the present invention comprises input units 221, 222, 223,
224, display format converters 231, 232, 23
3, 234, bus interfaces 241, 242, 24
3, 244, the bus controller 250, the control unit 260,
A frame memory controller 270, an overlay data controller 280, a frame memory 290, an overlay data store memory 310, an output display format converter 311, a display drive controller 312, a display device 313, a selector 314, a packet distribution controller 315,
Packet controller with FIFO memory 316, FIFO memory 317, infrared data converter 318, infrared data controller 319, infrared data receiver 320, display pointer controller 321, packet controller with FIFO 3
26, D / A converter 327, amplifier 328, speaker 3
29. In the figure, 211, 212,
Reference numerals 213 and 214 denote image signal sources (hereinafter, image source group).

Explaining the configuration of each unit, the image source groups 211, 212, 213, and 214 are configured as, for example, a personal computer, a workstation, a digital television, a video, and the like. In this embodiment, 4
Exist. Each input unit 221, 222, 223, 224
Are image source groups 211, 212, 213, and 2 respectively.
It receives the image data output from.
If the received image data is an analog signal of a computer, the input unit includes an A / D converter and a PLL (Phase Loc) for sampling the image data.
(Ked Loop) and LVDS
(Low Voltage Differential
For example, a digital signal such as a signal (Signaling) is provided with a decoder and a differential buffer.
An encoder for encoding G and B signals is provided.

Each input unit 221, 222, 223, 224
Is a control signal for receiving image data and image data from each image source group 211, 212, 213, 214;
For example, a horizontal synchronization signal for synchronizing one line, a vertical synchronization signal for synchronizing one frame or one field, a clock signal for sampling a pixel, a display enable signal indicating a transfer period of valid image data, and the like are also received at the same time. Each of the input units 221, 222, 223, and 224 is connected to the image source group 211, 212,
Image data is received from 213 and 214. Each of the input units 221, 222, 223, and 224 has a serial communication unit with image source groups 211, 212, 213, and 214 described below.

The display format converters 231, 232,
233, 234 are input units 221, 222, 223,
The display format (the number of display lines, the number of dots, and the number of colors) of the image data received at 224 is converted under the control of the control unit 260. Bus interfaces 241, 242,
Reference numerals 243 and 245 are for inputting four independent image data to one common bus. The bus controller 250 includes bus interfaces 241, 242,
The image data output from the image data 243 and 245, the image data output from the frame memory controller 270 and the image data output from the superimposition controller 280, and a transfer request therefrom are received, and the image data transfer is arbitrated based on the priority order.

The control unit 260 controls the multi display system 3
CPU that controls the entire system 31 and has arithmetic capability
It has a RAM for temporarily storing data, a ROM for storing a control program, a counter for measuring time, a peripheral input / output interface, and the like. Further, control unit 260 may be configured only with logic logic. The control program may be stored in the ROM, or may be externally transferred via the peripheral input / output interface. The frame memory controller 270 processes and controls image data input by arbitration of the bus controller 250 into data suitable for the frame memory 290 by calculation. This may be a CPU or a media processor capable of parallel operation.

The overlay data controller 280
The input units 221 to 224 are for displaying different image data on the display device 313 in a superimposed manner. The frame memory 290 is a memory that stores at least one frame of image data to be drawn on the display device 313. The superimposition data store memory 310 is a memory for storing data to be superimposed. The output display format conversion unit 311 inputs image data on the bus under the control of the bus controller 250 and converts the image data into a display format suitable for the display drive controller 312. The display drive controller 312 drives the display device 313.

The display device 313 displays an image. The display device 313 may be a flat panel (liquid crystal, plasma, or the like) having a matrix electrode structure or a CRT as long as it can display an image. Further, on the display device 313, a position sensor 322 in the X-axis (horizontal axis) direction and a position sensor 3 in the Y-axis (vertical axis) direction are provided.
23 are equipped. The selection unit 314 switches high-speed serial data lines that can transmit and receive data such as a mouse (infrared ray), a keyboard, and a speaker, which are input / output devices of the image source groups 211 to 214, by packet multiplexing. An example in which such data can be transferred by packet multiplexing is IEEE 1394 (Institute of
Electrical and Electronics
Engineers: A standard of serial interface by American Electrical and Electronic Engineers Association) and USB (Universal
rsal Serial Bus: an interface between relatively slow peripheral devices and a computer).

The packet distribution control unit 315 includes the selection unit 31
The serial data selected in step 4 is distributed for each packet. The packet control unit with FIFO memory 316 is a FIFO for adjusting the timing when receiving the packet data sent to the multi display system 331.
(First In First Out) memory is built-in. The display pointer controller (pointing device) 321 mainly has a display position layout function, and includes an infrared light emitting unit 330, a display pointer confirmation control button 324, and a display pointer cancellation control button 325. Infrared data receiving section 320
Receives the infrared data transmitted from the display pointer controller 321. The infrared data control unit 319
The data format received by the infrared data receiving unit 320 is output to the control unit 260 and the infrared data conversion unit 318.

The infrared data converter 318 converts the data sent from the infrared data controller 319 into serial data packets. The FIFO memory 317 is a memory for adjusting the timing at which the packet data generated by the infrared data conversion unit 318 is transferred to the packet distribution control unit 315. Packet control unit 326 with FIFO
Is a timing adjustment FI for receiving a sound packet transmitted from each of the image source groups 211 to 214.
Built-in FO memory. The D / A converter 327 converts the input digital sound data into analog sound data. The amplifier 328 amplifies sound data. The speaker 329 is provided in the multi-display system 331 and performs audio output.

Next, the first embodiment of the present invention configured as described above is described.
The operation of the multi-display system according to the embodiment will be described.

<Initialization of Display Position Layout> The image source groups 211 to 214 and the multi display system 331 are powered on, respectively, and then the input unit 2 of the multi display system 331 is turned on.
The communication is performed via the bidirectional serial communication lines provided in 21, 222, 223, and 224. Input units 221-2
From 24, the number of display dots, the number of display lines, the number of display colors,
Data such as video output timing is sent to the image source groups 211 to 214, respectively. This format is performed by both sides using a predetermined communication protocol.

As an example, US standardization organization VES
A (Video Electronics Standa)
rds Association)
(Display Data Channel) may be used, and the data format is EDID (Extended Display Id) also defined by VESA.
Entification Data). At this time, the number of display dots, the number of display lines, and the number of display colors to be transferred transfer the number of display dots, lines, and colors of the display device 313. Alternatively, a display format predetermined by the control unit 260 may be used. Image source groups 211, 212,
213 and 214 output the image data and the control signal thereof to each of the input units 221, 222, 223 and 224 of the multi display system 331 based on the received information.

However, if the image source groups 211 to 214 and the multi-display system 331 cannot communicate with each other via the bidirectional serial communication line (such as analog video output), the number of display dots and the number of display lines Is a horizontal synchronizing signal, one frame or one frame, in which each of the input units 221, 222, 223, and 224 synchronizes one line.
It is also possible to know by directly counting the number of clocks and the number of horizontal synchronization signals using a vertical synchronization signal for synchronizing fields, a clock signal for sampling one pixel, or the like. In any case, the multi-display system 331 initializes the image source groups 211, 212, 2
The display format (the number of display lines, the number of dots, and the number of colors) of the image data output from the devices 13 and 214 is recognized (or can be known).

At this time, the multi display system 331
The input units 221 to 224 constantly monitor a connection identification signal from the image source in order to identify how many image sources are connected to the image source. This connection identification signal is logically “1” or “0” from the image source groups 211 to 214.
As a binary signal. If the connection cable is disconnected or the image source is turned off, the input unit 211
Since the resistors are terminated at .about.214, this logic becomes "0", and the multi display system 331 can recognize that no image data is input. This monitoring information is sent to the control unit 260 every certain period.

The control section 260 first detects the connection recognition signal of the input section 221. If the connection recognition signal is "1", the input section 221 outputs the received image data to the display format conversion section 231. The conversion unit 231 performs display format conversion. On the other hand, when the connection recognition signal is “0”, the connection recognition signal of the input unit 222 is detected,
The input units 221 to 224 are scanned until they are detected.
When all the connection recognition signals are “0”, the multi display system 331 enters the power save mode, and the control unit 260, the selection unit 314, the packet distribution control unit 315, F
The power except for the packet control unit 316 with the FIFO memory, the FIFO memory 317, the infrared data conversion unit 318, the infrared data control unit 319, and the infrared data reception unit 320 is turned off.

<Case where One Image Source is Connected> An example in which only the connection recognition signal of the input unit 221 is “1” will be described below. Multi display system 33
The user using No. 1 starts by first determining which position and size of the image data of the image source 211 to display on the display device 313. This will be described with reference to FIG. The display state of the display device 313 when nothing is connected to the multi-display system 331 or when the display device 313 is connected but the display position is not determined is arbitrarily set on the system side as in the initial display state in FIG. The determined image pattern is displayed. This can be easily realized by the frame memory controller 270 writing an arbitrary image pattern in the image display area of the frame memory 290 after turning on the power under the instruction of the control unit 260.

Next, a display position layout method using the position sensor 322 in the X-axis (horizontal axis) direction and the position sensor 323 in the Y-axis (vertical axis) direction provided on the display device 313 will be described. This description is the basic point of the present invention. The user uses the display pointer controller 321 to start the display device 313 (X
(0, Y0), and the start point is determined by the confirmation control button 324. The X0 information is recognized by the position sensor 322 in the X-axis (horizontal axis) direction, and the Y0 information is recognized by the position sensor 323 in the Y-axis (vertical axis) direction. Next, the user similarly touches the end point (X1, Y1) of the display device 313 using the display pointer controller 321 and determines the end point with the confirmation control button 324. The X1 information is recognized by the position sensor 322 in the X-axis (horizontal axis) direction, and the Y1 information is recognized by the position sensor 323 in the Y-axis (vertical axis) direction.

The above series of operations are directly performed on the display device 313 as shown in FIG.
Can be performed based on the absolute position on the screen. Furthermore,
In order to make this operation a user interface that is easier for the user to use, the movement position of the display pointer from the start point to the end point is constantly monitored, and the trajectory is displayed as a layout frame as indicated by reference numeral 332 in FIG. In this realization method, the trajectory information of the display pointer is converted into X- and Y-information packets, which are converted into infrared rays at certain intervals, and emitted. The infrared light is received by the infrared data receiving section 320 and is converted into an electric signal. Infrared data control unit 31
9 transmits the packetized electric signal from the infrared data receiving section 320 to the control section 260. The control unit 260 extracts necessary X and Y information from the packet data, and sends the information to the data controller 280 by superimposing the information.

The overlay data controller 280 creates data in which the X and Y positions of the movement trajectory information of the display pointer are plotted in accordance with an instruction from the control section 260 and writes the data in the overlay data store memory 310. Apart from the input image data (in this example, an image pattern arbitrarily determined on the system side), data read from the superimposition data store memory 310 for storing data to be displayed on the display device 313 is controlled by the control unit 260. It is output on the bus via the operating overlay data controller 280. The superimposed data and input image data (an image pattern arbitrarily determined by the system in this example) output on the bus via the frame memory controller 270 are selected and input by the output display format conversion unit 311. You. This selection timing is determined by the control unit 2
60 is set.

The output display format conversion section 311 converts the data into data (such as a data bus width) suitable for the input of the display drive controller 312. The image data output by the output display format conversion unit 311 is output to the display drive controller 312. The display drive controller 312 generates a drive signal for driving the display device 313. For example, if the display device 313 is a TFT (Thi)
In the case of an n Film Transistor liquid crystal, it is a line-by-line synchronization signal, a frame-by-frame synchronization signal, an image data shift clock, image data, and an AC signal that drive a driver IC in a display device. If the display device 313 is a CRT, the image data is divided into R, G, and B, and D / A conversion is performed for each color to generate analog R, G, and B signals. Output to the display device 313. The display drive controller 312 transfers desired image data to the display device 313 and draws the image data on the display device 313. In the case of canceling the work of inputting the start point position and the input of the end point position, the work is reset by pressing the cancel control button 325 of the display pointer controller 321.

The display state when the above operation is completed is as shown in FIG. 3 (c) layout frame display state. The user confirms the position and size of the layout frame, and if the user wants to fit the input image, the user decides with the confirmation control button 324 of the display pointer controller 321.

Next, how to fit an input image into the layout frame will be described. Start point (X0, Y0) and end point (X1, Y
Based on 1), the control unit 260 calculates the following difference between the number of display dots Hdot (L) and the number of display lines Vline (L) of the layout frame.

Hdot (L) = X1−X0 Vline (L) = Y1−Y0 Also, the control section 260 controls the number of display dots Hdot (I) and the number of display lines Vlin of the input image from the image source 211.
Since e (I) is known, the scaling ratio of the input image to the layout frame can be calculated as follows.

Horizontal scaling factor = Hdot (L) / Hdot (I) (1) Vertical scaling factor = Vline (L) / Vline (I) (2) When the above magnification is larger than 1, magnification is smaller than 1. In this case, reduction magnification is equal to 1 and equal magnification is obtained. The scaling factors (1) and (2) are passed from the control unit 260 to the display format conversion unit 231. The input unit 221 outputs the image signal to the display format conversion unit 231 in a desired format. Display format converter 231
Passes image data when the scaling magnification is (1) = 1 and (2) = 1. (1) = 1 and (2)
If = 1, the image data is arbitrarily converted according to the calculated scaling factor, and the dots and lines of the input image are adjusted to the dots and lines of the layout frame. When the number of display colors input is larger than the number of display colors that can be displayed by the display device 313, the number of colors is determined by using an intermediate process such as dither (a method of expressing an intermediate gradation by combining white and black). Reduce the number of bits of image data.

The image data output from the display format converter 231 is transmitted to the bus interface 241, the bus controller 251, and the frame memory controller 270.
Is stored in the frame memory 290 via the. Also,
The storage location of the scaled data when stored in the frame memory 290 is determined by the control unit 260 passing the start point information (X0, Y0) to the frame memory controller 270 and generating a physical address to the frame memory in the frame memory controller 270. Correct starting point (X0, Y
0) by specifying an offset of minutes. The frame memory 290 has a plurality of layers, and the control unit 2
By the control of 60, the hierarchy for storing the image data input via the bus controller 250 is controlled.

The image data stored in the frame memory 290 is output to the bus at a certain timing controlled by the control unit 260, and is output to the output display format conversion unit 311. At this time, which layer of data to output is
The bus controller 250 controls according to the control of the control unit 260. With such internal processing, the display device 31
The display state of No. 3 is as shown in the input display state of FIG.
The input display in the target frame is realized.

<When Two or More Image Sources are Connected> Next, an example in which two or more image sources are connected to the multi-display system 331 will be described. In this example, a case where the image source 212 is connected while the image data of the image source 211 in FIG. 2 is being drawn will be described as an example. When the image data of the image source 211 is input, the input unit 221 detects the connection recognition signal and transmits the information to the control unit 260. When the control unit 260 recognizes the presence of the new second image source, the user can use the display pointer controller 321 to determine the layout display frame of the next input. This will be described below with reference to FIG.

As shown in FIG. 4 (e) layout frame display state,
When the user determines the start point (X2, Y2) and the end point (X3, Y3) (points indicated by reference numerals 432 and 433 in the drawing) by the above-described method so as not to overlap with the input 1-1, and determines the layout frame display. , As shown in FIG.
The image source of -2 is displayed on the screen of the display device 313 by the optimal scaling with respect to the input.
Is displayed with. However, as shown in the layout frame display state of FIG. 4F, the user sets the start point (X4, Y4) and the end point (X5,
Y5) (points indicated by reference numerals 434 and 435 in the figure) are determined, and when the layout frame display is determined, display states such as the input display state in FIG. 4H and the input display state in FIG.

FIG. 4 (h) shows the input display state when the user inputs 2.
It is an example of a display state when it is desired to superimpose and display a layout frame of -1 as determined above. In this case, the scaling method is the same as the method described above, but in this case, the priority of the superimposed display must be added. In this implementation method, a storage hierarchy of 1-1 and 1-2 image data stored in the frame memory 290 is set. The hierarchies of these frame memories 290 have priorities, and when outputting data of a plurality of hierarchies at the same position on the display device 313, the image data of the higher hierarchies is replaced with the other lower hierarchies. Is output to the output display format conversion unit 311 in preference to the data of. This priority can be arbitrarily determined by the user in accordance with an instruction from the display pointer controller 321 when the layout frame is determined.

FIG. 4 (i) shows the input display state when the user inputs 2
This is an example of a display state in a case where a layout frame of -1 is to be specified only for the size of the frame and not to be displayed in an overlapping manner. In this case, the scaling method is equivalent to the method described above,
In this case, the virtual space display must be taken into account. In this realizing method, the control unit 260 receives information on the capacity of the mounted memory detected by the frame memory controller 270, and can correspond to a virtual display that can be used from the used memory space of the input 1-1 and the used memory space of the input 1-2. By determining the space and where in the space the used memory space 1-1 or 1-2 is to be mapped by software or hardware, the control unit 260 sends the frame memory controller 270 to the frame memory. This can be realized by correcting the offset for the proper start point movement when generating the physical address.

In the first embodiment of the present invention, FIG.
(F) In the case of performing a layout such as a layout frame display state, that is, the control unit 260 sets the start point (X0, Y0) and end point (X1, Y1) of the input 1-1 and the start point (X4, X4) of the input 1-2. , Y4) and the end point (X5, Y5) are detected as follows: X0 <X4 <X1 <X5, Y4 <Y0 <Y1 <Y5.
As shown in FIG. 4 (j) message output state, the multi display system 331 displays a message indicated by reference numeral 436 on the display device, as shown in (h) input display state and FIG. 4 (i) input display state. 313 is displayed.

This can be realized by the control unit 260 issuing an instruction to the overlay data controller 280, writing output characters in the overlay data store memory 310, and functioning as an OSD (On Screen Display). The user sees this notification and can arbitrarily select one of them according to an instruction from the display pointer controller 321. In the above description, this notifying means corresponds to the overlay data store memory 31.
Although the means of character output display by 0 is used, the control unit 2
A unit may be used in which the voice data is generated by the speaker 60 and the voice is notified from the speaker 290.

As described above, according to the multi-display system according to the first embodiment of the present invention, a region on the screen of the display unit 101 for selecting an image input from an image source is selected. Selection means 102, communication means 104 for transmitting the selection information selected by the selection means 102 to the display device main body, detection means 105 for detecting the absolute position of the selected area on the screen of the display means 101, and input image data A display control unit for calculating a scaling ratio of the input image data to the display data based on the horizontal resolution / number of vertical lines and the display position information, scaling the input image to a size corresponding to the scaling ratio and displaying the input image; Therefore, the following functions and effects are exhibited.

A display device (selecting means 102) capable of designating a start point and an end point on a large screen display device and a display layout of a plurality of image sources, and an X-axis axis mounted on the large screen display device with the position of the pointing device. The position is determined by recognizing by the position sensor for detecting the direction and the position sensor (detecting means 105) for detecting the Y-axis direction, and the information is notified to the multi-display system, whereby the internal control circuit (display control means 106 ) Can be automatically and optimally mapped and displayed in the layout area determined above.

Therefore, in the multi-display system according to the first embodiment of the present invention, a layout in which the absolute position of the multi-input screen on the display was confirmed at the time of initial use of the system, which was not possible in the past. The work can be realized without complicated setting of the display driver. Accordingly, there is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation using a plurality of image sources.

[2] Second Embodiment Next, as a second embodiment of the present invention, a case in which the layout frame of the input image source laid out and displayed in the first embodiment is changed after it is determined Will be described below. There are two types of variable, an enlargement variable and a reduction variable.

The multi-display system 331 according to the second embodiment of the present invention comprises input units 221, 222, 223,
224, display format converters 231, 232, 23
3, 234, bus interfaces 241, 242, 24
3, 244, the bus controller 250, the control unit 260,
A frame memory controller 270, an overlay data controller 280, a frame memory 290, an overlay data store memory 310, an output display format converter 311, a display drive controller 312, a display device 313, a selector 314, a packet distribution controller 315,
Packet controller with FIFO memory 316, FIFO memory 317, infrared data converter 318, infrared data controller 319, infrared data receiver 320, display pointer controller 321, packet controller with FIFO 3
26, D / A converter 327, amplifier 328, speaker 3
29 (see FIG. 2 above). In the figure, reference numerals 211, 212, 213, and 214 indicate image signal sources.

The difference between the multi-display system according to the second embodiment of the present invention and the multi-display system according to the first embodiment is that the display pointer controller 3
21 is a confirmation control button 324 and a cancellation control button 32
5, in that a distance measuring sensor 539 is provided in addition to the infrared light emitting section 330 (see FIG. 5), and that the control section 260 has a moving distance / magnification reference table (see FIG. 6). The other configuration is the same as that of the first embodiment, and the description is omitted.

<When one of image sources is selected and enlarged>
An example in which the input image display after the layout display is enlarged will be described with reference to FIG. When the display image 1-2 is enlarged in the layout state displayed as in the initial display state of FIG. 5 (k), the user must first select the display image 1-2 (active state). Although several means are conceivable for this selection method, they are not limited here because they depart from the point of the present invention.

When enlarging the selected display image 1-2, the user measures the distance d0 between the display pointer controller 321 and the display device 313 by pressing the confirmation control button 324. This measuring method can be performed accurately and easily by the vector calculation of the position sensor 322 in the X-axis (horizontal axis) direction of the display device 313, the position sensor 323 in the Y-axis (vertical axis) direction, and the distance measurement sensor 539 of the display pointer controller 321. Since it can be obtained, there is no need for the user to specify the focus, such as when measuring the distance to a camera. As described in the first embodiment, the layout position of the input image source in this state is the starting point (X
0, Y0) and the end point (X1, Y1).

Next, the enlargement method will be described. In order to realize the enlargement of the selected image 1-2, the user holds down the determination control button 324 of the display pointer controller 321 in the above-described initial distance measurement step and presses the display pointer like the enlargement stroke indicated by reference numeral 537 in FIG. Pull the controller 321 toward you. During this movement, the distance d1 between the display pointer controller 321 and the display device 313 is measured by the above-described method, and the final distance d1 is determined by releasing the determination control button 324 by the user. During this enlargement stroke, the position of the display pointer from the start point to the end point is always monitored and the trajectory is displayed in a layout frame 332 as shown in FIG. As
The layout frame is displayed as shown in the layout frame display state of FIG.

Hereinafter, how to create the size of the final enlarged layout frame from the layout frame from the measured distance d1 will be described with reference to FIG. Measurement distance d
0 and d1 are the display pointer controller 32 of FIG.
The data is transferred to the control unit 260 by the infrared transmission unit (infrared light emitting unit 330) from step 1. The control unit 260 calculates the moving distance d1-d0 based on this information. In this enlarged example, d1-d0> 0 is a positive change. The enlargement ratio is determined based on the result. To realize this, the control unit 260 is provided with a reference table as shown in FIG. 6 in advance. This means that the horizontal axis is associated with the moving distance D, and the vertical axis is associated with the scaling factor M. When the moving distance is 0, the scaling factor is 1 ×,
If the moving distance is positive, the magnification changes accordingly to 1 or more.

The moving distance has converged to the maximum magnification ratio M (max) at a certain limit value D (max), and cannot be further expanded. The maximum magnification ratio M (max) is determined according to the relationship with the layout position of 1-2 peripheral input image (1-1 in this example) when JUST FIT is performed as shown in FIG. In the case of superimposed display as shown in FIG. 4 (h), the relationship with the display area, FIG.
When displaying in a virtual space as shown in FIG.
Can be set appropriately according to the relationship with the address map. If the moving distance is negative, the magnification area also changes to 1 or less correspondingly. The travel distance is a certain limit value D (mi
In n), it converges to the minimum magnification ratio M (min), and cannot be reduced any further. This minimum magnification ratio M (mi
n) is determined by the display format conversion unit 2 shown in FIG.
It is determined by a minimum scaling factor of 31 to 234.

According to the reference table described above, the moving distance d
The layout frame 1-2 at the time of 1-d0 is magnified m times, and in the example where the enlargement center is (X1, Y0) as shown in FIG. 5, the starting point is the same as (X1, Y0) before the enlargement. The end point is ((1-m) X1 + mX0, mY1 + (1-m) Y0)
5 (l), and is finally displayed as the enlarged display state of FIG. 5 (m) while drawing the layout frame locus of FIG. 5 (l).

<When one of image sources is selectively reduced>
An example in which the input image display after the layout display is reduced will be described with reference to FIG. The reduction means is the same as the enlargement means. In the layout state displayed as shown in FIG. 5 (m) initial display state (enlarged display state), when reducing the display image 1-2, the user first selects the display image 1-2 (active state). There must be. Although several means are conceivable for this selection method, they are not limited here because they depart from the point of the present invention. When reducing the selected display image 1-2, the user measures the distance d1 between the display pointer controller 321 and the display device 313 by pressing the confirmation control button 324.

Next, a reduction method will be described. In order to realize the reduction of the selected image 1-2, the user sets the display pointer by pressing the confirmation control button 324 of the display pointer controller 321 in the above-described initial distance measurement step as shown by a reduction stroke 538 in FIG. The controller 321 is pushed toward the display device 313. During this movement, the distance d0 between the display pointer controller 321 and the display device 313 is measured, and the final distance d0 is determined by releasing the determination control button 324 by the user. During this reduced stroke, the display pointer movement position from the start point to the end point is always monitored in order to make this work a more user-friendly user interface,
The locus is displayed as a layout frame indicated by reference numeral 332 in FIG. 5 as shown in the layout frame display state in FIG.

Hereinafter, how to create the size of the final reduced layout frame from the layout frame from the measured distance d0 will be described with reference to FIG. Measurement distance d
0 and d1 are the display pointer controller 32 of FIG.
The data is transferred to the control unit 260 by the infrared transmission unit (infrared light emitting unit 330) from step 1. The control unit 260 calculates the moving distance d0-d1 based on this information. In this enlarged example, a negative change s of d0−d1 <0 is obtained. The reduction ratio is determined based on this result. To realize this, a lookup table as shown in FIG. 6 is used in the same manner as in the case of the enlargement.

According to the reference table described above, the moving distance d
The layout frame 1-2 at the time of 0-d1 is reduced by m times, and in the example where the reduction center is (X1 ′, Y0 ′) as shown in FIG. 5, the starting point is (X1 ′, Y0 ′) before the enlargement. ), And the end point is ((1-1 / m) X1 '+ 1 / mX0', 1
/ MY1 '+ (1-1 / m) Y0'), and is finally displayed as the reduced display state in FIG. 5 (k) while drawing the layout frame trajectory in FIG. 5 (l).

As described above, according to the multi-display system according to the second embodiment of the present invention, the display means 1
01, a selection unit 102 for selecting one of the image data displayed on the display unit 01, a distance measurement unit 103 for measuring an absolute distance between the selection unit 102 and the selected image, and distance measurement information measured by the distance measurement unit 103. Communication means 104 for transmitting to the display device body
And the scaling ratio of the selected image data to the display data based on the difference of the moving distance of the selecting unit 102 measured by the distance measuring unit 103 and the horizontal resolution and the number of vertical lines of the selected image data. And the display control means 106 for calculating and using the reference table indicating the relationship, and for displaying the selected image by scaling it to the size corresponding to the scaling factor, has the following operations and effects.

A pointing device (selecting means 102) of the presenter is provided with a distance measuring sensor (ranging means 10).
3), the presenter generates a change in the distance between the target image source and the pointing device of the presenter by a stroke action in response to a scaling request of the image source when the system is used, so that an internal control circuit ( The display control unit 106) can enlarge or reduce the image source to an appropriate size by referring to the distance change information.

Therefore, in the multi-display system according to the second embodiment of the present invention, even if unexpected enlargement / reduction occurs at the time of using the presentation, the presenter can use the presentation for presentation. This request can be satisfied only by the stroke action of the display pointer. Accordingly, there is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation using a plurality of image sources.

The present invention may be applied to a system including a plurality of devices or to an apparatus including a single device. A storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or an apparatus, and a computer (or CPU or MPU) of the system or the apparatus executes the program code stored in the storage medium. Needless to say, this can also be achieved by executing the reading.

In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

Examples of a storage medium for supplying the program code include a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, and CD.
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

Further, when the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS and the like running on the computer are actually executed based on the instructions of the program code. It goes without saying that a part or all of the above-described processing is performed, and the functions of the above-described embodiments are realized by the processing.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0101]

As described above, according to the display device of the first aspect of the present invention, it is possible to simultaneously or independently display images input from a plurality of image sources. Means for selecting which area on the screen of the display means to display, detecting means for detecting an absolute position of the selected area on the screen, and input image data and the detected display position information. The display control means for scaling the input image to a predetermined size and displaying the input image has the following effects. At the time of initial use of the system, the layout work that confirmed the absolute position of the multi-input screen on the display unit was possible without the complicated setting of the display driver. There is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation.

According to a second aspect of the present invention, there is provided a display device having communication means for transmitting selection information by the selection means to a display device main body, wherein the display control means has a horizontal resolution and a vertical resolution of input image data. To calculate the scaling ratio of the input image data to the display data based on the number of lines and the detected display position information, and to display the input image by scaling the input image to a size corresponding to the scaling ratio, Effect. In the same way as described above, at the time of initial use of the system, layout work that confirmed the absolute position on the display of the multi-input screen can be realized without complicated setting of the display driver, which was impossible in the past. In a conference or presentation using the image source described above, a smooth and comfortable operation environment can be provided to the user.

According to the display device of the third aspect of the present invention, the selection means can designate one of the diagonal lines of the rectangular frame as a start point and the other point as an end point as a display selection range on the screen. Therefore, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the fourth aspect of the present invention, there is provided a storage device for storing a layout frame indicating a display selection range, wherein the display control device stores display screen data when displaying on the screen. Since the layout frame data is superimposed and displayed, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the fifth aspect of the present invention, when the display selection range is determined, the confirmation selection means for allowing the operator to confirm and select whether or not to display in the display selection range is provided. The following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the sixth aspect of the present invention, the confirmation selecting means is an On Screen Disp.
Because of the lay, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the present invention, since the confirmation selecting means is a voice information input / output means, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the present invention, the display control means determines the size of the display selection range when the display selection range overlaps the display area of another input image already displayed. Since the display position is shifted and displayed without changing, the following effects are obtained. As above,
In a meeting or presentation using a plurality of image sources, there is an effect that a smooth and comfortable operation environment can be provided to the user.

According to the display device of the present invention, when the display position is shifted and displayed, if the display position exceeds the boundary of the frame memory for the display screen, the display control means displays the virtual space. Therefore, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the present invention, the display control means can determine in which area of the virtual display space the used memory space of the input image is to be mapped. Effect. As above,
In a meeting or presentation using a plurality of image sources, there is an effect that a smooth and comfortable operation environment can be provided to the user.

According to the display device of the present invention, it is possible to simultaneously or independently display images input from a plurality of image sources, and to display a plurality of images displayed on a display means. Selecting means for selecting desired image data from the data, distance measuring means for measuring an absolute distance between the selecting means and the selected image, and display controlling means for scaling and displaying the selected image to a predetermined size based on the measurement Has the following effects. The presenter can respond to this request only with the stroke action of the selection means (display pointer) for the presentation, even if unexpected enlargement / reduction occurs at the time of using the presentation, which was conventionally impossible. In a conference or presentation using a plurality of image sources, a smooth and comfortable operation environment can be provided to the user.

According to a twelfth aspect of the present invention, there is provided the display device having communication means for transmitting the distance measurement information by the distance measuring means to a display device main body, wherein the display control means comprises a moving distance of the selecting means. And the horizontal resolution of the selected image data.
Since the scaling ratio of the selected image data to the display data is calculated based on the number of vertical lines, and the selected image is scaled to a size corresponding to the scaling ratio and displayed, the following effects are obtained. In the same way as above, the presenter can respond to this request only with the stroke action of the selection means (display pointer) for the presentation, even if unexpected enlargement / reduction occurs at the time of using the presentation, which was not possible in the past. As a result, there is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation using a plurality of image sources.

According to the display device of the present invention, the display control means calculates the scaling factor based on a lookup table indicating the relationship between the moving distance and the scaling factor. Effect. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the display device of the present invention, since the image source is a device such as a computer, a workstation, a digital television, and a video,
The following effects are obtained. In the case of displaying an image input from a device such as the computer, the workstation, the digital television, and the video, it was conventionally impossible.
During the initial use of the system, the layout work that confirms the absolute position of the multi-input screen on the display can be realized without complicated setting of the display driver, and even if unexpected enlargement / reduction occurs when using the presentation. ,
The presenter can respond to this request only by the stroke action of the selection means (display pointer) for the presentation, thereby providing a user with a smooth and comfortable operation environment in a meeting or presentation using a plurality of image sources. There is an effect that can be.

According to the display device of the present invention, since the selection means is equipped with the distance measuring means and transmits information to the display device main body by infrared rays through the communication means, the following means. The effect is as follows. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, there is provided an image display method applied to a display device which can simultaneously or independently display images input from a plurality of image sources, A selection step of using the selection means to select an area on the screen of the display means to be displayed, a detection step of detecting an absolute position of the selected area on the screen, input image data and the detected Display control step of scaling and displaying the input image to a predetermined size based on the displayed position information.
The following effects are obtained. At the time of initial use of the system, the layout work that confirmed the absolute position of the multi-input screen on the display unit was possible without the complicated setting of the display driver. There is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation.

According to the image display method of the present invention, there is provided a communication step of transmitting the selection information in the selection step to a display device main body. To calculate the scaling factor of the input image data to the display data based on the number of vertical lines and the detected display position information, and to scale and display the input image to a size corresponding to the scaling factor, It has the following effects. In the same way as described above, at the time of initial use of the system, layout work that confirmed the absolute position on the display of the multi-input screen can be realized without complicated setting of the display driver, which was impossible in the past. In a conference or presentation using the image source described above, a smooth and comfortable operation environment can be provided to the user.

According to the image display method of the present invention, in the selection step, one of the diagonal lines of the rectangular frame can be designated as a start point and the other point as an end point as a display selection range on the screen. Therefore, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, there is provided a storage step of storing a layout frame indicating a display selection range, wherein the display control step includes a step of storing display screen data at the time of display on the screen. And the layout frame data are displayed in a superimposed manner. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, when the display selection range is determined, there is a confirmation selection step for the operator to confirm and select whether or not to display in the display selection range. The following effects are obtained.
As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, in the confirmation selecting step, On Screen is selected.
Since the above-described confirmation and selection are performed using n Display, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, in the confirmation selecting step, the confirmation and selection are performed by using the audio information input / output means, so that the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, in the display control step, when the display selection range overlaps the display area of another input image already displayed, the display selection range is increased. Since the display position is shifted and displayed without changing the height, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to a twenty-fourth aspect of the present invention, in the display control step, when the display position is shifted and displayed, if the display position exceeds the boundary of the frame memory for the display screen, the virtual space To display
The following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, in the display control step, it is possible to determine in which area of the virtual display space the used memory space of the input image is mapped. It has the following effects. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, there is provided an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources. A selecting step of selecting desired image data from a plurality of image data displayed in the selecting means using a selecting means, a distance measuring step of measuring an absolute distance between the selecting means and the selected image, and selecting the selected image based on the measurement. And a display control step of scaling the display to a predetermined size for display. The presenter can respond to this request only with the stroke action of the selection means (display pointer) for the presentation, even if unexpected enlargement / reduction occurs at the time of using the presentation, which was impossible in the past. In a conference or presentation using a plurality of image sources, a smooth and comfortable operation environment can be provided to the user.

According to the image display method of the present invention, there is provided a communication step of transmitting the distance measurement information in the distance measurement step to a display device main body, and in the display control step, moving the selection means is performed. To calculate the scaling ratio of the selected image data to the display data based on the distance difference and the horizontal resolution and the number of vertical lines of the selected image data, and to scale and display the selected image to a size corresponding to the scaling ratio. The following effects are obtained.
In the same way as above, the presenter can respond to this request only with the stroke action of the selection means (display pointer) for the presentation, even if there is unexpected enlargement / reduction during the use of the presentation, which was not possible in the past. As a result, there is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation using a plurality of image sources.

[0128] According to the image display method of the present invention, in the display control step, the scaling magnification is calculated based on a reference table indicating a relationship between a moving distance and a scaling magnification. It has the following effects. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, since the image source is a device such as a computer, a workstation, a digital television, and a video, the following effects can be obtained. When displaying images input from devices such as the computer, workstation, digital television, and video, the absolute position of the multi-input screen on the display was confirmed during the initial use of the system, which was not possible in the past. The layout work can be realized without complicated setting of the display driver, and even if unexpected enlargement / reduction occurs during use of the presentation, the presenter can make this request only by the stroke action of the selection means (display pointer) for the presentation. Therefore, there is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation using a plurality of image sources.

According to the image display method of the present invention, since the information is transmitted by infrared rays to the display device main body via the communication step in the selecting step, the following effects are obtained. As described above, there is an effect that a smooth and comfortable operation environment can be provided to a user in a conference or presentation using a plurality of image sources.

According to the storage medium of the present invention, a program for executing an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources is stored. A storage medium readable by a computer, wherein the image display method comprises: a selection step of selecting, using a selection unit, an area on a screen of a display unit to display an input image; A detection step of detecting the absolute position above, and a display control step of scaling and displaying the input image to a predetermined size based on the input image data and the detected display position information. It works. At the time of initial use of the system, the layout work that confirmed the absolute position of the multi-input screen on the display unit was possible without the complicated setting of the display driver. There is an effect that a smooth and comfortable operation environment can be provided to the user in a conference or presentation.

According to the storage medium of the present invention, a program for executing an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources is stored. A storage medium readable by a computer, wherein the image display method includes a selection step of selecting desired image data from a plurality of image data displayed on a display unit using a selection unit,
Since the method includes a distance measuring step of measuring an absolute distance between the selecting unit and the selected image, and a display control step of scaling the selected image to a predetermined size based on the measurement and displaying the selected image, the following effects are obtained. Previously impossible,
In the event of unexpected enlargement / reduction during use of the presentation, the presenter can respond to this request only with the stroke action of the selection means (display pointer) for the presentation, thereby using a plurality of image sources. There is an effect that a smooth and comfortable operation environment can be provided to the user in a meeting or presentation.

[Brief description of the drawings]

FIG. 1 is a functional block diagram showing a configuration of a main part of a multi-display system according to first and second embodiments of the present invention and corresponding to the claims.

FIG. 2 is a block diagram showing a basic configuration of a multi-display system according to first and second embodiments of the present invention.

FIG. 3 is an explanatory diagram showing an image of creating a layout display frame using a position sensor in the X-axis direction and a position sensor in the Y-axis direction according to the first embodiment of the present invention.

FIG. 4 is an explanatory diagram showing an example of a display layout when a plurality of image sources are input according to the first embodiment of the present invention.

FIG. 5 is an explanatory diagram showing an image of a layout display frame change using a distance measuring sensor according to a second embodiment of the present invention.

FIG. 6 is an explanatory diagram showing a graph of a moving distance / magnification reference table according to a second embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 101 display means 102 selection means 103 distance measurement means 104 communication means 105 detection means 106 display control means 107 storage means 111-1 to 111-n, 211 to 214 image source 260 control unit 280 superimposition data controller 310 superimposition data store memory 311 Output display format converter 312 Display drive controller 313 Display device 319 Infrared data controller 320 Infrared data receiver 321 Display pointer controller 322, 323 Position sensor 330 Infrared light emitter

────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification symbol FI G09G 5/14 G06F 15/66 B (72) Inventor Shuntaro Araya 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc.

Claims (32)

[Claims] 1. A display device capable of simultaneously or independently displaying images input from a plurality of image sources, comprising: a selection unit that selects an area on a screen of a display unit to display an input image; Detecting means for detecting the absolute position of the selected area on the screen, and display control means for scaling and displaying the input image to a predetermined size based on the input image data and the detected display position information. A display device characterized by the above-mentioned. 2. A communication device for transmitting information selected by the selection device to a display device main body, wherein the display control device includes:
Calculate the scaling ratio of the input image data to the display data based on the horizontal resolution and the number of vertical lines of the input image data and the detected display position information, and scale the input image to a size corresponding to the scaling ratio. The display device according to claim 1, wherein the display device displays the image. 3. The display device according to claim 1, wherein the selection unit can designate one of the diagonal lines of the rectangular frame as a start point and the other point as an end point as a display selection range on the screen. Display device. 4. A storage unit for storing a layout frame indicating a display selection range, wherein the display control unit superimposes display screen data and layout frame data when displaying on the screen. Claims 1 to 3
The display device according to any one of the above. 5. The apparatus according to claim 1, further comprising a confirmation selection unit for allowing an operator to confirm and select whether or not to display in the display selection range when the display selection range is determined. The display device according to the above. 6. The On Screen, wherein said confirmation selecting means is an On Screen.
The display device according to claim 5, wherein the display device is an n Display. 7. The display device according to claim 5, wherein said confirmation selecting means is an audio information input / output means. 8. When the display selection range overlaps with the display area of another input image that is already displayed, the display control means shifts the display position without changing the size of the display selection range. The display device according to claim 1, wherein: 9. The display according to claim 8, wherein the display control means displays a virtual space when the display position is shifted and exceeds a boundary of a frame memory for a display screen. apparatus. 10. The display device according to claim 9, wherein said display control means is capable of determining in which area of the virtual display space the used memory space of the input image is mapped. 11. A display device capable of simultaneously or independently displaying images input from a plurality of image sources, a selection unit for selecting desired image data from the plurality of image data displayed on the display unit. A display device comprising: a distance measuring means for measuring an absolute distance between the selecting means and the selected image; and a display control means for scaling and displaying the selected image to a predetermined size based on the measurement. 12. A communication device for transmitting distance measurement information from the distance measurement unit to a display device main body, wherein the display control unit includes a difference between a moving distance of the selection unit and a horizontal resolution / vertical line of the selected image data. 12. The display device according to claim 11, wherein a scaling ratio of the selected image data to the display data is calculated based on the number, and the selected image is scaled to a size corresponding to the scaling ratio and displayed. 13. The display device according to claim 12, wherein the display control means calculates the scaling ratio based on a lookup table indicating a relationship between a moving distance and a scaling ratio. 14. The display device according to claim 1, wherein the image source is a device such as a computer, a workstation, a digital television, and a video. 15. The apparatus according to claim 1, wherein the selection unit is provided with the distance measurement unit and transmits information to a display device main body by infrared rays via the communication unit. Display device. 16. An image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources, wherein an input image is displayed on a screen of a display means. A selection step of selecting the selected area using a selection unit, a detection step of detecting an absolute position of the selected area on the screen, and a step of converting an input image into a predetermined size based on input image data and the detected display position information. A display control step of scaling and displaying the image. 17. A communication method for transmitting selection information from the selection step to a display device main body, wherein the display control step is based on horizontal resolution / number of vertical lines of input image data and the detected display position information. 17. The image display method according to claim 16, wherein a scaling ratio of the input image data to the display data is calculated, and the input image is scaled to a size corresponding to the scaling ratio and displayed. 18. The method according to claim 16, wherein in the selection step, one of a diagonal line of the rectangular frame as a starting point and the other point as an ending point can be designated as a display selection range on the screen. Image display method. 19. A storage step for storing a layout frame indicating a display selection range, wherein in the display control step, display screen data and layout frame data are superimposed and displayed at the time of display on the screen. The image display method according to any one of claims 16 to 18, wherein 20. The apparatus according to claim 16, further comprising a confirmation selection step for allowing an operator to confirm and select whether or not to display in the display selection range when the display selection range is determined. Image display method described. 21. In the confirmation selecting step, On S
21. The image display method according to claim 20, wherein the confirmation and the selection are performed by using a green display. 22. The image display method according to claim 20, wherein, in the confirmation selecting step, the confirmation and selection are performed using audio information input / output means. 23. In the display control step, when the display selection range overlaps with the display area of another input image already displayed, the display position is shifted and displayed without changing the size of the display selection range. 17. The method according to claim 16, wherein
23. The image display method according to any one of claims 21 to 22. 24. The image according to claim 23, wherein, in the display control step, when the display position is shifted and displayed, when the display position exceeds a boundary of a frame memory for a display screen, a virtual space display is performed. Display method. 25. The display control step according to claim 24, wherein it is possible to determine in which area of the virtual display space the used memory space of the input image is to be mapped.
Image display method described. 26. An image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources, the method comprising: displaying a desired image from a plurality of image data displayed on a display means. A selection step of selecting data using a selection unit; a distance measurement step of measuring an absolute distance between the selection unit and the selected image; and a display control step of scaling and displaying the selected image to a predetermined size based on the measurement. An image display method comprising: 27. A communication step for transmitting distance measurement information from the distance measurement step to a display device main body. In the display control step, a difference in a moving distance of the selection means and a horizontal resolution / vertical line of the selected image data are included. 27. The image display method according to claim 26, further comprising calculating a scaling ratio of the selected image data to the display data based on the number, scaling the selected image to a size corresponding to the scaling ratio, and displaying the selected image. 28. The image display method according to claim 27, wherein in the display control step, the scaling magnification is calculated based on a reference table indicating a relationship between a moving distance and a scaling magnification. 29. The image display method according to claim 16, wherein the image source is a device such as a computer, a workstation, a digital television, and a video. 30. The method according to claim 1, wherein in the selecting step and the distance measuring step, information is transmitted to a display device main body by infrared rays through the communication step.
30. The image display method according to any one of 6 to 29. 31. A computer-readable storage medium storing a program for executing an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources, An image display method, a selection step of selecting an area on the screen of the display means to display the input image using the selection means, and a detection step of detecting an absolute position of the selected area on the screen, A display control step of displaying the input image after scaling the input image to a predetermined size based on the input image data and the detected display position information. 32. A computer-readable storage medium storing a program for executing an image display method applied to a display device capable of simultaneously or independently displaying images input from a plurality of image sources, An image display method, a selecting step of selecting desired image data from a plurality of image data displayed on the display means using a selecting means, and a distance measuring step of measuring an absolute distance between the selecting means and the selected image; A display control step of scaling the selected image to a predetermined size based on the measurement and displaying the selected image.