WO2009131131A1

WO2009131131A1 - Display device and display method

Info

Publication number: WO2009131131A1
Application number: PCT/JP2009/057939
Authority: WO
Inventors: 卓司川村; 速人宇都宮
Original assignee: シャープ株式会社
Priority date: 2008-04-25
Filing date: 2009-04-21
Publication date: 2009-10-29

Abstract

Provided are a display device and a display method. A light reception position judgment unit (19) adds a value of a coordinate (X, Y) of the pixel having a light reception intensity judged to be greater than a predetermined value, to the N-th light reception data Lpos. An instruction pointer display data creation unit (20) judges the light reception color of the N-th light reception position according to the light reception data Lpos and the light reception color of each pixel data, and copies the basic coordinate data on the pointer size and the pointer shape corresponding to the judged light reception color to the coordinate data on the instruction pointer data. If the Lcolor corresponding to the light reception color is “3”, the light reception color of each pixel data is set as the color data on the instruction pointer data. If the Lcolor is smaller than “3”, the value of Lcolor is set to the color data on the instruction pointer data. A CPU (15) displays an instruction pointer of the color, the size, and the shape indicated by the instruction pointer, at the position indicated by the coordinate data.

Description

Display device and display method

The present invention relates to a display device and a display method capable of specifying the position of light irradiated on a screen by an indication device such as a laser pointer.
The present invention relates to a display device and a display method that use light emitted to a screen by a pointing device such as a laser pointer.

A presenter who makes a presentation using a large screen irradiates light such as a laser pointer to indicate the position in the image displayed on the screen, and a viewer who views the screen uses a laser pointer or the like irradiated on the screen. The position that the presenter wants to point to is recognized by the position of the light.
A pointing device described in Japanese Patent Application Laid-Open No. 2001-236181 takes a screen on which a pointing pointer is pointed by a laser pointer by a CCD camera, and recognizes a side of the screen in the image picked up by the CCD camera. The coordinate position of the pointing pointer is specified from the recognized position of the side of the screen. Therefore, the position pointed to by the laser pointer can be specified even if it is pointed from a position oblique to the screen.
An instruction information input device described in Japanese Patent Application Laid-Open No. 9-62444 takes a projection screen on which an image is displayed by a projector by a video camera, a video signal shot by the video camera, and a video signal being displayed The position of the light projected by the laser pointer is specified. Furthermore, the instruction information input device can perform an input operation similar to that of a mouse using the laser pointer when the color or brightness of the light projected by the laser pointer changes.
The viewing angle control display device described in JP-A-6-230896 displays different screens on the display device according to the angle between the viewer and the screen, and corresponds to each light emitting element constituting the screen. In addition, a light receiving element that selectively receives only light from an angle at which the screen by the light emitting element can be seen is provided. The viewing angle control display device receives light emitted from a laser pointer or the like by the light receiving element.
However, when light is emitted from a laser pointer or the like to a screen that the display device itself emits, such as a liquid crystal display, a person who looks at the screen can see the position where the light from the laser pointer is absorbed by the liquid crystal display. It may be difficult to distinguish. In the viewing angle control display device described in JP-A-6-230896, a light receiving element is provided for each light emitting element, and the light receiving element at the position irradiated with light by the laser pointer receives light. Although it is possible to accurately grasp the position where the light is irradiated, it is not possible to make it easy to understand the position where the light is irradiated to the person viewing the screen. The instruction information input device described in Japanese Patent Laid-Open No. 9-62444 can perform an input operation similar to that of a mouse by using the laser pointer by changing the color or brightness of the light projected by the laser pointer. However, it does not disclose how to perform the same operation as a mouse.

An object of the present invention is to provide a display device and a display method that can clearly indicate the position of light irradiated on a screen by an indication device that emits light.
Another object of the present invention is to provide a display device and a display method capable of performing control in accordance with light irradiated on a screen by an instruction device that emits light.
The present invention provides a display means comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
The display device includes a control unit that causes the display unit to display at least an image indicating a light detection position in accordance with the intensity of light detected by the detection unit.
According to the present invention, when an image is displayed on a display unit including a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each pixel, the control unit detects the image by the detection unit. In accordance with the intensity of the emitted light, an image showing at least the light detection position is displayed on the display means.
Therefore, the position of the light irradiated on the screen can be clearly indicated by the pointing device that emits light.
Further, the present invention is a display method for displaying an image on a display device including a plurality of pixels for displaying an image and a detection unit that detects the intensity of received light for each position.
And a first control step of displaying an image indicating a detection position in accordance with the intensity of light detected by the detection unit.
According to the present invention, when an image is displayed on a display device that includes a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each position, the first control step includes: An image indicating the detection position is displayed according to the intensity of light detected by the unit.
Therefore, if the display method according to the present invention is provided, the position of the light irradiated on the screen can be clearly indicated by the pointing device that emits light.
The present invention provides a display means comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
Discriminating means for discriminating a pattern in which the intensity of light detected by the detection unit changes;
When the pattern discriminated by the discriminating means is the first pattern, the symbol image of the first display form indicating the position where the light is detected by the detecting unit is displayed, and the pattern discriminated by the discriminating means is Control means for displaying a symbol image of a second display form different from the first display form and indicating the position when the second pattern is different from the first pattern. It is a display device.
According to the present invention, when displaying an image on a display unit including a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each of a plurality of positions, the detection unit includes the detection unit. When the pattern in which the intensity of the light detected by is changed is discriminated and the pattern discriminated by the discriminating unit is the first pattern by the control unit, the first position indicating the position where the light is detected by the detecting unit is determined. When a symbol image of one display form is displayed and the pattern discriminated by the discriminating means is a second pattern different from the first pattern, the position is different from the first display form and the position is A symbol image of the second display form shown is displayed.
Therefore, it is possible to clearly indicate each position on the screen instructed by a plurality of indicating devices that emit light having different patterns of varying light intensity.
Further, the present invention is a display method for displaying an image on a display device including a plurality of pixels for displaying an image and a detection unit that detects the intensity of received light for each position.
A determination step of determining a pattern in which the intensity of light detected by the detection unit changes;
When the pattern determined in the determination step is a first pattern, a symbol image of a first display form indicating a position where light is detected by the detection unit is displayed, and the pattern determined in the determination step is A second control step of displaying a symbol image of a second display form different from the first display form and indicating the position when the second pattern is different from the first pattern. This is a display method characterized by this.
According to the present invention, when an image is displayed on a display device that includes a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each position, in the determination step, the detection unit detects the image. The pattern in which the intensity of the emitted light changes is determined.
In the second control step, when the pattern determined in the determination step is the first pattern, a symbol image of the first display form showing the position where the light is detected by the detection unit is displayed. When the pattern discriminated in the discriminating step is a second pattern different from the first pattern, a symbol image of the second display form that is different from the first display form and indicates the position is displayed. To do.
Therefore, by providing the display method according to the present invention, it is possible to clearly indicate the positions on the screen instructed by a plurality of instruction devices that emit light having different light intensity patterns.
The present invention provides a display means comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
Range determining means for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
Position specifying means for specifying a position that is the center of each range for each range determined by the range determining means;
And a control unit that displays an image indicating the position specified by the position specifying unit.
According to the present invention, when an image is displayed on a display unit that includes a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each of a plurality of positions, the detection is performed by the range determination unit. A range in which the light intensity detected by the unit is greater than or equal to a predetermined reference intensity is determined, and a position that is the center of each range is specified for each range determined by the range determination unit by the position specifying unit, and control is performed. The means displays an image indicating the position specified by the position specifying means.
Therefore, even when using a pointing device that spreads light applied to the screen, such as a flashlight, it is possible to clearly indicate the position on the screen that the operator points with the pointing device.
The present invention is a display method for displaying an image on a display device including a plurality of pixels that display an image and a detection unit that detects the intensity of received light at a plurality of positions,
A range determining step for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
A first position specifying step for specifying a position at the center of each range for each range determined in the range determining step;
And a third control step for displaying an image indicating the position specified in the first position specifying step.
According to the present invention, when displaying an image on a display device including a plurality of pixels that display an image and a detection unit that detects the intensity of received light at each of a plurality of positions, the range determination step includes the detection A range in which the intensity of light detected by the unit is equal to or greater than a predetermined reference intensity is determined. In the first position specifying step, a position at the center of each range is specified for each range determined in the range determining step. In the third control step, an image indicating the position specified in the first position specifying step is displayed.
Therefore, if the display method according to the present invention is provided, the position on the screen indicated by the operator using the pointing device can be clearly indicated even when using a pointing device that spreads the light irradiated on the screen, such as a flashlight. Can do.
The present invention provides a display means comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
Range determining means for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
Position specifying means for specifying, for each of the determined ranges, a position where the intensity of light is detected most strongly within the range determined by the range determining means;
And a control unit that displays an image indicating the position specified by the position specifying unit.
According to the present invention, when an image is displayed on a display unit that includes a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each of a plurality of positions, the detection is performed by the range determination unit. A range in which the light intensity detected by the unit is equal to or greater than a predetermined reference intensity is determined, and the position specifying unit determines the position having the strongest light intensity in the range determined by the range determining unit. An image that is specified for each determined range and that indicates the position specified by the position specifying means is displayed by the control means.
Therefore, even when using a pointing device that spreads light applied to the screen, such as a flashlight, it is possible to clearly indicate the position on the screen that the operator points with the pointing device.
Further, the present invention is a display method for displaying an image on a display device including a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
A range determining step for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
A second position specifying step for specifying, for each of the determined ranges, a position having the strongest light intensity within the range determined in the range determining step;
And a fourth control step for displaying an image indicating the position specified in the second position specifying step.
According to the present invention, when displaying an image on a display device including a plurality of pixels that display an image and a detection unit that detects the intensity of received light at each of a plurality of positions, the range determination step includes the detection A range in which the intensity of light detected by the unit is equal to or greater than a predetermined reference intensity is determined. In the second position specifying step, a position having the strongest light intensity is specified for each determined range within the range determined in the range determining step. In the fourth control step, an image indicating the position specified in the second position specifying step is displayed.
Therefore, if the display method according to the present invention is provided, the position on the screen indicated by the operator using the pointing device can be clearly indicated even when using a pointing device that spreads the light irradiated on the screen, such as a flashlight. Can do.
The present invention provides a display means comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
Discriminating means for discriminating a pattern in which the intensity of light detected by the detection unit changes;
When the pattern discriminated by the discriminating means is the first pattern, the first control is performed on the display image, and the pattern discriminated by the discriminating means is different from the first pattern. And a control means for performing second control on the display image.
According to the present invention, when an image is displayed on a display unit including a plurality of pixels that display an image and a detection unit that detects the intensity of received light at each of a plurality of positions, the detection unit performs the detection. When the pattern in which the intensity of the light detected by the unit changes is determined and the pattern determined by the determining unit is the first pattern, the first control is performed on the display image. When the pattern determined by the determining unit is a second pattern different from the first pattern, the second control is performed on the display image.
Therefore, it is possible to perform control on the display image according to the pattern in which the intensity of light changes, for example, according to the light irradiated on the screen by the pointing device that emits light.
Further, the present invention is a display method for displaying an image on a display device including a plurality of pixels for displaying an image and a detection unit that detects the intensity of received light for each position.
A determination step of determining a pattern in which the intensity of light detected by the detection unit changes;
When the pattern determined in the determination step is the first pattern, the first control is performed on the display image, and the pattern determined in the determination step is different from the first pattern. And a fifth control step of performing second control on the display image.
According to the present invention, when an image is displayed on a display device that includes a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each position, in the determination step, the detection unit detects the image. The pattern in which the intensity of the emitted light changes is determined. In the fifth control step, when the pattern determined in the determination step is the first pattern, the first control is performed on the display image, and the pattern determined by the determination unit is the first pattern. When the second pattern is different from the first pattern, the second control is performed on the display image.
Therefore, if the display method according to the present invention is applied, control according to the light irradiated on the screen by the pointing device that emits light, for example, control on the display image according to the pattern in which the light intensity changes. Can do.
The present invention provides a display means comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at a plurality of positions,
A shape discriminating means for discriminating a shape formed by a reference position detected as a light intensity detected by the detection unit equal to or higher than a predetermined reference intensity;
And a control unit configured to perform predetermined control on the display image in accordance with the shape determined by the shape determination unit.
According to the present invention, the display unit includes a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light at each of a plurality of positions, and the shape determination unit detects the detection unit by the detection unit. The shape formed by the reference position detected with the intensity of the emitted light being equal to or higher than a predetermined reference intensity is determined, and the control unit determines the shape for the display image according to the shape determined by the shape determination unit. Predetermined control is performed.
Therefore, it is possible to perform control in accordance with the light irradiated on the screen by the pointing device that emits light, for example, the shape formed on the screen by the light.
Further, the present invention is a display method for displaying an image on a display device including a plurality of pixels for displaying an image and a detection unit that detects the intensity of received light for each position.
A shape discriminating step for discriminating a shape formed by a reference position detected as a light intensity detected by the detection unit equal to or greater than a predetermined reference intensity;
And a sixth control step for performing a predetermined control on the display image in accordance with the shape determined in the shape determination step.
According to the present invention, when displaying an image on a display device that includes a plurality of pixels that display an image and a detection unit that detects the intensity of received light for each position, the shape determination step includes: The shape formed by the reference position detected when the detected light intensity is greater than or equal to a predetermined reference intensity is determined. In the sixth control step, predetermined control is performed on the display image in accordance with the shape determined in the shape determination step.
Therefore, by applying the display method according to the present invention, it is possible to perform control according to the light irradiated on the screen by the pointing device that emits light, for example, the shape formed on the screen by the light.

Objects, features, and advantages of the present invention will become more apparent from the following detailed description and drawings.
It is a figure which shows the structure of the display apparatus which is the 1st Embodiment of this invention. It is a figure which shows the example of the screen irradiated with the light of the light emission instruction | indication apparatus. It is a figure which shows the example of the instruction | indication pointer displayed on the position where light was irradiated. It is a figure which shows the example of the instruction | indication pointer displayed on the position where light was irradiated. It is a figure which shows the example of the instruction | indication pointer displayed on the position where light was irradiated. It is a figure which shows the example of the instruction | indication pointer displayed on the position where light was irradiated. It is a figure which shows the example of the instruction | indication pointer when the irradiated light has a breadth. It is a figure which shows the example of the instruction | indication pointer when the irradiated light has a breadth. It is a figure which shows the example of the instruction | indication pointer when the irradiated light has a breadth. It is a figure which shows the example of the screen irradiated with the light of two types of light emission instruction | indication apparatuses from which the color of the light to irradiate differs. It is a figure which shows the example of the screen irradiated with the light of two types of light emission instruction | indication apparatuses from which the color of the light to irradiate differs. It is a figure which shows the example of the screen irradiated with the light of two types of light emission instruction | indication apparatuses from which an emission pattern differs. It is a flowchart which shows an example of the 1st display process which a central processing part performs. It is a flowchart which shows an example of the 2nd display process which a central processing part performs. It is a flowchart which shows an example of the light reception location search process called from a 2nd display process. It is a flowchart which shows an example of the instruction | indication pointer data creation process called from a 2nd display process. It is a flowchart which shows an example of the instruction | indication pointer display process called from a 2nd display process. It is a flowchart which shows an example of the 3rd display process which a central processing part performs. It is a flowchart which shows an example of the light reception location search process called from a 3rd display process. It is a flowchart which shows an example of the instruction | indication pointer data creation process called from a 3rd display process. It is a flowchart which shows an example of the instruction | indication pointer display process called from a 3rd display process. It is a flowchart which shows an example of the 4th display process which a central processing part performs. It is a flowchart which shows an example of the light reception location search process called from the 4th display process. It is a flowchart which shows an example of the instruction | indication pointer data creation process called from a 4th display process. It is a flowchart which shows an example of the instruction | indication pointer display process called from a 4th display process. It is a flowchart which shows an example of the setting process which a central processing part performs. It is a figure which shows the structure of the display apparatus which is the 2nd Embodiment of this invention. It is a flowchart which shows an example of the 5th display process which a central processing part performs. It is a flowchart which shows an example of the light reception location search process called from the 5th display process. It is a flowchart which shows an example of the instruction | indication pointer data creation process called from the 5th display process. It is a flowchart which shows an example of the instruction | indication pointer display process called from the 5th display process. It is a flowchart which shows an example of the command processing which a video production | generation apparatus central processing part performs. It is a figure which shows the structure of the display apparatus which is the 3rd Embodiment of this invention. It is a figure which shows the example of the shape of the light irradiated by the light emission instruction | indication apparatus. It is a figure which shows the example of the shape of the light irradiated by the light emission instruction | indication apparatus. It is a figure which shows the example of the shape of the light irradiated by the light emission instruction | indication apparatus. It is a figure which shows the example of the shape of the light irradiated by the light emission instruction | indication apparatus. It is a figure which shows an example of the display image with which the light of dot shape is irradiated to the panel. It is a figure which shows an example of the display image displayed when the shape of light is a horizontally long shape. It is a figure which shows an example of the display image displayed when the shape of light is a vertically long shape. It is a figure which shows an example of the display image displayed when the shape of light is a circle shape. It is a flowchart which shows an example of the 6th display process which a central processing part performs. It is a flowchart which shows an example of the light reception location search process called from the 6th display process. It is a flowchart which shows an example of the instruction | indication pointer data creation process called from the 6th display process. It is a flowchart which shows an example of the instruction | indication pointer display process called from the 6th display process. It is a flowchart which shows an example of the shape determination process called from an instruction pointer data creation process. It is a flowchart which shows an example of the command processing which a video production | generation apparatus central processing part performs.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a display device 1 according to the first embodiment of the present invention. The display device 1 includes a display device 10 and a light emission instruction device 30. The display method according to the present invention is processed by the display device 10.
The display device 10 includes N video input terminals 11, a display / display processing temporary storage unit 12, a photosensor built-in display device 13, a display processing unit 14, a central processing unit 15, an internal storage unit 16, a remote control ( The light receiving unit 17, the remote control processing unit 18, the light receiving location determination unit 19, the instruction pointer display data creation unit 20, and the light reception waveform determination unit 21 are included.
The video input terminal 11 receives a video signal output from a video generation device (see, for example, the element 50 in FIG. 21 and the element 50A in FIG. 27) described later, which includes a personal computer (hereinafter referred to as “PC”). N input terminals are provided. N is a natural number. Video signals input from the video input terminals 11 are sent to the display / display processing temporary storage unit 12. The display / display processing temporary storage unit 12 is a writable and readable storage device composed of a semiconductor memory, a hard disk device, or the like, and includes image information representing a video signal received from the video input terminal 11 and a central processing unit 15. To store image information on which display processing and display processing are performed. The image information stored in the display / display processing temporary storage unit 12 can be read from the display processing unit 14 and the central processing unit 15.
The display device 13 with a built-in photosensor serving as a display means is a liquid crystal display in which a plurality of pixels constituting a display image and a photosensor serving as a detection unit for detecting the intensity and color of received light are built for each pixel. . Furthermore, the display device 13 with a built-in photosensor is provided with a photosensor for each of the red, green, and blue sub-pixels constituting each pixel, and the color of the received light can be detected for each pixel. The photosensor built-in display device 13 displays the image information received from the display processing unit 14, and the light intensity (hereinafter referred to as "light reception intensity") detected by each photosensor for each pixel and color (hereinafter referred to as "light reception"). Color ”) to the central processing unit 15.
The display processing unit 14 converts the image information read from the display / display processing temporary storage unit 12 into a format instructed by the central processing unit 15, for example, a format that can be displayed by the optical sensor built-in display device 13. It is sent to the display device 13 with a built-in optical sensor and displayed.
The central processing unit 15 includes a central processing unit (hereinafter referred to as “CPU”) and a memory that stores a control program for controlling the display device 10, and the CPU executes the control program stored in the memory to execute the optical program. The sensor built-in display device 13, the display processing unit 14, and the remote control processing unit 18 are controlled. The central processing unit 15 is a determination unit, a determination unit, a range determination unit, a position specifying unit, and a control unit. The central processing unit 15 is an LSI (Large Scale Integration) FPGA (Field Programmable Gate Array) that can be programmed instead of the CPU and memory, and an ASIC that is an integrated circuit designed and manufactured for a specific application. (Application Specific Integrated
Circuit), or a circuit having other arithmetic functions.
The internal storage unit 16 is configured by a storage device such as a writable and readable semiconductor memory, and stores control information 161 used when the central processing unit 15 executes a control program. The control information 161 includes, for example, a received light color representing the color of the received light, a received light intensity representing the intensity of the received light, a received light number representing the number of received light, a pointer shape representing the shape of the pointing pointer, and an pointing pointer Information such as a pointer display color representing the color of the pointer, a pointer size representing the size of the pointing pointer, a pointer display position representing the center position of the pointing pointer display, and a pointer display standard representing the reference of the display position of the pointing pointer.
The number of received light is the number of light receiving portions that receive light, and is the number that matches the number of light emission instruction devices 30 that are irradiating light if the light is not overlapping. The light receiving location is a pixel group including at least one pixel irradiated with light by the light emission instruction device 30. The instruction pointer which is a symbol image is an image for clearly indicating the position where light is emitted by the light emission instruction device 30 and indicates the position of the representative point of the light receiving location. The pointer display reference indicates whether the center position of the light receiving location is the reference or the brightest position of the light receiving location is the reference. That is, it is a reference whether the representative point is the center position of the light receiving location or the brightest position of the light receiving location.
The remote control light receiving unit 17 receives light from a remote controller (not shown) that transmits information for operating the display device 10 to the display device 10, converts the received light into an electrical signal, and sends the electrical signal to the remote control processing unit 18. The remote control processing unit 18 converts the electrical signal received from the remote control light receiving unit 17 into information instructed from the remote control and sends the information to the central processing unit 15.
The light receiving location determination unit 19, the instruction pointer display data creation unit 20, and the light reception waveform determination unit 21 are functions realized by the central processing unit 15 executing a control program. The light receiving location determination unit 19 determines the location of the light applied to the display device 13 with a built-in optical sensor. Specifically, the light receiving location determination unit 19 receives the intensity of received light from the optical sensor of the display device 13 with a built-in optical sensor equal to or higher than a predetermined reference intensity, for example, 128 or more pixels in 256 levels from 0 to 255, or A range in which the plurality of pixels are adjacent to each other is determined as a light receiving location where the light emitted from the light emission instruction device 30 is received.
The instruction pointer display data creation unit 20 determines the position where the instruction pointer is displayed for the light receiving location determined to be receiving light by the light receiving location determination unit 19 and creates the instruction pointer data representing the instruction pointer. . The received light waveform determination unit 21 determines an emission pattern of light emitted from the light emission instruction device 30. Specifically, the light reception waveform determination unit 21 continuously receives light received from the optical sensor of the display device 13 with a built-in optical sensor when the received light intensity is equal to or greater than a predetermined reference intensity for a predetermined period, for example, a period of 2 milliseconds. It is determined that the output pattern is a pulse-shaped output pattern when a state that is greater than or equal to a predetermined reference intensity and a state that is less than a predetermined reference intensity are repeated in a predetermined period. The pulse-shaped emission pattern can be used as a plurality of emission patterns by changing the frequency, pulse width, pulse interval, and the like of repeated pulses and combining them. The continuous emission pattern is the first pattern, and the pulsed emission pattern is the second pattern.
The light emission instruction device 30 is an instruction device that indicates a position by irradiating a screen with light such as a laser pointer, an LED (Light Emitting Diode), or a flashlight. The light emission instructing device 30a includes a light emitting unit 31 that emits light. The light emission instructing device 30b includes an intermittent driving unit 32 that emits light in a pulse shape in addition to the light emitting unit 31, and the light emission instructing device 30c includes In addition to the light emitting unit 31 and the intermittent driving unit 32, a button 33 for switching whether to emit light in a pulsed manner or continuously is included.
FIG. 2 is a diagram illustrating an example of the screen 40 irradiated with light from the light emission instruction device 30. The light emission instruction device 30 shown in FIG. 2 is an instruction device having a small focal spread, such as a laser pointer, and a laser beam 39 from the light emission instruction device 30 is irradiated on a region 41 of a screen 40 where a person image is displayed. ing. A screen 41 drawn to the right side of the screen 40 is an enlarged screen so that each of the pixels 42 can be seen. The screen 41 is irradiated with a laser pointer irradiation spot irradiated with a person display image 43 and a laser beam 39. 44 is shown.
Each pixel 42 includes a red sub-pixel 421, a green sub-pixel 422, and a blue sub-pixel 423, and each pixel 42 is provided with a photosensor 46. The optical sensor 46 includes three optical sensors 461 to 463 that detect color and an optical sensor (not shown) that detects the intensity of light. The optical sensor 461 detects red, the optical sensor 462 detects green, and the optical sensor 463 detects blue.
3A to 3D are diagrams illustrating examples of instruction pointers displayed at positions where light is irradiated. FIG. 3A shows an enlarged screen 41a that displays an instruction pointer 45a in which the position indicated by the laser beam 39 irradiating light is indicated in red. FIG. 3B shows an enlarged screen 41b displaying an instruction pointer 45b in which the position indicated by the laser beam 39 irradiated with light is represented by 3 × 3 white pixels. FIG. 3C shows an enlarged screen 41c that displays an instruction pointer 45c in which a position indicated by the laser beam 39 irradiated with light is represented by a 5 × 5 green pixel. The instruction pointer 45c is an instruction pointer that is larger than the instruction pointer 45b illustrated in FIG. 3B. FIG. 3D shows an enlarged screen 41d that displays an instruction pointer 45d that indicates the position indicated by the laser beam 39 irradiated with light in the shape of a red arrow. The tip of the arrow indicates the position of the pixel at the center of the pixel being irradiated with light, for example.
4A to 4C are diagrams showing examples of instruction pointers when the irradiated light has a spread. FIG. 4A shows that light from the flashlight is radiated to a wide area 44e. In FIG. 4A, the intensity of light emitted from the flashlight is stronger toward the center of the region 44e. The instruction pointer display data creation unit 20 determines the position of the pixel at the center of the area 44e or the position of the pixel having the strongest light reception among the pixels included in the area 44e as the position for displaying the instruction pointer. FIG. 4B shows an enlarged screen 41f displaying a red instruction pointer 45f at a position determined by the instruction pointer display data creation unit 20, and FIG. 4C shows a red arrow at a position determined by the instruction pointer display data creation unit 20. An enlarged screen 41g displaying a shape instruction pointer 45g is shown.
5A and 5B are diagrams showing examples of a screen 40h irradiated with light from two types of light

emission instruction devices

30a and 30b having different colors of light to be irradiated. The light

emission instruction devices

30a and 30b are both configured by a laser pointer, the light emission instruction device 30a emits a red laser beam, and the light emission instruction device 30b emits a yellow laser beam. FIG. 5A shows that the screen 40h is irradiated with a red laser beam from the light emission instruction device 30a and a yellow laser beam from the light emission instruction device 30b. The enlarged screen 41h shows the pixels 45h1 and 45h2 irradiated with the respective laser beams. In FIG. 5B, a square red instruction pointer 45j1 composed of 3 × 3 pixels is displayed at the position where the red laser beam from the light emission instruction device 30a is irradiated, and the yellow laser beam from the light emission instruction device 30b is irradiated. This indicates that a pointer 45j2 in the shape of a yellow arrow is displayed at the position where it is displayed.
FIG. 6 is a diagram illustrating an example of a screen 40k irradiated with light from two types of light

emission instruction devices

30c and 30d having different emission patterns. The light

emission instruction devices

30c and 30d are both configured by a laser pointer. The light emission instruction device 30c irradiates a laser beam with a continuous emission pattern, and the light emission instruction device 30d irradiates the laser beam with a pulsed emission pattern. FIG. 6 shows that the laser beam from the light emission instructing device 30c and the laser beam from the light emission instructing device 30d are irradiated on the screen 40k, and the enlarged screen 41k is irradiated with the respective laser beams. Pixels 45k1 and 45k2 are shown.
In the example illustrated in FIG. 6, the received light waveform determination unit 21 determines that the received light intensity received from the optical sensor of the pixel 45k1 is equal to or higher than a predetermined reference intensity for a predetermined period, and thus is a continuous emission pattern. Since the state where the intensity of light received from the photosensor of the pixel 45k2 is equal to or higher than the predetermined reference intensity and the state where it is lower than the predetermined reference intensity are repeated in a predetermined period, it is determined to be a pulsed emission pattern.
The variables used in the flowcharts of FIGS. 7 to 12 include the number of received light Lcount, the pointer size Lsize, the pointer display color Lcolor, the pointer shape Lpattern, the pointer display reference Lbase, the received light color PixelColor, the received light intensity PixelValue, and the coordinate data of the received light location. There are variables of Lpos and instruction pointer data PointInf.
The number of received light Lcount is the number of light receiving portions that receive light. When the portion irradiated with light is composed of a plurality of adjacent pixels, one unit is counted as one location. The variable Lcount is an integer from 0 to LMAX, and LMAX is the maximum number of received light colors, for example, “3”.
The pointer size Lsize is a value indicating the size of the pointer, and when the value is “0”, it indicates a large size, and when the value is “1”, it indicates an intermediate size and the value is “2”. If present, it represents a small size. The pointer display color Lcolor is a value indicating the color of the pointer, and when the value is “0”, it indicates red, when the value is “1”, it indicates green, and when the value is “2”. Represents blue, and a value of “3” represents the received color. The pointer shape Lpattern is a value representing the shape of the pointing pointer. When the value is “0”, it represents a quadrangle. When the value is “1”, it represents a circle, and when the value is “2”, Represents an arrow.
The pointer size Lsize, the pointer display color Lcolor, and the pointer shape Lpattern can be set for each K, for example, three, that is, for each received color. When distinguishing each, Lsize [K], Lcolor [K], and Lpattern [K]. Hereinafter, the data of the pointer size Lsize, the pointer display color Lcolor, and the pointer shape Lpattern are also referred to as basic coordinate data. The pointer size Lsize, the pointer display color Lcolor, and the pointer shape Lpattern are display forms determined in advance.
The pointer display reference Lbase is indicated when the irradiated light has a spread like light emitted by a flashlight or the like, that is, when the portion irradiated with light is composed of a plurality of adjacent pixels. The position at which the pointer is displayed is based on the position of the center of the area where the light is irradiated (hereinafter referred to as “center reference”), or the position of the pixel where the intensity of the irradiated light is the strongest (referred to below) The value is “0”, indicating that the central reference is used, and if the value is “1”, the brightness is indicated. .
The light reception color PixelColor and the light reception intensity PixelValue are pixel data representing the light reception color and the light reception intensity of the received light for each pixel. The light receiving color PixelColor is composed of three elements corresponding to the red sub-pixel, the green sub-pixel, and the blue sub-pixel, and is expressed by 256 levels of gradation from “0” to “255”, respectively. The pixel data of each pixel is composed of four elements: the gradation of the red sub-pixel, the gradation of the green sub-pixel, the gradation of the blue sub-pixel, and the intensity of light reception. Among the four elements, the gradation of the red subpixel, the gradation of the green subpixel, and the gradation of the blue subpixel are pixel data of the light reception color PixelColor, and the light reception intensity is the light reception intensity. PixelValue pixel data.
The screen of the display device 13 with a built-in photosensor is composed of M pixels in the horizontal direction and N pixels in the vertical direction, and the position of each pixel is represented by XY coordinates with the upper left pixel as the origin toward the screen. For example, pixel data of a pixel having an XY coordinate of (0, 0) is (255, 255, 255, 255), and pixel data of a pixel having an XY coordinate of (0, 1) is (255, 250, 255). 252), the pixel data of the pixel with the XY coordinates (100, 200) is (120, 100, 200, 180), and the pixel data of the pixel with the XY coordinates (100, 201) is (122, 98, 210, 190), the pixel data of the pixel whose XY coordinates are (M-1, N-2) is (0, 0, 0, 0), and the XY coordinates are (M-1, N-). The pixel data of the pixel 1) is (0, 0, 0, 0). When the light reception color and light reception intensity of each pixel are expressed, they are expressed as PixelColor [x, y] and PixelValue [x, y], respectively, using the XY coordinates of each pixel.
The coordinate data (hereinafter also referred to as “light reception data”) Lpos of the light receiving location represents the coordinates of each pixel included in the light receiving location for each light receiving location. The instruction pointer data PointInf is data representing the XY coordinates, color, size, and shape for displaying the instruction pointer for each light receiving location. The setting of the variables of the pointer size Lsize, the pointer display color Lcolor, the pointer shape Lpattern, and the pointer display reference Lbase will be described in detail in the setting process shown in FIG.
FIG. 7 is a flowchart illustrating an example of the first display process performed by the central processing unit 15. The first display process is a process of displaying an instruction pointer having the same color as the color of the received light, that is, the received light color, on the pixel that has received the light. After the central processing unit 15 instructs the display processing unit 14 to display the image information stored in the display / display processing temporary storage unit 12 on the optical sensor built-in display device (hereinafter also referred to as “panel”) 13. The process proceeds to Step A1.
In step A1, the data for each pixel detected by each photosensor, specifically the light reception color and the light reception intensity data, are obtained from the panel 13, and set to the light reception color PixelColor and the light reception intensity PixelValue for each pixel. To do. In step A2, initialization is performed by substituting “0” into variables X and Y, respectively. The values of the variables X and Y are natural numbers. In step A3, it is determined whether or not the value of the variable Y is less than the vertical resolution of the panel 13, that is, the number of pixels in the vertical direction of the screen. If the value of Y is less than the vertical resolution of the panel 13, the process proceeds to step A4. If the value of Y is equal to or greater than the vertical resolution of the panel 13, the first display process is terminated.
In step A4, “0” is substituted into the variable X for initialization. In step A5, it is determined whether or not the value of the variable X is less than the horizontal resolution of the panel 13, that is, the number of pixels in the horizontal direction of the screen. If the value of the variable X is less than the horizontal resolution of the panel 13, the process proceeds to step A6, and if the value of the variable X is equal to or greater than the horizontal resolution of the panel 13, the process proceeds to step A10. In step A6, the PixelValue of the pixel at the coordinate (X, Y), that is, the intensity of light reception is acquired. In step A7, it is determined whether or not the acquired value of PixelValue is greater than a predetermined value, for example, the above-described predetermined reference intensity, that is, whether or not light is irradiated. If the value of PixelValue is greater than the predetermined value, the process proceeds to step A8, and if the value of PixelValue is not greater than the predetermined value, the process proceeds to step A9.
In step A8, the pixel at the coordinate (X, Y) is displayed in the PixelColor of the coordinate (X, Y), that is, the received light color. Specifically, the central processing unit 15 sets the pixel color at the coordinates (X, Y) to the PixelColor at the coordinates (X, Y) in the image information stored in the display / display processing temporary storage unit 12. That is, it is replaced with the color of the received light color. The display processing unit 14 reads the image information in which the color of the pixel at the coordinates (X, Y) is rewritten from the display / display processing temporary storage unit 12, converts the image information into a predetermined format, and displays the information on the panel 13. In step A9, “1” is added to the variable X, and the process returns to step A5. In Step A10, “1” is added to the variable Y, and the process returns to Step A3.
FIG. 8 is a flowchart illustrating an example of the second display process performed by the central processing unit 15. The second display process is a process of displaying an instruction pointer having a preset color and shape at the position of the light receiving portion that has received the light. After the central processing unit 15 instructs the display processing unit 14 to display the image information stored in the display / display processing temporary storage unit 12 on the panel 13, the process proceeds to step B1.
In step B1, data for each pixel detected by each photosensor, specifically, light reception color and light reception intensity data is acquired from the panel 13 and set to the light reception color PixelColor and the light reception intensity PixelValue for each pixel. To do. In step B2, a light receiving location search process is performed. In step B3, instruction pointer data creation processing is performed. In step B4, an instruction pointer display process is performed, and the process returns to step B1.
FIG. 9 is a flowchart illustrating an example of a light receiving location search process called from the second display process. The light receiving location searching process is executed by the light receiving location determining section 19, and when the light receiving location determining section 19 is called from the second display process shown in FIG. 8, the process proceeds to step C1.
In step C1, initialization is performed by substituting “0” into the variables X and Y and the variable Lcount of the number of received light. In step C2, it is determined whether or not the value of the variable Y is less than the vertical resolution of the panel 13, that is, the number of pixels in the vertical direction of the screen. If the value of Y is less than the vertical resolution of the panel 13, the process proceeds to step C3, and if the value of Y is equal to or greater than the vertical resolution of the panel 13, the received light spot search process is terminated. In step C3, initialization is performed by substituting “0” into the variable X. In step C4, it is determined whether or not the value of the variable X is less than the horizontal resolution of the panel 13, that is, the number of pixels in the horizontal direction of the screen. If the value of the variable X is less than the horizontal resolution of the panel 13, the process proceeds to step C5. If the value of the variable X is equal to or greater than the horizontal resolution of the panel 13, the process proceeds to step C13.
In Step C5, PixelValue of the pixel at the coordinate (X, Y), that is, the intensity of light reception is acquired. In step C6, it is determined whether or not the acquired PixelValue value is greater than a predetermined value, that is, the predetermined reference intensity, that is, whether or not light is irradiated. If the value of PixelValue is greater than the predetermined value, the process proceeds to step C7, and if the value of PixelValue is not greater than the predetermined value, the process proceeds to step C11. In Step C7, initialization is performed by substituting “0” into a variable N which is a light reception data counter.
In step C8, it is determined whether or not the value of the variable N is less than the value of Lcount, that is, the number of received light that has already been detected. If the value of variable N is less than the value of Lcount, the process proceeds to step C9, and if the value of variable N is equal to or greater than the value of Lcount, the process proceeds to step C14. In step C9, it is determined whether or not the Nth received light data Lpos has the coordinates of adjacent pixels detected as having been irradiated with light (hereinafter referred to as “adjacent coordinates”). If there are adjacent coordinates in the Nth received light data Lpos, the process proceeds to step C10, and if there are no adjacent coordinates in the Nth received light data Lpos, the process proceeds to step C12.
In step C10, the value of the coordinate (X, Y) is added to the Nth received light data Lpos. In Step C11, “1” is added to the variable X, and the process returns to Step C4. In Step C12, “1” is added to the variable N, and the process returns to Step C8. In Step C13, “1” is added to the variable Y, and the process returns to Step C2. In Step C14, “1” is added to the variable Lcount, that is, the number of received light is counted up, and the process proceeds to Step C10.
FIG. 10 is a flowchart illustrating an example of instruction pointer data creation processing called from the second display processing. The instruction pointer data generation process is executed by the instruction pointer display data generation unit 20, and when the instruction pointer display data generation unit 20 is called from the second display process shown in FIG. 8, the process proceeds to step D1.
In step D1, "0" is substituted for variable N to be initialized. In step D2, it is determined whether or not the variable N is less than the received light number Lcount. If the variable N is less than the light reception number Lcount, the process proceeds to step D3. If the variable N is greater than or equal to the light reception number Lcount, the process proceeds to step D113. In step D3, the light reception color of the Nth light reception point is determined based on the coordinate data of the light reception point, that is, the light reception data Lpos, and the light reception color PixelColor of each pixel data. In step D4, the basic coordinate data of the pointer size Lsize and the pointer shape Lpattern corresponding to the received light color determined in step D3 is copied to the coordinate data of the instruction pointer data PointInf. The basic coordinate data is represented by XY coordinates of each pixel of the pointing pointer when the reference position is set to XY coordinates (0, 0).
In step D5, it is determined whether or not the value of the pointer display color Lcolor corresponding to the light reception color determined in step D3 is “3”, that is, the received color. If the value of the pointer display color Lcolor is “3”, the process proceeds to step D11. If the value of the pointer display color Lcolor is not “3”, the process proceeds to step D6. In step D6, the color of the pointer display color Lcolor is set in the color data of the instruction pointer data PointInf. The color of the pointer display color Lcolor is, for example, one of red, green, and blue.
In step D7, it is determined whether or not the value of the pointer display reference Lbase is “0”, that is, whether or not the display reference is the central portion, that is, the central reference. If the value of the pointer display reference Lbase is “0”, the process proceeds to step D8. If the value of the pointer display reference Lbase is not “0”, the process proceeds to step D12. In step D8, the average value of the XY coordinates of the pixels included in the Nth light receiving location is obtained, the obtained average value of the X coordinate is set to the variable Xb, and the obtained average value of the Y coordinate is set to the variable Yb.
In step D9, the value of the variable Xb is added to the X coordinate of the basic coordinate copied to the coordinate data of the pointing pointer data PointInf in step D4, and the value of the variable Yb is added to the Y coordinate.
In Step D10, “1” is added to the variable N, and the process returns to Step D2. In step D11, the color data corresponding to the coordinates of the instruction pointer data PointInf is extracted from the received color PixelColor of each pixel data, set to the color data of the instruction pointer data PointInf, and the process proceeds to step D7.
In step D12, a pixel having the largest value of received light intensity PixelValue is searched for among the pixels included in the Nth light receiving location, the X coordinate of the searched pixel data is set in the variable Xb, and the Y coordinate is set as the variable. Set to Yb. In step D13, data having a negative coordinate value or a value exceeding the resolution of the panel 13, that is, the number of pixels, is removed from the instruction pointer data PointInf. In step D14, the instruction pointer data PointInf is sorted, that is, rearranged in the coordinate order, and the instruction pointer data creation process is terminated.
FIG. 11 is a flowchart illustrating an example of an instruction pointer display process called from the second display process. When executing step B4 of the second display process shown in FIG. 8, the central processing unit 15 proceeds to step E1.
In step E1, initialization is performed by substituting “0” into variables X, Y, and Z, respectively. In step E2, it is determined whether or not the value of the variable Y is less than the vertical resolution of the panel 13. If the value of Y is less than the vertical resolution of the panel 13, the process proceeds to step E3. If the value of Y is equal to or greater than the vertical resolution of the panel 13, the instruction pointer display process is terminated. In step E3, initialization is performed by substituting “0” into the variable X. In step E4, it is determined whether or not the value of the variable X is less than the horizontal resolution of the panel 13. If the value of the variable X is less than the horizontal resolution of the panel 13, the process proceeds to step E5. If the value of the variable X is equal to or greater than the horizontal resolution of the panel 13, the process proceeds to step E9.
In step E5, it is determined whether or not the coordinates (X, Y) and the coordinates of the Z-th PointInf data are the same. If the coordinates (X, Y) and the coordinates of the Zth PointInf data are the same, the process proceeds to step E6. If the coordinates (X, Y) and the coordinates of the Zth PointInf data are not the same, step E8 is performed. Proceed to
In step E6, the pixel at the coordinate (X, Y) is displayed in the color of the Zth PointInf data. Specifically, the central processing unit 15 sets the color of the pixel at the coordinate (X, Y) in the image information stored in the display / display processing temporary storage unit 12 to the color of the Zth PointInf data. Replace with The display processing unit 14 reads the image information in which the color of the pixel at the coordinates (X, Y) is rewritten from the display / display processing temporary storage unit 12, converts the image information into a predetermined format, and displays the information on the panel 13. In Step E7, “1” is added to the variable Z. In Step E8, “1” is added to the variable X, and the process returns to Step E4. In Step E9, “1” is added to the variable Y, and the process returns to Step E2. Steps D1 to D14 shown in FIG. 10 and steps E1 to E9 shown in FIG. 11 are first control steps.
FIG. 12 is a flowchart illustrating an example of the third display process performed by the central processing unit 15. The third display process is a process of displaying an instruction pointer of a different color and shape for each light emission instruction device when the light emission instruction device 30 having a plurality of emission patterns, for example, a continuous emission pattern and a pulsed emission pattern is used. It is. After the central processing unit 15 instructs the display processing unit 14 to display the image information stored in the display / display processing temporary storage unit 12 on the panel 13, the process proceeds to step F1. Steps F1 to F4 correspond to steps B1 to B4 shown in FIG. 8, respectively, and description thereof is omitted to avoid duplication.
FIG. 13 is a flowchart illustrating an example of a light receiving location search process called from the third display process. FIG. 14 is a flowchart illustrating an example of instruction pointer data creation processing called from the third display processing. FIG. 15 is a flowchart illustrating an example of an instruction pointer display process called from the third display process. 13 is the same as the light receiving point search process shown in FIG. 9, and the instruction pointer display process shown in FIG. 15 is the same as the instruction pointer display process shown in FIG. The description is omitted to avoid it.
The instruction pointer data creation process shown in FIG. 14 is executed by the instruction pointer display data creation part 20, and when the instruction pointer display data creation part 20 is called from the third display process shown in FIG. 12, the process proceeds to step H1. . Steps H1 and H2 are the same as steps D1 and D2 shown in FIG. 10, steps H6 to H9 are the same as steps D7 to D10 shown in FIG. 10, respectively, and steps H12 to H14 are respectively shown in FIG. Steps D12 to D14 shown in FIG. 10 are the same, and the description is omitted to avoid duplication.
In step H3, it is determined based on the determination result of the received light waveform determination unit 21 whether or not the emission pattern is pulsed. If the emission pattern is pulsed, the process proceeds to step H4, and if the emission pattern is not pulsed, that is, if it is a continuous emission pattern, the process proceeds to step H10. In step H4, the reference coordinate data whose shape is a quadrangle and whose size is “intermediate” is copied to the coordinate data of the instruction pointer data PointInf. In step H5, blue is set in the color data of the instruction pointer data PointInf.
In step H10, the reference coordinate data having a round shape and a size of “large” is copied to the coordinate data of the pointing pointer data PointInf. In step H11, red is set in the color data of the instruction pointer data PointInf, and the process proceeds to step H6.
Red is the first color, blue is the second color, the large circular shape is the first shape, and the middle rectangular shape is the second shape. It is. Step H3 shown in FIG. 14 is a determination step. Steps H1, H2 and steps H4 to H14 shown in FIG. 14 and steps J1 to J9 shown in FIG. 15 are second control steps.
Steps G1 to G14 shown in FIG. 13 are range determination steps.
Steps H7 and H8 shown in FIG. 14 are first position specifying steps.
Steps H8 and H12 shown in FIG. 14 are second position specifying steps.
Steps H1 to H6, H9 to H11, H13, and H14 shown in FIG. 14 and steps J1 to J9 shown in FIG. 15 are the third and fourth control steps.
FIG. 16 is a flowchart illustrating an example of a fourth display process performed by the central processing unit 15. In the fourth display process, when the light emission instruction device 30 having a plurality of emission patterns, for example, a continuous emission pattern and a pulsed emission pattern, is used, an indication pointer of a different color and shape is displayed for each light emission instruction device. For any one of the light emission instruction devices, this is processing for performing control related to screen control. The control related to the screen control is, for example, a control for turning a page on the screen. Specifically, by sending a page break command for turning a page on the screen to a PC or the like that inputs a video signal to the display device 10. Do. After the central processing unit 15 instructs the display processing unit 14 to display the image information stored in the display / display processing temporary storage unit 12 on the panel 13, the process proceeds to step K1. Steps K1 to K4 correspond to steps B1 to B4 shown in FIG. 8, respectively, and description thereof is omitted to avoid duplication.
FIG. 17 is a flowchart illustrating an example of a light receiving location search process called from the fourth display process. FIG. 18 is a flowchart illustrating an example of instruction pointer data creation processing called from the fourth display processing. FIG. 19 is a flowchart illustrating an example of an instruction pointer display process called from the fourth display process. The received light spot search process shown in FIG. 17 is the same as the received light spot search process shown in FIG. 9, and the instruction pointer display process shown in FIG. 19 is the same as the instruction pointer display process shown in FIG. The description is omitted to avoid it.
The instruction pointer data creation process shown in FIG. 18 is executed by the instruction pointer display data creation part 20, and when the instruction pointer display data creation part 20 is called from the fourth display process shown in FIG. 16, the process proceeds to step M1. . Steps M1 to M5 are the same as Steps H1 to H5 shown in FIG. 14, respectively, Steps M9 to M12 are the same as Steps H8 to H11 shown in FIG. 14, respectively, and Steps M14 and M15 are shown in FIG. Steps H13 and H14 shown in FIG. 14 are the same, and a description thereof is omitted to avoid duplication.
In step M6, the average value of the XY coordinates of the pixels included in the Nth light receiving location is obtained, the obtained average value of the X coordinate is set to the variable Xb, and the obtained average value of the Y coordinate is set to the variable Yb. In step M7, the XY coordinates (Xc, Yc) of the average value converted to the resolution of the input signal are calculated from the XY coordinates (Xb, Yb) of the average value. Specifically, the value of the coordinate Xc is calculated by the equation (1), and the value of the coordinate Yc is calculated by the equation (2).
Xc = Xb × (input signal horizontal resolution / panel horizontal resolution) (1)
Yc = Yb × (input signal vertical resolution / panel vertical resolution) (2)
In step M8, a page break command for turning the page on the screen is transmitted to the PC or the like that inputs the video to the video input terminal 11 together with the XY coordinates (Xc, Yc). In step M13, the average value of the XY coordinates of the pixels included in the Nth light receiving portion is obtained, the obtained average value of the X coordinate is set in the variable Xb, the obtained average value of the Y coordinate is set in the variable Yb, Proceed to step M9.
FIG. 20 is a flowchart illustrating an example of the setting process performed by the central processing unit 15. Before displaying a video signal from a PC or the like on the panel 13, the user responds to a setting screen (not shown) displayed on the panel 13, the pointer size Lsize, the pointer display color Lcolor, the pointer shape Lpattern, and the pointer display reference. The Lbase variable can be set in advance for each received color.
The central processing unit 15 generates image information of a setting screen for setting variables of the pointer size Lsize, the pointer display color Lcolor, the pointer shape Lpattern, and the pointer display reference Lbase, and the display / display processing temporary storage unit 12 The display processing unit 14 displays the image information stored in the display / display processing temporary storage unit 12 on the panel 13. The setting screen is a screen on which, for example, the contents to be set for each variable can be selected by a remote controller. The central processing unit 15 displays the setting screen on the panel 13, and then proceeds to Step P1.
In Step P1, it is determined whether the pointer display reference selected by the remote controller is “center reference” or “brightness reference”. If the selected pointer display standard is “center standard”, the process proceeds to step P2, and if the selected pointer display standard is “brightness standard”, the process proceeds to step P14. In step P2, “0” is substituted for variable D. In step P3, the value of the variable D is substituted for the display reference Lbase. In Step P4, "0", that is, a value indicating red is substituted for the variable K for selecting the received light color.
In Step P5, it is determined whether or not the value of the variable K is less than the number of light receiving colors that can be set, for example, a value “3” representing three colors of red, blue, and yellow. If the value of the variable K is less than “3”, the process proceeds to step P6. If the value of the variable K is “3” or more, the setting process is terminated. The variable K is “0” for red, “1” for blue, and “2” for yellow. Displays the light reception color that has been set on the setting screen. In step P6, first, the light reception color that has been set, that is, the color determined by the value of the variable K is displayed on the setting screen. Next, it is determined whether the pointer shape selected by the remote controller is “square”, “circle”, or “arrow”. If the selected pointer shape is “square”, the process proceeds to step P15. If the selected pointer shape is “circle”, the process proceeds to step P7. If the selected pointer shape is “arrow”, the process proceeds to step P15. Proceed to P16. In step P7, “1” is substituted for variable A.
In step P8, it is determined whether the size of the pointer selected by the remote controller is “large”, “medium”, or “small”. If the size of the selected pointer is “large”, the process proceeds to step P17. If the size of the selected pointer is “medium”, the process proceeds to step P9, and the size of the selected pointer is “small”. ", The process proceeds to Step P18. In Step P9, “1” is substituted into the variable B.
In Step P10, it is determined whether the pointer color selected by the remote controller is “red”, “blue”, “green”, or “light receiving color”. If the selected pointer color is “red”, the process proceeds to step P19. If the selected pointer color is “green”, the process proceeds to step P11. If the selected pointer color is “blue”, the process proceeds to step P19. Proceeding to P20, if the selected pointer color is “light receiving color”, the process proceeds to Step P21. In Step P11, “1” is substituted into the variable C.
In step P12, the set contents are stored. Specifically, the value of the variable B is assigned to the pointer size Lsize [K], the value of the variable C is assigned to the pointer color Lcolor [K], and the value of the variable A is assigned to the pointer shape Lpattern [K]. To do. In Step P13, “1” is added to the variable K, and the process returns to Step P5. In Step P14, “1” is substituted for the variable D, and the process proceeds to Step P3. In Step P15, “0” is substituted into the variable A, and the process proceeds to Step P8. In Step P16, “2” is substituted into the variable A, and the process proceeds to Step P8.
In Step P17, “0” is substituted into the variable B, and the process proceeds to Step P10. In Step P18, “2” is substituted into the variable B, and the process proceeds to Step P10. In Step P19, “0” is substituted for the variable C, and the process proceeds to Step P12. In Step P20, “2” is substituted into the variable C, and the process proceeds to Step P12. In Step P21, “3” is substituted for the variable C, and the process proceeds to Step P12.
As described above, when the image is displayed on the photosensor built-in display device 13 that includes a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the central processing unit 15 Thus, according to the intensity of light detected by the optical sensor, an image indicating the light detection position, for example, an instruction pointer is displayed on the optical sensor built-in display device 13.
Therefore, the position of the light irradiated on the screen can be clearly indicated by the pointing device that emits light.
Furthermore, since the image displayed on the display device 13 with a built-in optical sensor is a predetermined color, for example, red, green, or blue, by using a color that can be easily understood by a person viewing the screen, the image is displayed on the screen by an instruction device that emits light. The position of the irradiated light can be made clearer.
Furthermore, since the color of the light received by the optical sensor is detected and the image displayed on the optical sensor built-in display device 13 is the color detected by the optical sensor, the color irradiated by the pointing device that emits the light. Can be made clearer.
Furthermore, since the image displayed on the display device 13 with a built-in optical sensor has a predetermined display form, for example, a quadrangle, a circle, or an arrow, an indication device that irradiates light by using a shape that is easy for a person viewing the screen to understand. The position of the light irradiated on the screen can be shown more clearly.
Further, the central processing unit 15 determines whether or not the intensity of light detected by the optical sensor is equal to or greater than a predetermined reference strength. The central processing unit 15 detects by the central processing unit 15 using the optical sensor. When it is determined that the intensity of the emitted light is equal to or greater than a predetermined reference intensity, the image is displayed on the display device 13 with a built-in optical sensor.
Therefore, the position irradiated with light having a predetermined reference intensity or higher can be displayed on the display device 13 with a built-in optical sensor.
Further, in displaying an image on the photosensor-equipped display device 13 including a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light for each position, steps D1 to D1 shown in FIG. In D14 and steps E1 to E9 shown in FIG. 11, an image indicating the detection position, for example, an instruction pointer, is displayed according to the intensity of light detected by the optical sensor.
Therefore, if the display method according to the present invention is provided, the position of the light irradiated on the screen can be clearly indicated by the pointing device that emits light.
Further, when displaying an image on the photosensor built-in display device 13 including a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the central processing unit 15 When the pattern in which the intensity of the light detected by the optical sensor changes is determined, and the pattern determined by the central processing unit 15 is a continuous emission pattern, the light is detected by the optical sensor. A symbol image of a first display form indicating a position, for example, a red or large-sized circular pointer is displayed, and a pulse-shaped emission different from the emission pattern in which the pattern determined by the central processing unit 15 is continuous When it is a pattern, a symbol image of a second display form different from the first display form and indicating the position, for example, Color or size instruction pointer in the shape of the intermediate rectangle is displayed.
Therefore, it is possible to clearly indicate the positions on the screen instructed by a plurality of, for example, two types of instruction devices that emit light having different patterns of varying light intensity.
Furthermore, since the first display form is red and the second display form is blue different from red, a plurality of, for example, two types of light irradiating different patterns of varying light intensity. The position on the screen designated by the pointing device can be clearly indicated by different colors.
Further, the first display form is a round shape with a large size, and the second display form is a square shape with a size different from the round shape with a large size, The positions on the screen instructed by a plurality of, for example, two types of pointing devices that emit light having different light intensity patterns can be clearly indicated by different shapes.
Furthermore, when displaying an image on the display device 13 with a built-in optical sensor that includes a plurality of pixels for displaying an image and an optical sensor that detects the intensity of received light for each position, in step H3 shown in FIG. A pattern in which the intensity of light detected by the optical sensor changes is discriminated.
Steps H1, H2 and steps H4 to 14 shown in FIG. 14 and steps J1 to J9 shown in FIG. 15 are performed when the pattern determined in step H3 shown in FIG. 14 is a predetermined continuous emission pattern. The symbol image of the first display form showing the position where the light is detected by the optical sensor, for example, a red or large-sized circular pointer is displayed, and the pattern determined in step H3 shown in FIG. Is a pulse-like emission pattern different from the continuous emission pattern, the symbol image of the second display form showing the position, which is different from the first display form, for example, a blue or medium-sized square An instruction pointer of the shape of is displayed.
Therefore, if the display method according to the present invention is provided, the positions on the screen indicated by a plurality of, for example, two types of pointing devices that emit light having different light intensity patterns can be specified. .
Furthermore, when displaying an image on the photosensor built-in display device 13 including a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the central processing unit 15 A light receiving location that is a range in which the intensity of light detected by the optical sensor is equal to or greater than a predetermined reference intensity is determined, and the central calculation unit 15 becomes the center of each range for each range determined by the central calculation unit 15. The position is specified, and the central processing unit 15 displays an image indicating the position specified by the central processing unit 15, for example, an instruction pointer.
Therefore, even when using a pointing device that spreads light applied to the screen, such as a flashlight, it is possible to clearly indicate the position on the screen that the operator points with the pointing device.
Furthermore, since the image indicating the specified position is in a predetermined display form, the position on the screen instructed by the operator using the pointing device can be clearly indicated by the specific display form.
Furthermore, since the predetermined display form is a predetermined color, for example, red, green, or blue, the position on the screen instructed by the pointing device is made clearer by using a color that is easy for the viewer to see. be able to.
Furthermore, since the color of light received by the optical sensor is detected, and the predetermined display form is the color detected by the optical sensor, the position can be clearly indicated by the color irradiated by the pointing device. it can.
Furthermore, since the predetermined display form is a predetermined shape, for example, a quadrangle, a circle, or an arrow, the position on the screen instructed by the pointing device is made clearer by using a shape that is easy for the viewer to see. Can be shown.
Furthermore, in displaying an image on the display device 13 with a built-in photosensor, which includes a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the steps shown in FIG. In G1 to G14 and Steps H7 and H8 shown in FIG. 14, a light receiving point that is in a range in which the intensity of light detected by the optical sensor is equal to or greater than a predetermined reference intensity is determined. In steps G1 to G14 shown in FIG. 13 and steps H7 and H8 shown in FIG. 14, each range is determined for each range determined in steps G1 to G14 shown in FIG. 13 and steps H7 and H8 shown in FIG. Identify the center location. In steps H1 to H6, H9 to H11, H13, and H14 shown in FIG. 14 and steps J1 to J9 shown in FIG. 15, steps G1 to G14 shown in FIG. 13 and steps H7 and H8 shown in FIG. An image indicating the position specified by (eg, an instruction pointer) is displayed.
Therefore, if the display method according to the present invention is provided, the position on the screen indicated by the operator using the pointing device can be clearly indicated even when using a pointing device that spreads the light irradiated on the screen, such as a flashlight. Can do.
Furthermore, when displaying an image on the photosensor built-in display device 13 including a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the central processing unit 15 A light receiving location that is a range in which the intensity of light detected by the optical sensor is equal to or greater than a predetermined reference intensity is determined, and the intensity of light within the range determined by the central processing unit 15 is determined by the central processing unit 15. Is determined for each of the determined ranges, and the central processing unit 15 displays an image indicating the position specified by the central processing unit 15, for example, an instruction pointer.
Therefore, even when using a pointing device that spreads light applied to the screen, such as a flashlight, it is possible to clearly indicate the position on the screen that the operator points with the pointing device.
Furthermore, since the image indicating the specified position is in a predetermined display form, the position on the screen instructed by the operator using the pointing device can be clearly indicated by the specific display form.
Furthermore, since the predetermined display form is a predetermined color, for example, red, green, or blue, the position on the screen instructed by the pointing device is made clearer by using a color that is easy for the viewer to see. be able to.
Furthermore, since the color of light received by the optical sensor is detected, and the predetermined display form is the color detected by the optical sensor, the position can be clearly indicated by the color irradiated by the pointing device. it can.
Furthermore, since the predetermined display form is a predetermined shape, for example, a quadrangle, a circle, or an arrow, the position on the screen instructed by the pointing device is made clearer by using a shape that is easy for the viewer to see. Can be shown.
Furthermore, in displaying an image on the display device 13 with a built-in photosensor, which includes a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the steps shown in FIG. In G1 to G14 and Steps H8 and H12 shown in FIG. 14, a light receiving location in a range where the intensity of light detected by the optical sensor is equal to or greater than a predetermined reference intensity is determined. In Steps G1 to G14 shown in FIG. 13 and Steps H8 and H12 shown in FIG. 14, light within the range determined in Steps G1 to G14 shown in FIG. 13 and Steps H8 and H12 shown in FIG. A position having the strongest intensity is specified for each of the determined ranges. In steps H1 to H6, H9 to H11, H13, and H14 shown in FIG. 14 and steps J1 to J9 shown in FIG. 15, steps G1 to G14 shown in FIG. 13 and steps H8 and H12 shown in FIG. An image indicating the position specified by (eg, an instruction pointer) is displayed.
Therefore, if the display method according to the present invention is provided, the position on the screen indicated by the operator using the pointing device can be clearly indicated even when using a pointing device that spreads the light irradiated on the screen, such as a flashlight. Can do.
FIG. 21 is a diagram showing a configuration of a display device 1A according to the second embodiment of the present invention. The display device 1A includes a display device 10A, a light emission instruction device 30, and a video generation device 50. The display method according to the present invention is processed by the display device 10A and the video generation device 50. In the present embodiment, the same reference numerals are given to the same parts as those in the above-described embodiment, and the description thereof is omitted.
The display device 10A includes N video input terminals 11, a display / display processing temporary storage unit 12, a photosensor built-in display device 13, a display processing unit 14, a central processing unit 15, an internal storage unit 16, a remote control ( (Hereinafter referred to as “remote control”) includes a light receiving unit 17, a remote control processing unit 18, a light receiving location determination unit 19, an instruction pointer display data creation unit 20, a light reception waveform determination unit 21 and a serial communication processing unit 22, and is connected to the video generation device 50. Has been.
The central processing unit 15 includes a central processing unit (hereinafter referred to as “CPU”) and a memory that stores a control program for controlling the display device 10A, and the CPU executes the control program stored in the memory, thereby The sensor built-in display device 13, the display processing unit 14, the remote control processing unit 18, and the serial communication processing unit 22 are controlled.
The serial communication processing unit 22 is connected to the video generation device serial communication processing unit 55 of the video generation device 50 through a serial interface, and transmits and receives information to and from the video generation device serial communication processing unit 55. The serial communication processing unit 22 transmits a command for controlling the display image instructed from the central processing unit 15 to the video generation device 50. The commands for controlling the display image include, for example, a page break command for turning the page of the displayed image information, a horizontal scroll command for moving the displayed image information in the X-axis direction, and the displayed image information for the Y-axis. These are commands such as a vertical scroll command for moving in the direction, an enlargement command for enlarging the displayed image information, and a reduction command for reducing the displayed image information.
The light emission instruction device 30 is an instruction device that indicates a position by irradiating a screen with light such as a laser pointer, an LED (Light Emitting Diode), or a flashlight. The light emission instructing device 30 includes a light emitting unit 31 that emits light, an intermittent drive unit 32 that emits the light emitting unit 31 in a pulsed manner, and a button 33 that switches whether to emit light in a pulsed manner or continuously.
The video generation device 50 is configured by a PC or the like, and includes a display data storage unit 51, a video signal generation unit 52, a video generation device central processing unit 53, a video generation device internal storage unit 54, and a video generation device serial communication processing unit 55. Including.
The display data storage unit 51 is a storage device including a semiconductor memory or a hard disk device that stores image information to be displayed on the display device 10A. The video signal generation unit 52 reads image information instructed by the video generation device central processing unit 53 from the image information stored in the display data storage unit 51 from the display data storage unit 51, and reads the read image information. Convert to video signal and output. The video signal output by the video signal generation unit 52 is input to any one of the video input terminals 11 of the display device 10A.
The video generation device central processing unit 53 includes a CPU and a memory that stores a video generation device control program for controlling the video generation device 50, and the CPU executes the video generation device control program stored in the memory. The video signal generator 52 and the video generator serial communication processor 55 are controlled. The video generation device central processing unit 53 is an FPGA (Large Scale Integration) FPGA (LGA) that can be programmed instead of the CPU and the memory.
Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit) which is an integrated circuit designed and manufactured for a specific application, or other circuits having an arithmetic function may be used.
The video generation device internal storage unit 54 is configured by a storage device such as a writable and readable semiconductor memory, and stores control information 541 used when the video generation device central processing unit 53 executes the video generation device control program. . Control information 541 includes information such as a display area. The display area is information representing the area of the portion to be displayed on the display device 10A in the entire image information for one page. For example, among the pixels in the area, the XY of the pixel in the upper left position toward the screen This is expressed by the coordinates (Ppos_xs, Ppos_ys) and the XY coordinates (Ppos_xe, Ppos_ye) of the pixel at the lower right position. The XY coordinates are coordinates whose origin is, for example, the position of the upper left pixel toward the entire image for one page to be displayed.
The video generation device serial communication processing unit 55 is connected to the serial communication processing unit 22 of the display device through a serial interface, and transmits and receives information to and from the serial communication processing unit 22. The video generation device serial communication processing unit 55 receives commands such as a page break command, a horizontal scroll command, a vertical scroll command, an enlargement command, and a reduction command, which control the display image transmitted from the display device 10A. The received command is sent to the video generation device central processing unit 53. The central processing unit 15 and the video generation device central processing unit 53 are control means.
The variables used in the flowcharts of FIGS. 22 to 25 include variables of the light reception number Lcount, the light reception color PixelColor, the light reception intensity PixelValue, the light reception point coordinate data Lpos, and the instruction pointer data PointInf. The definition of these variables is as described above, and a description thereof will be omitted.
FIG. 22 is a flowchart illustrating an example of the fifth display process performed by the central processing unit 15. The fifth display process is a process of displaying an instruction pointer having a preset color and shape at the position of the light receiving portion that has received the light. After the central processing unit 15 instructs the display processing unit 14 to display the image information stored in the display / display processing temporary storage unit 12 on the panel 13, the process proceeds to step Q1.
In step Q1, data for each pixel detected by each photosensor from the panel 13, specifically, light reception color and light reception intensity data are acquired and set to the light reception color PixelColor and the light reception intensity PixelValue for each pixel. To do. In step Q2, a light receiving location search process is performed. In step Q3, an instruction pointer data creation process is performed. In step Q4, an instruction pointer display process is performed, and the process returns to step Q1.
FIG. 23 is a flowchart illustrating an example of a light receiving location search process called from the fifth display process. FIG. 24 is a flowchart illustrating an example of instruction pointer data creation processing called from the fifth display processing. FIG. 25 is a flowchart illustrating an example of an instruction pointer display process called from the fifth display process. The received light spot search processes R1 to R14 shown in FIG. 23 are the same as the received light spot search processes C1 to C14 shown in FIG. 9, and the instruction pointer data creation processes S1 to S15 shown in FIG. The pointer pointer display processes T1 to T9 shown in FIG. 25 are the same as the pointer data creation processes M1 to M15, and are the same as the pointer pointer display processes E1 to E9 shown in FIG. . Step S3 shown in FIG. 24 is a determination step.
FIG. 26 is a flowchart illustrating an example of command processing performed by the video generation device central processing unit 53. The command processing is processing for executing a command for controlling the display image received from the display image device 10A, for example, a page break command. After the video generation device central processing unit 53 instructs the video signal generation unit 52 to output the image information stored in the display data storage unit 51 to the display device 10A, the process proceeds to step U1.
In step U1, it is determined whether a page break command has been received. If a page break command is received, the process proceeds to step U1, and if no page break command is received, the process returns to step U1. In step U2, a page break command is executed, and the process returns to step U1. Specifically, the video signal of the pixel information of the next page of the page of the image information currently being output is output, and the process returns to step U1. Steps S1, S2, S4 to S15 shown in FIG. 24, steps T1 to T9 shown in FIG. 25, and steps U1 and U2 shown in FIG. 26 are fifth control steps.
As described above, when the image is displayed on the photosensor built-in display device 13 that includes a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light at a plurality of positions, the central processing unit 15 Thus, a pattern in which the intensity of light detected by the optical sensor changes, that is, an emission pattern, is discriminated, and the patterns discriminated by the central processing unit 15 by the central processing unit 15 and the video generation device central processing unit 53 are continuous. When it is an emission pattern, the first control is performed on the display image, and when the pattern determined by the central processing unit 15 is a pulsed emission pattern different from the continuous emission pattern, the display image is controlled. Second control is performed.
Therefore, it is possible to control the display image according to the light emitted to the screen by the light emission instruction device 30 that emits light, for example, according to the emission pattern in which the intensity of the light changes.
Further, since the first control is a control for displaying an image showing the position of light detected by the optical sensor, and the second control is a control for operating the display image, the emission pattern is continuous. When it is a pattern, an instruction pointer is displayed, and when the emission pattern is a pulse pattern, an operation of displayed image information, for example, a page can be changed.
Furthermore, in displaying an image on the display device 13 with a built-in optical sensor that includes a plurality of pixels for displaying an image and an optical sensor that detects the intensity of received light for each position, in step S3 shown in FIG. A pattern in which the intensity of light detected by the optical sensor changes, that is, an emission pattern is discriminated. Then, when the pattern determined in step S3 shown in FIG. 24 is a continuous emission pattern, the display image is subjected to steps S2, S9 to S15 shown in FIG. 24 and steps T1 to T9 shown in FIG. When the first control is performed and the pattern determined in step S3 shown in FIG. 24 is a pulsed emission pattern different from the continuous pattern, steps S2, S4 to S10, S14, shown in FIG. In S15 and steps U1 and U2 shown in FIG. 26, the second control is performed on the display image.
Therefore, if the display method according to the present invention is applied, control according to the light emitted to the screen by the light emission instruction device 30 that emits light, for example, control over the display image according to the emission pattern in which the intensity of light changes. It can be performed.
FIG. 27 is a diagram showing a configuration of a display device 1B according to the third embodiment of the present invention. The display device 1B includes a display device 10B, a light emission instruction device 30A, and a video generation device 50A. The display method according to the present invention is processed by the display device 10B and the video generation device 50A. In the present embodiment, the same reference numerals are given to the same parts as those in the above-described embodiment, and the description thereof is omitted. The connection relationship between the display device 10B and the video generation device 50A according to the present embodiment is similar to the connection relationship between the display device 10A and the video generation device 50 according to the above-described embodiment.
The display device 10B includes N video input terminals 11, a display / display processing temporary storage unit 12, a photosensor built-in display device 13, a display processing unit 14, a central processing unit 15, an internal storage unit 16, a remote control ( (Hereinafter referred to as “remote control”) including a light receiving unit 17, a remote control processing unit 18, a light receiving location determination unit 19, an instruction pointer display data creation unit 20, a light receiving unit shape determination unit 21 A, and a serial communication processing unit 22. Has been.
The light receiving location determination unit 19, the instruction pointer display data creation unit 20, and the light receiving unit shape determination unit 21A are functions realized by the central processing unit 15 executing a control program.
The instruction pointer display data creation unit 20 determines the position at which the instruction pointer is displayed for the light receiving part determined to receive light by the light receiving part determination unit 19 and creates instruction pointer data representing the instruction pointer. At the same time, a command corresponding to the shape determined by the light receiving portion shape determination unit 21A is transmitted to the video generation device 50. The light receiving unit shape determining unit 21A, which is a shape determining unit, is called from the instruction pointer display data creating unit 20 and determines the shape of the light irradiated on the screen by the light emission instruction device 30. Specifically, the light receiving portion shape determination unit 21A determines a shape formed by pixels whose received light intensity received from the optical sensor of the optical sensor built-in display device 13 is equal to or higher than a predetermined reference intensity.
The light emission instruction device 30A is an instruction device that indicates a position by irradiating the screen with light such as a laser pointer. The light emission instructing device 30A includes a light emitting unit 31A that emits light, for example, a laser beam, and a light emission shape switching unit 32A that switches the shape of light formed on the screen by irradiating light.
The video generation device 50A is configured by a PC or the like, and includes a display data storage unit 51, a video signal generation unit 52, a video generation device central processing unit 53, a video generation device internal storage unit 54, a video generation device serial communication processing unit 55, A scroll processing unit 56 and an enlargement processing unit 57 are included.
The scroll processing unit 56 and the enlargement processing unit 57 are functions realized by the video generation device central processing unit 53A executing the video generation device control program. The scroll processing unit 56 performs a process of horizontally scrolling or vertically scrolling image information to be displayed on the screen of the display device 10B among the image information for one page. The horizontal scroll is a process of moving the image information to be displayed among the image information for one page in the X-axis direction of the XY coordinates, and the vertical scroll is a process of moving in the Y-axis direction. The enlargement processing unit 57 performs a process of enlarging image information to be displayed on the screen of the display device 10B among the image information for one page. The central processing unit 15 and the video generation device central processing unit 53A are control means.
28A to 28D are diagrams showing examples of the shape of light emitted by the light emission instruction device 30. FIG. FIG. 28A is an example of a case where the shape of light emitted by the light emission instruction device 30 is a circle shape 61. The circle shape 61 is a predetermined shape that is not irradiated with light at the center, for example, a circular shape. FIG. 28B is an example when the shape of the light emitted by the light emission instruction device 30 is a dot shape 62. The dot shape 62 is a predetermined shape in which light is irradiated to the central portion, for example, a circular shape. FIG. 28C is an example in which the shape of the light emitted by the light emission instruction device 30 is a horizontally long shape 63. The horizontally long shape 63 is a shape of a horizontal line segment whose inclination is equal to or less than a predetermined angle. FIG. 28D is an example when the shape of the light emitted by the light emission instruction device 30 is the vertically long shape 64. The vertically long shape 64 is a shape of a vertical line segment whose inclination is equal to or less than a predetermined angle. Hereinafter, the horizontally long shape is also referred to as a horizontal line shape, and the vertically long shape is also referred to as a vertical line shape.
FIG. 29 is a diagram illustrating an example of a display image in which the panel 13 is irradiated with the light having the dot shape 62. The image information 70 is image information for one page stored in the display data storage unit 51 </ b> A, and the image information in the area 71 among the image information for one page is displayed on the panel 13. The screen 72 is a screen of the panel 13 and displays image information in the area 71 among the image information 70 for one page stored in the display data storage unit 51A. The screen 74 is a partial screen obtained by enlarging a peripheral portion of the screen 72 irradiated with the laser beam from the light emission instruction device 30, and is irradiated with light having a dot shape 62.
FIG. 30 is a diagram illustrating an example of a display image displayed when the light shape is the horizontally long shape 63. The display device 1B moves the region of the image information to be displayed to the right of the region of the displayed image information when the light of the horizontally long shape 63 is irradiated on the screen 75 by the light emission instruction device 30. The image information displayed on the screen of the panel 13 is scrolled horizontally. The example shown in FIG. 30 is a state in which the area of the image information to be displayed is horizontally scrolled from the area 71, that is, moved to the right, and the image information of the area 71a is displayed on the screen 75.
FIG. 31 is a diagram illustrating an example of a display image displayed when the light shape is the vertically long shape 64. When the light emitting instruction device 30 irradiates the screen 76 with the light of the vertically long shape 64, the display device 1 </ b> B moves the region of the image information to be displayed downward from the region of the image information being displayed. The image information displayed on the screen of the panel 13 is scrolled vertically. The example shown in FIG. 31 is a state in which the area of the image information to be displayed is vertically scrolled from the area 71a, that is, moved downward, and the image information of the area 71b is displayed on the screen 76.
FIG. 32 is a diagram illustrating an example of a display image displayed when the light shape is the circle shape 61. When the light of the circle shape 61 is irradiated on the screen 77 by the light emission instruction device 30, the display device 1B expands the image information displayed on the screen 77 around the pixel irradiated with the circle shape 61. The image information is displayed on the screen of the panel 13. The display device 1 </ b> B gradually enlarges the image information displayed on the screen 77 and displays the image information on the screen 77 while the light of the circle shape 61 is irradiated on the screen 77 by the light emission instruction device 30. At this time, the area of the image information displayed on the screen of the panel 13 is changed from the area 71b to the area 71c.
The variables used in the flowcharts of FIGS. 33 to 37 include variables of the light reception number Lcount, the light reception color PixelColor, the light reception intensity PixelValue, the light reception point coordinate data Lpos, and the instruction pointer data PointInf. The definition of these variables is as described above, and a description thereof will be omitted.
FIG. 33 is a flowchart illustrating an example of a sixth display process performed by the central processing unit 15. The sixth display process is a process of displaying an instruction pointer of a preset color and shape at the position of the light receiving point that has received the light. After the central processing unit 15 instructs the display processing unit 14 to display the image information stored in the display / display processing temporary storage unit 12 on the panel 13, the process proceeds to step V1. Steps V1 to V4 correspond to steps Q1 to Q4 shown in FIG. 22, respectively, and description thereof is omitted to avoid duplication.
FIG. 34 is a flowchart illustrating an example of a light receiving location search process called from the sixth display process. The light receiving location searching process is executed by the light receiving location determining unit 19, and when the light receiving location determining unit 19 is called from the sixth display process shown in FIG. 33, the process proceeds to step W1. The received light spot search processes W1 to W4 and W6 to W14 shown in FIG. 34 are the same as the received light spot search processes R1 to R4 and R6 to R14 shown in FIG. 23, and a description thereof will be omitted to avoid duplication.
In step W5, the PixelValue, that is, the intensity of light reception and the PixelColor, that is, the light reception color of the pixel at the coordinates (X, Y) are acquired.
FIG. 35 is a flowchart illustrating an example of instruction pointer data creation processing called from the sixth display processing. The instruction pointer data generation process is executed by the instruction pointer display data generation unit 20, and when the instruction pointer display data generation unit 20 is called from the sixth display process shown in FIG. 33, the process proceeds to step AA1.
In step AA1, initialization is performed by substituting “0” into the variable N. In Step AA2, it is determined whether or not the variable N is less than the number of received light Lcount. If the variable N is less than the light reception number Lcount, the process proceeds to step AA3. If the variable N is greater than or equal to the light reception number Lcount, the instruction pointer data creation process is terminated.
In step AA3, the coordinates of the Nth received light data Lpos are copied to the coordinate data of the Nth instruction pointer data PointInf. In step AA4, the color data of each coordinate of the Nth instruction pointer data PointInf is extracted from the data of the received light color PixelColor and copied. In step AA5, the light receiving portion shape determining unit 21A is called to determine the shape of the irradiated portion, that is, the light receiving portion. In step AA6, it is determined what the shape determined by the light receiving portion shape determining portion 21A is. If the determined shape is a dot shape, specifically, if the variable A is “0”, the process proceeds to step AA8. If the determined shape is a circle shape, specifically, if the variable A is “3”, Proceeding to step AA7, if the shape is a horizontal line, specifically, if the variable A is "1", proceeding to step AA9, and if the shape is a vertical line, specifically, the variable A is "2". The process proceeds to step AA10.
In step AA 7, an “enlargement” command is transmitted to the video generation device 50 by the serial communication processing unit 22. In step AA8, “1” is added to the variable N, and the process returns to step AA2. In step AA9, a “horizontal scroll” command is transmitted to the video generation device 50A by the serial communication processing unit 22, and the process proceeds to step AA8. In Step AA10, a “vertical scroll” command is transmitted to the video generation device 50A by the serial communication processing unit 22, and the process proceeds to Step AA8.
FIG. 36 is a flowchart illustrating an example of an instruction pointer display process called from the sixth display process. After executing step V4 of the display process shown in FIG. 33, the central processing unit 15 proceeds to step BB1. The instruction pointer display processes BB1 to BB9 shown in FIG. 36 are the same as the instruction pointer display processes E1 to E9 shown in FIG. 11, and a description thereof is omitted to avoid duplication.
FIG. 37 is a flowchart illustrating an example of a shape determination process called from the instruction pointer data creation process. The shape determination process is executed by the light receiving portion shape determination unit 21A, and when called from the instruction pointer data creation process shown in FIG. 35, the process proceeds to step CC1.
In step CC1, the X coordinate of the pixel of interest is set to the minimum X coordinate Xmin among the X coordinates of the light receiving location. In step CC2, it is determined whether or not the value of the X coordinate of the pixel of interest is equal to or less than the value of the maximum X coordinate Xmax among the X coordinates of the light receiving location. If the X coordinate value of the pixel of interest is less than or equal to the X coordinate Xmax, the process proceeds to step CC3. If the X coordinate value of the pixel of interest is greater than the X coordinate Xmax value, the process proceeds to step CC12. In step CC3, it is determined whether or not the inclination in the X-axis direction is within an allowable range. Specifically, it is determined whether or not the range of the Y coordinate of the coordinate X is less than 5, that is, whether or not the difference between the Y coordinate of the pixel of interest and the Y coordinate of the pixel of the coordinate Xmin is less than 5. . If the Y coordinate range of the coordinate X is less than 5, the process proceeds to step CC4. If the Y coordinate range of the coordinate X is 5 or more, the process proceeds to step CC5. In step CC4, “1” is added to the variable X, and the process returns to step CC2.
In step CC5, the Y coordinate of the pixel of interest is set to the minimum Y coordinate Ymin among the Y coordinates of the light receiving location. In step CC6, it is determined whether or not the Y coordinate value of the pixel of interest is less than or equal to the maximum Y coordinate Ymax value among the Y coordinates of the light receiving points. If the Y coordinate value of the pixel of interest is equal to or less than the Y coordinate Ymax value, the process proceeds to step CC7. If the Y coordinate value of the pixel of interest is greater than the Y coordinate Ymax value, the process proceeds to step CC13. In step CC7, it is determined whether the inclination in the Y-axis direction is within an allowable range. Specifically, it is determined whether or not the range of the X coordinate of the coordinate Y is less than 5, that is, whether or not the difference between the X coordinate of the pixel of interest and the X coordinate of the pixel of the coordinate Ymin is less than 5. . If the X coordinate range of the coordinate Y is less than 5, the process proceeds to Step CC8, and if the X coordinate range of the coordinate Y is 5 or more, the process proceeds to Step CC9. In step CC8, “1” is added to the variable Y, and the process returns to step CC6.
In step CC9, the center coordinates (Xm, Ym) of the light receiving location are obtained. Specifically, it is obtained by the formula Xm = (Xmin + Xmax) / 2 and the formula Ym = (Ymin + Ymax) / 2. In step CC10, it is determined whether or not the central portion is irradiated with light. Specifically, among the pixels included in the light receiving location data Lpos, the upper left position is within the range determined by the coordinates (Xm-2, Ym-2) and the lower right position is determined by the coordinates (Xm + 2, Ym + 2). It is determined whether there are two or more pixels with coordinates. If there are two or more, the process proceeds to step CC11, and if there are not two or more, the process proceeds to step CC14.
In step CC11, a value “0” representing the dot shape is substituted for variable A, and the shape determination process is terminated. In step CC12, the value “1” representing the horizontal line shape is substituted for the variable A, and the shape determination process ends. In step CC13, the value “2” representing the vertical line shape is substituted for the variable A, and the shape determination process ends. In step CC14, the value “3” representing the circle shape is substituted for the variable A, and the shape determination process ends. Steps CC1 to CC14 shown in FIG. 37 are shape determination steps.
FIG. 38 is a flowchart illustrating an example of command processing performed by the video processing device central processing unit 53A. The command processing is processing for executing a command for controlling the display image received from the display image device 10B, such as a horizontal scroll command, a vertical scroll command, an enlargement command, and a reduction command. After the video generation device central processing unit 53A instructs the video signal generation unit 52A to output the image information stored in the display data storage unit 51A to the display device 10B, the process proceeds to step DD1.
In step DD1, it is determined whether a command has been received. If no command is received, the process proceeds to step DD5. If the received command is a horizontal scroll command, the process proceeds to step DD8. If the received command is a vertical scroll command, the process proceeds to step DD2. If the received command is an enlarged command, the process proceeds to step DD13. move on. In step DD2, it is determined whether or not the display area is the lowermost end of the display data. Specifically, it is determined whether or not the display area includes the lowermost pixel among pixels of pixel information for one page. If the display area is the lowermost end of the display data, the process proceeds to step DD7. If the display area is not the lowermost end of the display data, the process proceeds to step DD3.
In step DD3, it is determined whether or not the difference between the lowermost end of the display area and the lowermost end of the display data is one pixel (hereinafter also referred to as “dot”). If the difference between the bottom end of the display area and the bottom end of the display data is 1 dot, the process proceeds to step DD6. If the difference between the bottom end of the display area and the bottom end of the display data is not 1 dot, the process proceeds to step DD4. . In step DD4, “2” is added to the Y coordinate of the display area. Specifically, “2” is added to the Y coordinates Ppos_ys and Ppos_ye.
In step DD5, a video signal is generated in the display area, that is, the area determined by the XY coordinates (Ppos_xs, Ppos_ys) of the pixel located at the upper left position and the XY coordinates (Ppos_xe, Ppos_ye) of the pixel located at the lower right position. The data is generated and output by the unit 52A, and the process returns to step DD1. In step DD6, the display area is set to the lowermost end, and the process proceeds to step DD5. That is, without changing the X coordinate, the lowermost pixel of the display area is set to the lowermost pixel of the image information for one page, and the process proceeds to step DD5. In step DD7, the display area is set to the uppermost end, and the process proceeds to step DD5. In other words, the X coordinate is not changed, and the uppermost pixel of the display area becomes the uppermost pixel of the image information for one page, and the process proceeds to step DD5.
In step DD8, it is determined whether or not the display area is the rightmost end of the display data. Specifically, it is determined whether or not the display area includes the rightmost pixel among pixels of pixel information for one page. If the display area is the rightmost edge of the display data, the process proceeds to step DD12. If the display area is not the rightmost edge of the display data, the process proceeds to step DD9. In step DD9, it is determined whether or not the difference between the rightmost edge of the display area and the rightmost edge of the display data is 1 dot. If the difference between the rightmost edge of the display area and the rightmost edge of the display data is 1 dot, the process proceeds to step DD11. If the difference between the rightmost edge of the display area and the rightmost edge of the display data is not 1 dot, the process proceeds to step DD10. .
In step DD10, "2" is added to the X coordinate of the display area. Specifically, 2 is added to the X coordinates Ppos_xs and Ppos_xe, and the process proceeds to step DD5. In step DD11, the display area is set to the rightmost end, and the process proceeds to step DD5. That is, without changing the Y coordinate, the rightmost pixel of the display area is set to the rightmost pixel of the image information for one page, and the process proceeds to step DD5. In step DD12, the display area is set to the leftmost end, and the process proceeds to step DD5. That is, without changing the Y coordinate, the leftmost pixel of the display area is set to the leftmost pixel of the image information for one page, and the process proceeds to step DD5.
In step DD13, it is determined whether or not the width of the display area, that is, the number of pixels in the X-axis direction is within 10 dots. If the width of the display area is within 10 dots, the process proceeds to step DD16. If the width of the display area is not within 10 dots, the process proceeds to step DD14. In step DD14, it is determined whether or not the height of the display area, that is, the number of pixels in the Y-axis direction is within 10 dots. If the height of the display area is within 10 dots, the process proceeds to step DD16. If the height of the display area is not within 10 dots, the process proceeds to step DD15.
In step DD15, "2" is added to each of the X coordinate and Y coordinate of the upper left pixel of the display area, and "2" is subtracted from each of the X coordinate and Y coordinate of the lower right pixel, to step F5. move on. In step DD16, the display area is set to a standard size, that is, a non-enlarged size, and the process proceeds to step DD5.
The video generation device central processing unit 53A executes steps DD2 to DD7 and steps DD8 to DD12 by the scroll processing unit 56, and executes steps DD13 to DD16 by the enlargement processing unit 57. Steps V1 to V4 shown in FIG. 33 and steps DD1 to DD16 shown in FIG. 38 are sixth control steps.
Although the process for reducing the image information is not described in the above-described flowchart, the same process can be performed by assigning a shape other than the dot shape, the horizontally long shape, the vertically long shape, and the circle shape to the reduction command. Furthermore, the enlarged image information or the reduced image information may be restored by assigning another shape to a command for restoring the enlarged image information or the reduced image information.
As described above, the display device 13 with a built-in optical sensor includes a plurality of pixels for displaying an image and an optical sensor for detecting the intensity of received light at each of a plurality of positions. The shape formed by the reference position detected when the light intensity detected by the optical sensor is equal to or greater than a predetermined reference intensity is determined, and the shape of the light receiving unit is determined by the central processing unit 15 and the video generation device central processing unit 53A. In accordance with the shape determined by the determination unit 21A, predetermined control is performed on the display image.
Therefore, it is possible to control the display image in accordance with the light irradiated on the screen by the pointing device that emits light, for example, the shape formed on the screen by the light.
Further, since the predetermined control is a control for scrolling and displaying the display image, image information that does not enter the screen can be scrolled and displayed depending on the shape of the light applied to the screen.
Furthermore, since the predetermined control is control for enlarging or reducing the display image, or returning and displaying the enlarged display image or the reduced display image, the image may be changed depending on the shape of light applied to the screen. Information can be enlarged or reduced, or displayed in its original size.
Further, in displaying an image on the photosensor-equipped display device 13 including a plurality of pixels for displaying an image and a photosensor for detecting the intensity of received light for each position, steps CC1 to CC1 shown in FIG. In CC14, the shape formed by the reference position detected when the intensity of the light detected by the optical sensor is greater than or equal to a predetermined reference intensity is determined. In steps V1 to V4 shown in FIG. 33 and steps DD1 to DD16 shown in FIG. 38, predetermined control is performed on the display image in accordance with the shape determined in steps CC1 to CC14 shown in FIG. .
Therefore, when the display method according to the present invention is applied, it is possible to control the display image according to the light irradiated on the screen by the pointing device that emits light, for example, the shape formed on the screen by the light.
Furthermore, since the predetermined control is control for scrolling and displaying the display image, image information that does not enter the screen can be scrolled and displayed by applying the display method according to the present invention.
Further, since the predetermined control is control for enlarging or reducing the display image, or returning and displaying the enlarged display image or the reduced display image, the display method according to the present invention is applied. The image information can be displayed enlarged or reduced.
The present invention can be implemented in various other forms without departing from the spirit or main features thereof. Therefore, the above-described embodiment is merely an example in all respects, and the scope of the present invention is shown in the claims, and is not restricted by the text of the specification. Further, all modifications and changes belonging to the scope of the claims are within the scope of the present invention.

Claims

Display means comprising a plurality of pixels for displaying an image, and a detection unit for detecting the intensity of received light at a plurality of positions;
A display device comprising: a control unit that causes the display unit to display at least an image indicating a light detection position in accordance with the intensity of light detected by the detection unit.
2. The display device according to claim 1, wherein the image displayed on the display means is a predetermined color.
The detection unit is capable of detecting the color of light received,
The display device according to claim 1, wherein the image displayed on the display unit is a color detected by the detection unit.
The display device according to any one of claims 1 to 3, wherein the image displayed on the display means has a predetermined display form.
Determining means for determining whether or not the intensity of light detected by the detection unit is greater than or equal to a predetermined reference intensity;
The control means causes the display means to display the image when it is determined by the determination means that the intensity of light detected by the detection unit is greater than or equal to a predetermined reference intensity. Item 5. The display device according to any one of Items 1 to 4.
A display method for displaying an image on a display device comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each position,
And a first control step of displaying an image indicating a detection position in accordance with the intensity of light detected by the detection unit.
Display means comprising a plurality of pixels for displaying an image, and a detection unit for detecting the intensity of received light at a plurality of positions;
Discriminating means for discriminating a pattern in which the intensity of light detected by the detection unit changes;
When the pattern discriminated by the discriminating means is the first pattern, a symbol image of the first display form showing the position where the light is detected by the detecting unit is displayed, and the pattern discriminated by the discriminating means is Control means for displaying a symbol image of a second display form different from the first display form and indicating the position when the second pattern is different from the first pattern. A display device.
The first display form is a first color;
The display device according to claim 7, wherein the second display form is a second color different from the first color.
The first display form is a first shape,
The display device according to claim 7, wherein the second display form is a second shape different from the first shape.
A display method for displaying an image on a display device comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each position,
A determination step of determining a pattern in which the intensity of light detected by the detection unit changes;
When the pattern determined in the determination step is the first pattern, a symbol image of a first display form indicating a position where light is detected by the detection unit is displayed, and the pattern determined in the determination step is A second control step for displaying a symbol image in a second display form different from the first display form and indicating the position when the second pattern is different from the first pattern. A display method characterized by that.
Display means comprising a plurality of pixels for displaying an image, and a detection unit for detecting the intensity of received light at a plurality of positions;
Range determining means for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
Position specifying means for specifying a position that is the center of each range for each range determined by the range determining means;
Control means for displaying an image indicating the position specified by the position specifying means.
Display means comprising a plurality of pixels for displaying an image, and a detection unit for detecting the intensity of received light at a plurality of positions;
Range determining means for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
Position specifying means for specifying, for each of the determined ranges, a position where the intensity of light is detected most strongly within the range determined by the range determining means;
Control means for displaying an image indicating the position specified by the position specifying means.
The display device according to claim 11 or 12, wherein the image indicating the specified position is in a predetermined display form.
14. The display device according to claim 13, wherein the predetermined display form is a predetermined color.
The detection unit is capable of detecting the color of light received,
The display device according to claim 13, wherein the predetermined display form is a color detected by the detection unit.
The display device according to claim 13, wherein the predetermined display form is a predetermined shape.
A display method for displaying an image on a display device comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each of a plurality of positions,
A range determining step for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
A first position specifying step for specifying a position at the center of each range for each range determined in the range determining step;
And a third control step of displaying an image indicating the position specified in the first position specifying step.
A display method for displaying an image on a display device comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each of a plurality of positions,
A range determining step for determining a range in which the intensity of light detected by the detection unit is equal to or greater than a predetermined reference intensity;
A second position specifying step for specifying, for each of the determined ranges, a position having the strongest light intensity within the range determined in the range determining step;
And a fourth control step of displaying an image indicating the position specified in the second position specifying step.
Display means comprising a plurality of pixels for displaying an image, and a detection unit for detecting the intensity of received light at a plurality of positions;
Discriminating means for discriminating a pattern in which the intensity of light detected by the detection unit changes;
When the pattern discriminated by the discriminating means is the first pattern, the first control is performed on the display image, and the pattern discriminated by the discriminating means is different from the first pattern. And a control means for performing second control on the display image.
The first control is a control for displaying an image indicating a position of light detected by the detection unit;
The display device according to claim 19, wherein the second control is a control for manipulating a display image.
A display method for displaying an image on a display device comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each position,
A determination step of determining a pattern in which the intensity of light detected by the detection unit changes;
When the pattern determined in the determination step is the first pattern, the first control is performed on the display image, and the pattern determined in the determination step is different from the first pattern. And a fifth control step for performing second control on the display image.
Display means comprising a plurality of pixels for displaying an image, and a detection unit for detecting the intensity of received light at a plurality of positions;
A shape discriminating means for discriminating a shape formed by a reference position detected as a light intensity detected by the detection unit equal to or higher than a predetermined reference intensity;
And a control unit that performs predetermined control on the display image according to the shape determined by the shape determination unit.
23. The display device according to claim 22, wherein the predetermined control is control for scrolling and displaying the display image.
23. The display device according to claim 22, wherein the predetermined control is control for enlarging or reducing the display image, or returning and displaying the enlarged display image or the reduced display image.
A display method for displaying an image on a display device comprising a plurality of pixels for displaying an image and a detection unit for detecting the intensity of received light for each position,
A shape discriminating step for discriminating a shape formed by a reference position detected as a light intensity detected by the detection unit equal to or greater than a predetermined reference intensity;
And a sixth control step of performing predetermined control on the display image according to the shape determined in the shape determination step.
26. The display method according to claim 25, wherein the predetermined control is a control for scrolling and displaying the display image.
26. The display method according to claim 25, wherein the predetermined control is control for enlarging or reducing the display image, or returning and displaying the enlarged display image or the reduced display image.