JP2023097686A - Display method and display device - Google Patents

Abstract

To improve an operability as of when a user inputs characters by indicator.SOLUTION: A display method includes: receiving an input to a display surface; obtaining an input position subjected to the input; displaying a first object 101 on the display surface on the basis of the input position; determining whether or not the first object 101 is a character; and displaying, when the first object 101 is determined to be a character, a first guide image that guides the input position relating to the input on the display surface on the basis of a first region where the first object 101 is displayed.SELECTED DRAWING: Figure 6

Description

The present invention relates to a display method and a display device.

2. Description of the Related Art Conventionally, there is known a device that draws characters according to an input using an indicator such as a pen. For example, in the handwriting input mode, the device disclosed in Patent Literature 1 determines the character input direction from the input positions of a plurality of characters, and displays auxiliary lines along the input direction.

Japanese Unexamined Patent Application Publication No. 2011-233102

The device disclosed in Patent Document 1 needs to determine the character input direction in order to display the auxiliary line. That is, it requires multiple characters to be entered. Therefore, there is a problem that it takes time and effort from the start of character input until the auxiliary line is displayed.

According to one aspect of the present disclosure, receiving an input on a display surface, obtaining an input position where the input is performed, displaying a first object on the display surface based on the input position, Determining whether a first object is a character; and, if the first object is a character, displaying on the display surface based on a first region in which the first object is displayed, a and displaying a first guide image for guiding an input position.

Another aspect of the present disclosure is a display unit that displays on a display surface, an input unit that receives an input to the display surface, an input position at which the input is performed, and a second display based on the input position. a control unit that causes the display unit to display one object, wherein the control unit determines whether the first object is a character; and if the first object is a character, the first causing the display unit to display a first guide image that guides an input position related to the input based on a first area in which an object is displayed.

FIG. 2 is an external view showing an example of an installation state of the projector; Block diagram of a projector. 4 is a flowchart showing the operation of the projector according to the first embodiment; 4 is a flowchart showing the operation of the projector according to the first embodiment; 4A and 4B are diagrams showing examples of projected images in the first embodiment; FIG. 4A and 4B are diagrams showing examples of projected images in the first embodiment; FIG. FIG. 10 is a diagram showing an example of a projected image in the second embodiment; FIG. 8 is a flowchart showing the operation of the projector according to the second embodiment; FIG. 11 is a diagram showing an example of a projected image in the third embodiment; FIG. FIG. 11 is a diagram showing an example of a projected image in the third embodiment; FIG. 9 is a flowchart showing the operation of the projector according to the third embodiment; 9 is a flowchart showing the operation of the projector according to the third embodiment; FIG. 11 is a diagram showing another example of a projected image in the third embodiment; FIG. 11 is a diagram showing another example of a projected image in the third embodiment;

[1. First Embodiment]
[1-1. Projector configuration]
FIG. 1 is an external view showing an installation state of the projector 1. As shown in FIG. FIG. 1 shows an example in which a projector 1 according to the first embodiment is installed on a wall. In the installation state of FIG. 1, the projector 1 is fixed to the wall surface of the building and projects image light PL downward.

The projector 1 of this embodiment corresponds to an example of a display device. The projector 1 forms a projection image P on the screen SC by projecting the image light PL onto the screen SC, which is a projection target. Forming the projection image P by the projector 1 corresponds to displaying the projection image P on the screen SC. A screen SC corresponds to an example of a display surface.

The form of the screen SC is not limited as long as it can form an image by reflecting the image light PL emitted by the projector 1 . For example, the screen SC may be a flat surface such as a wall surface, or a hanging curtain. The screen SC may be a blackboard or whiteboard on which writing is possible.

The projector 1 detects an operation by the pointer 3 . The range in which the projector 1 detects the operation of the pointer 3 includes the range in which the image light PL is projected. That is, the projector 1 detects the position of the pointer 3 in the range including the projection image P. FIG. The indicator 3 may be a part of the user's body. As a specific example, the projector 1 may be configured to detect the finger of the user as the indicator 3 . Also, the indicator 3 may be a device that is held and operated by the user. For example, the shape of the pointer 3 can be pen-shaped, rod-shaped, or other shapes.

In this embodiment, an indicator 3A and an indicator 3B, which are pen-type devices, are exemplified. The indicators 3A and 3B have the same configuration. In the following description, the indicator 3A and the indicator 3B are referred to as the indicator 3 when not distinguished from each other.

A user performs an operation of indicating a position with the pointer 3 . For example, the user performs an operation of pointing the pointer 3 at a desired point in the projected image P. FIG. The projector 1 detects the position indicated by the pointer 3 . This position is called an input position, and processing for detecting the input position is called position detection processing. The position indicated by the indicator 3 is, for example, the position of the tip of the indicator 3, which is a pen-type device. When the user uses the user's finger as an indicator, the projector 1 detects the position of the tip of the finger as the input position.

The projector 1 forms characters and figures according to the input position of the indicator 3, and displays a projection image P including the formed characters and figures on the screen SC. The process of forming characters and figures by the projector 1 is called drawing. For example, the projector 1 forms a curved line or straight line along the locus of the input position of the pointer 3, and generates image data of the formed curved line or straight line when the input of the pointer 3 is completed. A series of processes up to generation of this image data corresponds to drawing. The projector 1 generates image light PL including generated image data, and projects the image light PL onto the screen SC. An image displayed on the screen SC based on the image data generated by the projector 1 is called an object. FIG. 1 shows an object 100 consisting of a curved line along the trajectory of the input position of the pointer 3 .

FIG. 2 is a block diagram of the projector 1. As shown in FIG.
The projector 1 includes a projection section 10 , an image processing section 11 , a frame memory 12 , an imaging section 13 , an image input section 14 , an operation section 15 and a control section 20 .

The projection unit 10 forms image light PL and projects the image light PL onto the screen SC. A configuration in which the projection unit 10 forms the image light PL includes, for example, a light source and a light modulation device that modulates the light emitted by the light source. The light source may be a lamp or a solid state light source. Solid-state light sources are, for example, LEDs (Light Emitting Diodes) and laser light sources. The optical modulator is composed of a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Mirror Device), or the like. Also, the projection unit 10 may include a self-luminous display element that emits the image light PL instead of the light source and the light modulation device. Self-luminous display elements include, for example, OLEDs (Organic LEDs). The projection unit 10 may include an optical element that guides the image light PL inside the projection unit 10 and an optical element that radiates the image light PL toward the screen SC. Examples of optical elements include lenses, dichroic mirrors, dichroic prisms, and polarizing optical elements, but other elements may also be used. The projection unit 10 corresponds to an example of a display unit.

The photographing unit 13 is a digital camera having an imaging device. The imaging device is, for example, a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The photographing unit 13 photographs a photographing range including the projection image P and outputs photographed image data to the control unit 20 . The photographing unit 13 may have an infrared transmission filter that absorbs visible light and transmits infrared light. In this case, the photographing unit 13 performs infrared photographing by receiving infrared light with the imaging element.

The image input unit 14 receives image signals from an external image supply device. Here, the image signal may be a still image signal or a video signal. The image supply device is, for example, a computer, media player, or the like. The image input unit 14 includes, for example, an input terminal connected to the image supply device via a cable, and an interface circuit for processing signals input to the input terminal. The image input unit 14 may be a wireless communication device that receives image signals by wireless communication.

The operation unit 15 detects user's operation. The operation unit 15 includes, for example, buttons and switches provided on the surface of the housing of the projector 1 . In this case, the operation unit 15 generates an operation signal corresponding to the button or switch operation and outputs the operation signal to the control unit 20 . The operation unit 15 may include a receiving circuit that receives a signal from a remote controller (not shown). In this case, the operation unit 15 detects an operation by the remote controller based on the signal received from the remote controller, and outputs an operation signal indicating the operation by the remote controller to the control unit 20 .

The control unit 20 is a computer device that includes a processor 21 and memory 30 . The control unit 20 controls the projector 1 by causing the processor 21 to execute the control program 31 stored in the memory 30 .

The memory 30 is a storage device that stores programs and data executed by the processor 21 in a non-volatile manner. The memory 30 is composed of a magnetic storage device, a semiconductor storage device such as a flash ROM (Read Only Memory), or other types of non-volatile storage devices. The memory 30 may include a RAM (Random Access Memory) forming a work area of the processor 21 . The memory 30 stores data processed by the control unit 20 and a control program 31 executed by the processor 21 .

The processor 21 may be composed of a single processor, or may be composed of a plurality of processors. The processor 21 may be composed of a part or all of the memory 30 and/or an SoC (System on Chip) integrated with other circuits. Further, as described above, the processor 21 may be configured by a combination of a CPU (Central Processing Unit) that executes programs and a DSP (Digital Signal Processor) that executes predetermined arithmetic processing. All the functions of the processor 21 may be implemented in hardware, or may be configured using a programmable device. The processor 21 may also function as the image processing section 11 . That is, the functions of the image processing section 11 may be executed by the processor 21 .

The control unit 20 includes a reception unit 22 , a drawing processing unit 23 , and a projection control unit 24 as functional blocks realized by the control program 31 . These functional blocks represent functions realized by the processor 21 executing the control program 31 for convenience.

The accepting unit 22 accepts an input by the indicator 3 and identifies the input position. Specifically, the receiving unit 22 acquires the image captured by the image capturing unit 13 and extracts the image of the indicator 3 from the captured image. The process of extracting the image of the pointer 3 is performed using, for example, pattern matching or other known image processing.

Alternatively, the pointer 3 may emit infrared light, the photographing unit 13 may perform infrared photographing, and the receiving unit 22 may detect the input position based on the infrared photographed image. Specifically, the pointer 3 may be configured to include an infrared light source that emits infrared light, and to emit the infrared light from the tip of the pointer 3 . The photographing unit 13 performs infrared photographing using the infrared transmission filter described above, and outputs an infrared photographed image to the control unit 20 . The reception unit 22 extracts an image of infrared light emitted by the tip of the pointer 3 from the infrared image captured by the image capturing unit 13 . The reception unit 22 further determines whether or not the tip of the pointer 3 is in contact with the screen SC based on the position of the infrared captured image. When the reception unit 22 determines that the tip of the indicator 3 is in contact with the screen SC, the reception unit 22 specifies the position of the tip of the indicator 3 as the input position.

In a configuration in which the indicator 3 emits infrared light, the projector 1 can distinguish between the indicator 3A and the indicator 3B. For example, there is a configuration in which the indicator 3A and the indicator 3B emit infrared light in a predetermined pattern by blinking the infrared light source. In this case, the indicator 3A and the indicator 3B emit infrared light in different patterns. The reception unit 22 can distinguish between the input by the indicator 3A and the input by the indicator 3B based on the emission pattern of the infrared light. For example, the reception unit 22 can identify the infrared light emission pattern of the pointer 3 by extracting the infrared light image emitted by the pointer 3 from a plurality of captured images captured by the imaging unit 13 at different timings. .

The projector 1 may include a light emitting device that emits infrared light toward the vicinity of the screen SC. In this case, an object that reflects infrared light emitted by the light emitting device can be used as the indicator 3 . For example, a user's finger can be used as the indicator 3 . According to this configuration, the infrared light emitted by the light-emitting device is reflected by the pointer 3 and reflected in the infrared photographed image of the photographing unit 13 . The drawing processing unit 23 can detect the input of the pointer 3 by extracting the reflected light image from the infrared photographed image. The reflected light of the pointer 3 detected in this manner reflects the light emission pattern of the light emitting device. Therefore, by setting the light emission pattern of the light emitting device to a light emission pattern different from that of the indicators 3A and 3B, the projector 1 can distinguish between the indicators 3, 3A, and 3B that do not emit infrared light. can.

The drawing processing unit 23 generates an object based on the input position detected by the receiving unit 22 . An object is a drawing object projected by the projection unit 10 . The drawing processing unit 23 acquires from the receiving unit 22 the trajectory of the input position from the start of input by the pointer 3 until the input is stopped. The start of input by the pointer 3 refers to, for example, when the reception unit 22 detects that the tip of the pointer 3 has touched the screen SC. Stopping the input by the indicator 3 means, for example, when the receiving unit 22 detects that the tip of the indicator 3 has left the screen SC. The drawing processing unit 23 forms, for example, a curve along the trajectory of the input position. This curve corresponds to the object. The drawing processing unit 23 outputs image data of the object to the image processing unit 11 . The image processing section 11 generates an image signal of the projection image P based on the image data input from the drawing processing section 23 and outputs the image signal to the projection section 10 .

The drawing processing unit 23 determines whether the generated object is a character. When the object is a character, the drawing processing unit 23 forms a guide image that guides character input. The drawing processing unit 23 generates image data of the guide image and outputs the image data to the image processing unit 11 . As a result, a guide image for character input is displayed on the screen SC, which makes it easier for the user to input characters with the indicator 3 . For example, the well-known OCR (Optical Character Reading) technology can be used for the process of determining whether the object is a character by the drawing processing unit 23 .

The projection control unit 24 controls the projection unit 10 to project an image based on the image signal generated by the image processing unit 11 onto the screen SC.

The image processing unit 11 can be configured by, for example, an integrated circuit. The integrated circuit is configured by, for example, an LSI (Large Scale Integration). More specifically, the image processing circuit 42 is configured by an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or the like. PLDs include, for example, FPGAs (Field-Programmable Gate Arrays). Also, part of the configuration of the integrated circuit may include an analog circuit, or may be a combination of a processor and an integrated circuit. A combination of a processor and an integrated circuit is called a microcontroller (MCU), SoC, system LSI, chipset, or the like.

The image processing section 11 generates an image signal for projecting the projection image P under the control of the control section 20 . The image processing section 11 is connected to the frame memory 12 . The frame memory 12 is configured by, for example, SDRAM (Synchronous Dynamic Random Access Memory). The image processing unit 11 develops image data input from the control unit 20 in the frame memory 12 . The image processing unit 11 executes image processing on the image data developed in the frame memory 12 . The image processing unit 11 executes, for example, resolution conversion processing, geometric correction processing, digital zoom processing, and image correction processing for adjusting the hue and brightness of an image. The image processing unit 11 generates an image signal for displaying the processed image, and outputs the image signal to the projection unit 10 . Projector 10 forms image light PL based on an image signal input from image processor 11 .

[1-2. Projector operation]
3 and 4 are flowcharts showing the operation of the projector 1. FIG. 5 and 6 are diagrams showing examples of the projection image P in the first embodiment. The operation of the projector 1 will be described with reference to these figures.

The operations shown in steps S11 to S17 in FIG. 3 and steps S21 to S26 in FIG. Specifically, steps S11 to S12 and S17 are executed by the reception unit 22, step S13 is executed by the drawing processing unit 23 and the projection control unit 24, and steps S14 to S16 are executed by the drawing processing unit 23.

In step S<b>11 , the projector 1 waits for input by the pointer 3 . The projector 1 determines whether or not there is an input from the pointer 3 in step S11. When it is determined that there is no input by the pointer 3 (step S11; NO), the projector 1 waits for a predetermined time in step S11. If it is determined that there is an input by the pointer 3 (step S11; YES), the projector 1 proceeds to step S12.

In step S<b>12 , the projector 1 detects the input position of the pointer 3 . At step S13, the projector 1 generates an object based on the input position detected at step S12. In step S13, the projector 1 also displays the object on the screen SC.

In step S14, the projector 1 determines whether the object generated in step S13 is a character. When the projector 1 determines that the object is not a character (step S14; NO), the process proceeds to step S17, which will be described later. When the projector 1 determines that the object is a character (step S14; YES), the process proceeds to step S15.

FIG. 5 shows an example in which the projector 1 projects a rectangular projection image P onto a rectangular screen SC. In this example, the projector 1 sets an XY orthogonal coordinate system in the range in which the projection image P is projected. This coordinate system has an origin at the upper left corner of the projected image P, and includes an X-axis pointing to the lower right and a Y-axis pointing downward.

In the example shown in FIG. 5, the first object 101 is displayed based on the input position when the user performs input using the indicator 3A. The shape of the first object 101 in FIG. 3 is a shape similar to the letter "A". In this example, the projector 1 determines that the first object 101 is a character.

In step S15, the projector 1 determines whether or not the guide image is being displayed on the screen SC. If the guide image is already being displayed (step S15; YES), the projector 1 proceeds to step S17, which will be described later. If the guide image is not being displayed (step S15; NO), the projector 1 proceeds to step S16 and executes guide image display processing. After the guide image display process, the projector 1 proceeds to step S17.

In step S<b>17 , the projector 1 determines whether or not to end processing for the input of the pointer 3 . For example, when the end of processing is instructed by the input of the pointer 3 or the image input unit 14, the projector 1 ends the processing for the input of the pointer 3. FIG.

If the process for the input of the pointer 3 is not finished (step S17; NO), the projector 1 returns to step S11. When ending the process for the input of the pointer 3 (step S17; YES), the projector 1 ends this process.

FIG. 4 shows in detail the guide image display process of step S16. Steps S21 to S26 in FIG. 4 are executed by the drawing processing unit 23. FIG.
In step S21, the projector 1 identifies the first area containing the object determined to be a character. Subsequently, in step S22, the projector 1 identifies the position and size of the first area. The first area is, for example, a rectangular area including the edge of the object on the X axis and the edge of the object on the Y axis. The position of the first area is, for example, the XY coordinates of the center of the first area. The size of the first region is, for example, the length of the first region on the X-axis and the length of the first region on the Y-axis.

FIG. 5 shows the first area 131 corresponding to the first object 101 . A first area 131 is a rectangular area that includes the first object 101 . The projector 1 specifies the width WT1 and the height HT1 as the size of the first area 131 . The width WT1 corresponds to the size on the X-axis and the height HT1 corresponds to the size on the Y-axis.

In step S23, the projector 1 calculates the intervals between the ruled lines forming the guide image. In this embodiment, the projector 1 displays horizontal ruled lines made of straight lines extending in the horizontal direction and vertical ruled lines made of straight lines extending in the vertical direction as guide images. The horizontal direction is parallel to the X-axis and the vertical direction is parallel to the Y-axis. When the user draws a plurality of characters with the pointer 3, the guide image helps the user to align the characters in the horizontal and vertical directions and the sizes of the characters in the horizontal and vertical directions.

FIG. 6 shows a state in which the guide image 201 is displayed based on the first object 101. As shown in FIG. The guide image 201 includes multiple horizontal ruled lines 211 and multiple vertical ruled lines 212 . A guide image 201 corresponds to an example of a first guide image. The guide image 201 is an image that guides the input position when the user inputs a character using the indicator 3, and is an image that indicates a rough indication of the character input position.

In step S23, the projector 1 calculates the intervals between the horizontal ruled lines and the intervals between the vertical ruled lines included in the guide image. For example, the vertical ruled line spacing HL1, which is the spacing between horizontal ruled lines 211 in FIG. 6, is calculated from the height HT1 of the first object 101 . The ruled line vertical interval HL1 may have a length obtained by adding a predetermined margin to the height HT1, or may be equal to the height HT1. The horizontal ruled line spacing WL1, which is the spacing between the vertical ruled lines 212, is calculated from the width WT1 of the first object 101. FIG. The ruled line horizontal interval WL1 may have a length obtained by adding a predetermined margin to the width WT1, or may be equal to the width WT1.

In step S24, the projector 1 arranges horizontal ruled lines according to the intervals calculated in step S23. Specifically, the projector 1 arranges a first horizontal ruled line that overlaps the top end or the bottom end of the first area. Next, using the first horizontal ruled line as a reference, the projector 1 arranges horizontal ruled lines above and below the first area at the intervals calculated in step S23. The projector 1 does not arrange ruled lines outside the upper end of the projected image P and outside the lower end of the projected image P.

Subsequently, in step S25, the projector 1 arranges vertical ruled lines according to the intervals calculated in step S23. Specifically, the projector 1 arranges a first vertical ruled line that overlaps the right end or left end of the first area. Next, using the first vertical ruled line as a reference, the projector 1 arranges vertical ruled lines on the right and left sides of the first area at the intervals calculated in step S23. The projector 1 does not arrange ruled lines outside the right edge of the projection image P and outside the left edge of the projection image P. As shown in FIG.

Note that the first horizontal ruled line may be arranged at a predetermined distance from the top end or bottom end of the first area. Similarly, the first vertical ruled line may be spaced a predetermined distance from the right or left edge of the first region.

In step S26, the projector 1 generates a guide image including the ruled lines laid out in steps S24 and S25. The projector 1 displays the guide image on the screen SC, and proceeds to step S17 in FIG.

A plurality of horizontal ruled lines 211 included in the guide image 201 of FIG. A plurality of horizontal ruled lines 211 are arranged in the projection image P with a ruled line vertical interval HL1 therebetween. The guide image 201 also includes a vertical ruled line 212 that overlaps the right edge of the first area 131 and a vertical ruled line 212 that overlaps the left edge of the first area 131 . A plurality of vertical ruled lines 212 are arranged on the projection image P with a horizontal ruled line interval WL1 from each other.

[1-3. action]
As described above, the display method according to the first embodiment of the present disclosure accepts an input to the screen SC, acquires the input position where the input is performed, and displays the first object 101 based on the input position. on the screen SC. It also includes determining whether the first object 101 is a character. Further, when the first object 101 is a character, a first guide image for guiding an input position related to input is displayed on the screen SC based on the first area 131 where the first object 101 is displayed. and including.

The projector 1 according to the first embodiment includes a projection section 10 that displays on the screen SC, and a reception section 22 that receives input to the screen SC. The projector 1 also includes a control unit 20 that acquires an input position where an input has been made and causes the projection unit 10 to display the first object 101 based on the input position. The control unit 20 determines whether the first object 101 is a character, and if the first object 101 is a character, the control unit 20 determines whether the first object 101 is a character, based on the first area 131 in which the first object 101 is displayed. and causing the projection unit 10 to display a guide image 201 for guiding the input position to be input.

Thus, when characters are input by the pointer 3, the guide image 201 is displayed based on the first area 131 in which the characters are input. The projector 1 can display the guide image 201 even when only one character is input, for example. Therefore, since the guide image 201 can be displayed immediately after the character input is started, the user's burden when inputting characters with the pointer 3 can be reduced, and the operability can be improved.

For example, as shown in FIG. 6, when the user continues to input characters after the first object 101 is displayed based on the input position of the indicator 3, the user follows the guide image 201 to move the characters horizontally. You can input so as to line up with In this case, it is possible to reduce the user's burden when inputting characters arranged in an easy-to-read manner, so that an easy-to-read character string can be easily input by the indicator 3 .

[2. Second Embodiment]
FIG. 7 is a diagram showing an example of the projection image P in the second embodiment. FIG. 8 is a flow chart showing the operation of the projector 1 in the second embodiment.
In the second embodiment, the configuration of the projector 1 is the same as the configuration described in the first embodiment, so illustration and description are omitted here.

In the second embodiment, an example in which the first object 101 is displayed based on the input of the pointer 3 while the second object 102 is displayed in the projection image P as shown in FIG. 7 will be described. The second object 102 is an object displayed by the projector 1 based on the input of the pointer 3 before the first object 101 .

The projector 1 generates the first object 101 based on the input of the pointer 3 and displays the projection image P including the first object 101 . In this case, the projected image P already contains the second object 102 .

The projector 1 displays the guide image 201 when determining that the first object 101 is a character. The guide image 201 is displayed in an area other than the second area 132 where the second object 102 is displayed. Specifically, the projector 1 sets the area overlapping the second object 102 as the second area 132 and the area other than the second area 132 as the third area 133 in the projected image P. The projector 1 displays the guide image 201 on the third area 133 . The interval between the horizontal ruled lines 211 and the interval between the vertical ruled lines 212 displayed in the third area 133 are determined in the same manner as in the first embodiment.

The operation of the projector 1 according to the second embodiment is the same as that according to the first embodiment except for the processing shown in FIG. The operation of FIG. 8 is executed by the projector 1 in place of the operation shown in FIG. The operations of steps S21 to S23 and steps S31 to S36 in FIG.

The processes of steps S21 to S23 are common to the first embodiment. In step S31, the projector 1 detects existing objects. For example, the projector 1 detects the second object 102 shown in FIG. In step S32, the projector 1 determines the second area including the object detected in step S31. The second area is an area containing the object detected in step S31. For example, the second area includes a range in which the X-coordinate of the left end of the second object 102 and the Y-coordinate of the top end of the second object 102 are used as a reference, and the X-coordinate or the Y-coordinate is larger than the reference. The second region may include reference X and Y coordinates.

In the example of FIG. 7 , the second area 132 includes the left edge of the second object 102 and a range of X coordinates larger than the left edge of the second object 102 . Also, the second area 132 includes the upper end of the second object 102 and a range in which the Y coordinate is larger than the upper end of the second object 102 . This is an example, and for example, the second area 132 may be a rectangular area surrounded by the top edge, bottom edge, left edge, and right edge of the second object 102 . Also, the second area 132 may be an area surrounded by the outer edge of the second object 102 and having a shape corresponding to the second object 102 .

In step S33, the projector 1 avoids the second area and sets the third area. In the example of FIG. 7, the third area 133 is the entire portion of the projection image P other than the second area 132 .

In step S34, the projector 1 arranges horizontal ruled lines in the third area. Also, in step S35, the projector 1 arranges a vertical ruled line in the third area. The operations of steps S34 and S35 are performed according to the interval between the ruled lines calculated in step S23, as in steps S24 and S25 of FIG.

In step S36, the projector 1 generates a guide image including the ruled lines laid out in steps S34 and S35. The projector 1 displays the guide image on the screen SC, and proceeds to step S17 in FIG.

As described above, the display method by the projector 1 is such that when the first object 101 is displayed after the second object 102 is displayed in the second area 132 different from the first area 131, the guide image 201 is displayed in the second area on the display surface. and drawing in a third region 133 excluding the second region 132 . As a result, when the user draws a character with the indicator 3, the guide image 201 for inputting the character avoiding the already displayed second object 102 is displayed on the screen SC. For this reason, it is possible to reduce the burden on the user when performing character input using the indicator 3, and improve operability. In the display method shown in the second embodiment, the projector 1 can display the guide image 201 even when only one character is input, for example. Therefore, there is an advantage that the guide image can be displayed immediately after the character input is started.

[3. Third Embodiment]
9 and 10 are diagrams showing examples of the projection image P in the third embodiment. 11 and 12 are flowcharts showing the operation of the projector 1 according to the third embodiment.
In the third embodiment, the configuration of the projector 1 is the same as the configuration described in the first embodiment, so illustration and description are omitted here.

In the third embodiment, as shown in FIG. 9, an example will be described in which the first object 101 and the third object 103 are displayed based on the respective inputs of the indicator 3A and the indicator 3B. The projector 1 displays the first object 101 based on the input of the indicator 3A, and displays the third object 103 based on the input of the indicator 3B. In the third embodiment, the indicator 3A corresponds to an example of the first indicator, and the indicator 3B corresponds to an example of the second indicator.

In this example, the projector 1 displays the third object 103 based on the input of the pointer 3B after displaying the first object 101 based on the input of the pointer 3A. When the first object 101 is displayed, the projector 1 displays the guide image 201 according to the first area 131 where the first object 101 is displayed, as described in the first embodiment.

The projector 1 displays the third object 103 when receiving the input of the pointer 3B. The projector 1 displays the guide image 203 according to the third object 103 when the third object 103 is displayed based on the input of the indicator 3B. The guide image 203 is an image that guides the input position by the pointer 3B. A guide image 203 corresponds to an example of a second guide image.

FIG. 10 shows an example in which the guide image 203 is displayed. The guide image 203 in FIG. 10 includes horizontal ruled lines 231 and vertical ruled lines 232 . The intervals between the horizontal ruled lines 231 included in the guide image 203 are determined based on the height HT2 of the fourth area 134 where the third object 103 is displayed. Also, the intervals between the plurality of vertical ruled lines 232 included in the guide image 203 are determined based on the width WT2 of the fourth area 134 .

The projector 1 performs processing to prevent the guide image 201 and the guide image 203 from overlapping in the projection image P. FIG. First, as a first example, when the projector 1 displays the third object 103 after the input by the indicator 3A is completed or while the input by the indicator 3A is not being performed, the guide image 201 is displayed. It is erased and the guide image 203 is displayed.

That is, the projector 1 displays the guide image 201 when displaying the first object 101 according to the input of the indicator 3A. Furthermore, when the third object 103 is displayed according to the input of the indicator 3B, the display of the guide image 201 is stopped and the guide image 203 is displayed according to the third object 103. FIG. This series of operations is shown in FIGS. 11 and 12. FIG.

The operations shown in FIGS. 11 and 12 are executed by the projector 1 instead of the operations shown in FIGS. In the following description, the same step numbers are given to the processes that are common to the first embodiment, and description thereof is omitted. Step S41 in FIG. 11 is executed by the reception unit 22, and steps S42 to S43 and steps S51 to S59 in FIG. Step S<b>60 is executed by the drawing processing section 23 and the projection control section 24 .

The projector 1 receives the input of the pointer 3 and detects the input position in steps S11 and S12. Here, the projector 1 determines the pointer in step S41. The projector 1 determines whether the input from the pointer 3 detected in step S11 is the input from the pointer 3A or the input from the pointer 3B. After that, the projector 1 proceeds to step S13.

When the projector 1 determines in step S15 that the guide image is being displayed (step S15; YES), the process proceeds to step S42. In step S<b>42 , the projector 1 determines whether or not the guide images being displayed are guide images corresponding to the same pointer 3 . For example, when the projector 1 determines in step S41 that the input received by the receiving unit 22 is the input by the indicator 3A, in step S42, the guide image being displayed becomes the object displayed by the input by the indicator 3A. It is determined whether or not it is a corresponding guide image. Further, for example, when the projector 1 determines in step S41 that the input received by the receiving unit 22 is input by the indicator 3B, in step S42, the guide image being displayed is displayed by the input by the indicator 3B. It is determined whether or not the guide image corresponds to an object.

When the projector 1 determines that the guide image being displayed is the guide image corresponding to the same pointer 3 (step S42; YES), the process proceeds to step S17.

When the projector 1 determines that the guide image being displayed is not the guide image corresponding to the same pointer 3 (step S42; NO), the process proceeds to step S43. This case corresponds to, for example, a case where an input by the indicator 3B is received while the guide image 201 is being displayed corresponding to the first object 101 drawn according to the input by the indicator 3A.

In step S43, the projector 1 executes guide image update processing. Details of the guide image update process are shown in FIG.

In step S51, the projector 1 erases the guide image being displayed. Specifically, the projector 1 deletes the guide image from the image developed in the frame memory 12 by the image processing unit 11 .

In step S52, the projector 1 identifies the area corresponding to the object displayed in step S13. For example, in the example of FIG. 10, the third object 103 is displayed in step S13. The projector 1 specifies the fourth area 134 corresponding to the third object 103 in step S52. Subsequently, in step S53, the projector 1 identifies the position and size of the fourth area.

The fourth area is, for example, a rectangular area including the edge of the third object 103 on the X axis and the edge of the third object 103 on the Y axis. The position of the fourth area is, for example, the XY coordinates of the center of the fourth area. The size of the fourth area is, for example, the length of the fourth area on the X axis and the length of the fourth area on the Y axis.

A fourth area 134 in FIG. 10 is a rectangular area including the third object 103 . The projector 1 specifies the width WT2 and the height HT2 as the size of the fourth area 134 . The width WT2 corresponds to the size on the X-axis and the height HT2 corresponds to the size on the Y-axis.

In step S54, the projector 1 calculates the interval between the ruled lines forming the guide image. In this embodiment, the projector 1 displays horizontal ruled lines made of straight lines extending in the horizontal direction and vertical ruled lines made of straight lines extending in the vertical direction as guide images. The horizontal direction is parallel to the X-axis and the vertical direction is parallel to the Y-axis. When the user draws a plurality of characters with the pointer 3, the guide image helps the user to align the characters in the horizontal and vertical directions and the sizes of the characters in the horizontal and vertical directions.

In step S54, the projector 1 calculates the intervals between the horizontal ruled lines and the intervals between the vertical ruled lines included in the guide image. For example, the interval between horizontal ruled lines 231 in FIG. 10 is calculated from the height HT2 of the third object 103 . This interval may have a length equal to the height HT2 plus a predetermined margin, or may be equal to the height HT2. The spacing of the vertical ruled lines 232 is calculated from the width WT2 of the third object 103 . This interval may be the width WT2 plus a predetermined margin, or may be equal to the width WT2.

In step S55, the projector 1 detects existing objects. For example, the projector 1 detects the first object 101 shown in FIG. 10 . In step S56, the projector 1 determines the third area including the object detected in step S55. The third area is an area containing the object detected in step S55.

Specifically, the third area includes a range in which the X-coordinate of the left end of the existing object and the Y-coordinate of the top end of the existing object are used as references, and the X-coordinate or Y-coordinate is larger than the reference. The third region may include reference X and Y coordinates.

In the example of FIG. 10 , the third area 133 includes the left edge of the first object 101 and a range of X coordinates larger than the left edge of the first object 101 . Also, the third area 133 includes an upper end of the first object 101 and a range having a larger Y coordinate than the upper end of the second object 102 . This is just an example, and for example, the third area 133 may be the same as the first area 131 , which is a rectangular area surrounded by the top, bottom, left, and right edges of the first object 101 . Also, the third area 133 may be an area surrounded by the outer edge of the first object 101 and having a shape corresponding to the first object 101 .

In step S57, the projector 1 sets a new area avoiding the third area. In the example of FIG. 10, the new area 135 is all parts of the projection image P other than the third area 133. In the example of FIG.

In step S58, the projector 1 arranges horizontal ruled lines in the new area. Also, in step S59, the projector 1 arranges a vertical ruled line in the new area. The operations of steps S58 and S59 are performed according to the interval between the ruled lines calculated in step S54.

Specifically, in step S58, the projector 1 arranges horizontal ruled lines according to the intervals calculated in step S54. The projector 1 arranges a first horizontal ruled line that overlaps the upper end or the lower end of the fourth area. Next, using the first horizontal ruled line as a reference, the projector 1 arranges horizontal ruled lines above and below the fourth area at the intervals calculated in step S54. The projector 1 does not arrange ruled lines outside the upper end of the projected image P, outside the lower end of the projected image P, and in the third area.

Subsequently, in step S59, the projector 1 arranges vertical ruled lines according to the intervals calculated in step S54. Specifically, the projector 1 arranges a first vertical ruled line that overlaps the right end or left end of the fourth area. Next, using the first vertical ruled line as a reference, the projector 1 arranges vertical ruled lines on the right and left sides of the fourth area at the intervals calculated in step S54. The projector 1 does not arrange ruled lines outside the right edge of the projection image P, outside the left edge of the projection image P, and in the third area.

Note that the first horizontal ruled line may be arranged at a predetermined distance from the upper end or lower end of the fourth area. Similarly, the first vertical ruled line may be arranged at a predetermined distance from the right or left edge of the fourth area.

In step S60, the projector 1 generates a guide image including the ruled lines laid out in steps S58 and S59. The projector 1 displays the guide image on the screen SC, and proceeds to step S17 in FIG.

A plurality of horizontal ruled lines 231 included in the guide image 203 of FIG. A plurality of horizontal ruled lines 231 are arranged in the projected image P with a space corresponding to the height HT2 from each other. The guide image 203 also includes a vertical ruled line 232 overlapping the right edge of the fourth area 134 and a vertical ruled line 232 overlapping the left edge of the fourth area 134 . A plurality of vertical ruled lines 232 are arranged in the projection image P with a space corresponding to the width WT2 from each other.

In the example of FIG. 10, there is a portion in which the vertical ruled line 232 is not arranged in the area to the right of the third area 133 . That is, by arranging the vertical ruled lines 232 at intervals corresponding to the width WT2 so as not to overlap the third region 133, a blank space may be generated in the third region 133 in the X-axis direction. The same is true for the horizontal ruled lines 231 .

Thus, according to the display method according to the third embodiment, accepting an input to the screen SC includes accepting a first input to the screen SC by the indicator 3A and a second input to the screen SC by the indicator 3B. including receiving In this display method, when the first input is performed, the first input position where the first input is performed is obtained, and the first object 101 is displayed on the screen SC based on the first input position. and including. In this display method, when the second input is performed, the second input position at which the second input is performed is acquired, and the third object 103 is displayed on the screen SC based on the second input position. and including. In this display method, when the third object 103 is a character, the guide image 203 for guiding the input position related to the second input is displayed on the screen SC based on the fourth area where the third object 103 is displayed. and displaying.

Thereby, the projector 1 distinguishes between the pointer 3A and the pointer 3B, and displays the guide image 203 corresponding to the second input corresponding to the pointer 3B. Therefore, for example, when characters are input using a plurality of indicators 3A and 3B, the guide images 201 and 203 corresponding to the indicators 3A and 3B are displayed to reduce the user's burden.

The display method by the projector 1 further includes ending display of the guide image 201 when the guide image 203 is displayed after the guide image 201 is displayed. Further, the display method by the projector 1 includes, after displaying the guide image 201, terminating the display of the guide image 201 when the second input is performed while the first input is not performed. It's okay.
Thus, the guide image 203 can be displayed without mixing the guide images 201 and 203 together. Therefore, the visibility of the projected image P can be maintained well. Furthermore, since the guide image 203 can be displayed in an easy-to-see state during input by the pointer 3B, operability can be further improved.

In the third embodiment, the projector 1 may be configured to display the guide image 203 without erasing the guide image 201 . A display example in this case is shown in FIG.

FIG. 13 is a diagram showing another example of the projection image P in the third embodiment.
A projection image P shown in FIG. 13 includes a first object 101 and a third object 103 . In the example of FIG. 13, the guide image 201 is displayed in the third area 133 where the first object 101 is arranged. Further, a guide image 203 is displayed in a new area 135 which is a portion other than the third area 133 in the projection image P. FIG.

As for the display mode shown in FIG. 13, for example, in the operation shown in FIG. 12, the guide image 201 may be displayed only in the third area 133 determined in step S56 without executing step S51. In other words, the guide image 201 in the new area 135 may be deleted. Other operations are performed as described with reference to FIGS.

Thus, according to the display method shown in FIG. 13, the screen SC is provided with the first display area and the second display area. In this display method, the guide image 201 is displayed in the first display area including the display position of the first object 101, and the guide image 203 is displayed in the second display area including the display position of the third object 103. , further includes. The first display area corresponds to the third area 133, for example, and the second display area corresponds to the new area 135, for example.
Accordingly, the user using the indicator 3A can input characters using the guide image 201 as a guide, and the user using the indicator 3B can input characters using the guide image 203 as a guide.

According to the display shown in FIG. 13, it is possible to cope with an operation of inputting characters in parallel using a plurality of pointers 3A and 3B.
In the third embodiment, as a first example, the case where the projector 1 displays the third object 103 after the input by the indicator 3A is completed or while the input by the indicator 3A is not being performed will be described. bottom. On the other hand, the display mode shown in FIG. 13 may be executed when the input by the indicator 3A is not completed, or when the input by the indicator 3B is accepted during the input by the indicator 3A. In this case, since the display of the guide image 201 is continued, the guide image 201 can guide the input using the pointer 3A. Furthermore, by displaying the guide image 203, the input by the indicator 3B can be guided by the guide image 203. FIG. Therefore, it is possible to improve the operability of input using both the indicators 3A and 3B.

The display method by the projector 1 may further include displaying the guide image 203 in a color different from that of the guide image 201 in the display mode of FIG. 13 . In this case, the user can easily distinguish between the guide image 201 corresponding to the indicator 3A and the guide image 203 corresponding to the indicator 3B. Therefore, it is possible to improve the convenience of both the user using the indicator 3A and the user using the indicator 3B.

Further, the projector 1 may divide the projected image P into an area corresponding to the input of the indicator 3A and an area corresponding to the input of the indicator 3B. That is, the projected image P may be divided into two or more areas, one of which may be the first display area, and one of the other areas may be the second display area. The first display area should just include the first object 101 , and the second display area should just include the third object 103 . Specifically, the projector 1 may divide the projected image P horizontally or vertically to provide a first display area and a second display area.

FIG. 14 is a diagram showing another example of the projected image P in the third embodiment. FIG. 14 shows an example in which the first object 101 and the third object 103 are displayed while the second object 102 is displayed. In this example, areas other than the second area 132 including the second object 102 are the third area 133 and the new area 135 .

The display mode of FIG. 14 can be realized by the projector 1 determining the second area 132 including the second object 102 in addition to the third area 133 including the first object 101 in step S56 shown in FIG. is. That is, the projector 1 sets the new area 135 so as to avoid the third area 133 and the second area 132 in step S57. Also in this case, similarly to the example shown in FIG. 13, it is possible to obtain the effect that the operability of using the indicators 3A and 3B can be improved.

[4. Other embodiments]
Each embodiment described above is a disclosure of a preferred embodiment. However, the present disclosure is not limited to the embodiment described above, and various modifications are possible.

For example, there is no limit to the number and types of pointers 3 that can be used in the projector 1 described above. For example, the operation described in the third embodiment may be performed by identifying the indicator 3A and the user's fingers. Further, in the above-described embodiment, an example in which the projector 1 optically detects the pointer 3 has been described, but this is just an example. For example, the projector 1 may be configured to detect the input position of the pointer 3 by performing wireless communication with the pointer 3 .

Further, the display examples shown in each of the above embodiments are merely examples, and the shapes and types of objects determined as characters by the projector 1 can be expanded as appropriate. The language of characters determined by the projector 1 is not limited, and may include symbols, pictographs, or pictorial symbols.

Further, in each of the above-described embodiments, the configuration using the projector 1 as an example of the display device has been described. As the display device, for example, a display device that displays an image on a display panel may be used. In this case, the display panel corresponds to the display surface, and the control section or driving section for displaying an image on the display panel corresponds to the display section. Examples of the display panel include a liquid crystal display panel, an OLED panel, or an OEL (Organic Electro Luminescence) display panel, but other display methods may be used.

Moreover, each functional unit of the projector 1 shown in FIG. 2 shows a functional configuration, and a specific implementation form is not particularly limited. In other words, it is not always necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to adopt a configuration in which one processor executes a program to realize the functions of a plurality of functional units. Further, a part of the functions realized by software in the above embodiments may be realized by hardware, and a part of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of other parts of the projector can be arbitrarily changed without departing from the scope of the present invention.

Also, the processing unit of each flowchart is divided according to the main processing content in order to facilitate understanding of the processing of the projector 1 . The present invention is not limited by the division method and names of the processing units shown in the above flowcharts. Further, the processing of the control unit 20 can be divided into more processing units according to the processing contents, or can be divided so that one processing unit includes more processing. Also, the processing order of the above flowchart is not limited to the illustrated example.

Further, when the display device control method is implemented using a computer provided in the projector 1, the program to be executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. A magnetic or optical recording medium, a disk-type recording medium, or a semiconductor memory device can be used as the recording medium. Further, the recording medium may be a non-volatile storage device such as a RAM, ROM, HDD, etc., which is an internal storage device provided in the server device.

DESCRIPTION OF SYMBOLS 1... Projector (display apparatus) 3, 3A, 3B... Indicator, 10... Projection part (display part), 11... Image processing part, 12... Frame memory, 13... Shooting part, 14... Image input part, 15... Operation unit 20 Control unit 21 Processor 22 Reception unit 23 Drawing processing unit 24 Projection control unit 30 Memory 31 Control program 42 Image processing circuit 101 First object 102... second object, 103... third object, 131... first area, 132... second area, 133... third area, 134... fourth area, 135... new area, 201... guide image (first guide image ), 203... Guide image (second guide image), P... Projected image, SC... Screen (display surface).

Claims (8)

receiving input to the display surface;
obtaining an input location where the input was made;
displaying a first object on the display surface based on the input position;
determining if the first object is a character;
displaying a first guide image for guiding an input position related to the input on the display surface based on a first area where the first object is displayed when the first object is a character; , including, how to display. When the first object is displayed after displaying the second object in a second area different from the first area, the first guide image is rendered in a third area on the display surface excluding the second area. 2. The display method of claim 1, further comprising: accepting an input to the display surface includes accepting a first input to the display surface by a first indicator; and accepting a second input to the display surface by a second indicator;
obtaining a first input position at which the first input is performed if the first input is performed;
displaying the first object on the display surface based on the first input position;
obtaining a second input position where the second input is performed when the second input is performed;
displaying a third object on the display surface based on the second input position;
displaying a second guide image for guiding an input position related to the second input on the display surface based on a fourth area in which the third object is displayed when the third object is a character; 3. The display method according to claim 1 or 2, further comprising: 4. The display method according to claim 3, further comprising, when displaying the second guide image after displaying the first guide image, ending display of the first guide image. After displaying the first guide image, if the second input is performed while the first input is not performed, the display of the first guide image is terminated. 3. The display method described in 3. 6. The display method according to any one of claims 3 to 5, further comprising displaying the second guide image in a color different from that of the first guide image. displaying the first guide image in a first display area including the display position of the first object;
7. The display method according to any one of claims 3 to 6, further comprising displaying the second guide image in a second display area including the display position of the third object. a display unit for displaying on a display surface;
a reception unit that receives an input to the display surface;
a control unit that acquires the input position where the input is performed and displays the first object on the display unit based on the input position;
The control unit
determining if the first object is a character;
causing the display unit to display a first guide image that guides an input position related to the input based on a first area in which the first object is displayed when the first object is a character; Display device including.

Images