WO2016129489A1

WO2016129489A1 - Display apparatus, method of controlling display apparatus, control program, and recording medium

Info

Publication number: WO2016129489A1
Application number: PCT/JP2016/053306
Authority: WO
Inventors: 知之新井; 誠悟伊藤
Original assignee: シャープ株式会社
Priority date: 2015-02-10
Filing date: 2016-02-04
Publication date: 2016-08-18
Also published as: JPWO2016129489A1

Abstract

The present invention enables a position on which a video image is to be projected to be indicated by an intuitive operation. This display apparatus (100) is provided with: an indicated position determination unit (12) that extracts, from an image captured by an imaging unit (2), an image of an indicator that indicates the position on which the video image is to be projected, and identifies the position indicated by the indicator; and a projection position control unit (14) that adjusts the position on which the video image is to be projected so that the video image will be projected on the position determined by the indicated position determination unit.

Description

Display device, display device control method, control program, and recording medium

The present invention relates to a display device capable of projecting and displaying an image at a desired position, a control method thereof, and the like.

Projectors that can move the projection position are known as prior art. For example, the projector described in Patent Literature 1 extracts an indicator from an image captured by a camera including a projection screen, detects the indication direction of the indicator, and moves the projection screen of the projector in the detected indication direction. Let

Japanese Published Patent Publication “Japanese Patent Laid-Open No. 2010-160403” (Publication Date: July 22, 2010)

However, although the projector described in Patent Document 1 can move the projection screen of the projector in the direction instructed by the user, the area in which the indicator that instructs the movement can be detected is imaged including the projection screen. Since it is limited to a predetermined detection area provided in the area, there has been a problem that it is not possible to smoothly instruct the movement of the projection screen.

The present invention has been made in view of the above problems, and an object of the present invention is to realize a display device or the like capable of instructing an image projection position by an intuitive operation.

In order to solve the above-described problem, a display device according to one embodiment of the present invention is a display device including a projection unit capable of adjusting a position at which a video is projected, and the video image is obtained from a captured image captured by the imaging unit. An image of a pointer that indicates the position where the pointer is projected is extracted, and the video is projected to the position determined by the pointing position determination unit that specifies the position indicated by the pointer and the pointing position determination unit. A projection position control unit that adjusts a position at which the projection unit projects the video.

In order to solve the above-described problem, a control method for a display device according to one embodiment of the present invention is a control method for a display device including a projection unit that can adjust a position at which an image is projected, and the imaging unit captures an image. An imaging step, an instruction position determining step for extracting an image of an indicator that indicates a position to project the video from the captured image captured in the imaging step, and specifying a position indicated by the indicator; and the instruction A projection position control step of adjusting a position at which the projection unit projects the video so that the video is projected at the position determined in the position determination step.

According to one aspect of the present invention, it is possible to smoothly project an image to a desired position by instructing an image projection position by an intuitive operation.

It is a block diagram which shows an example of schematic structure of the display apparatus which concerns on Embodiment 1 of this invention. It is a block diagram which shows an example of the hardware constitutions of a display apparatus. It is a figure which shows an example of the external appearance of a display apparatus, (a) is an example which carries out movement control of an imaging part and a projection part integrally, (b) is an example which carries out movement control of an imaging part and a projection part separately. (A) is a figure explaining the imaging range which an imaging part images, (b) is a figure explaining the projection range which a projection part projects an image | video. (A) is a figure which shows the example of the image of the indicator which an image detection part extracts, (b) is a figure which shows the example of the image of the indicator which remove | deviated from the shape pattern which an image detection part extracts. . It is a figure which shows an example of the method of calculating the target angle when projecting an image | video at the position of the indicator extracted from the captured image, (a) is a case where an imaging range and a projection range correspond, (b) is This is an example where the imaging range and the projection range do not match. It is a figure which shows another example of the method of calculating the target angle at the time of projecting an image | video at the position of the indicator extracted from the captured image, (a) is (b) when an imaging range and a projection range correspond. ) Is an example when the imaging range and the projection range do not match. It is a flowchart which shows an example of the flow of a process in which a display apparatus projects an image | video to the position which a pointer points. 10 is a block diagram illustrating an example of a schematic configuration of a display device according to Embodiment 2. FIG. 6 is a block diagram illustrating an example of a hardware configuration of a display device according to Embodiment 2. FIG. It is a flowchart which shows an example of the flow of a process which a display apparatus starts the projection of an image | video at the position which a pointer points. 6 is a block diagram illustrating an example of a schematic configuration of a display device according to Embodiment 3. FIG. It is a flowchart which shows an example of the flow of a process in which a display apparatus projects an image | video to the position which a pointer instruct | indicates, and controls a focus.

[Embodiment 1]
Hereinafter, embodiments of the present invention will be described in detail.

(Appearance of display device 100)
The display device 100 includes a projection unit 3 (projection unit) that can adjust a position at which a video is projected, and extracts an image of an indicator that indicates the position at which the video is projected from the captured image captured by the imaging unit 2. Then, an image is projected at a desired position indicated by the indicator.

First, the appearance of the display device 100 will be described with reference to FIG. 3A and 3B are diagrams illustrating an example of the appearance of the display device 100. FIG. 3A illustrates an example in which the imaging unit 2 and the projection unit 3 are integrally controlled, and FIG. 3B illustrates the imaging unit 2 and the projection unit 3 separately. This is an example of movement control. Here, the case where the display device 100 has the shape of a humanoid robot including the head 10 and the torso 20 will be described as an example. However, the display device 100 is not limited thereto, and is not limited to this, but is a rectangular parallelepiped, a cylinder, a sphere, a cone, And any shape such as a combination thereof.

The display device 100 shown in FIG. 3A performs movement control of the imaging unit 2 and the projection unit 3 as one body. For example, the imaging unit 2 and the projection unit 3 are always in the same direction (imaging direction, projection direction). ). That is, the imaging unit 2 and the projection unit 3 are provided on the head 10, and both the imaging unit 2 and the projection unit 3 are directed in the y-axis direction. The head 10 can rotate with a rotation axis parallel to the z-axis and rotation with a rotation axis parallel to the xy plane, whereby the imaging range K and the projection unit 3 of the imaging unit 2 project an image. The projection range L to be moved can be moved vertically and horizontally at the same time.

The display device 100 shown in FIG. 3B separately controls the movement of the imaging unit 2 and the projection unit 3 and can independently change the direction (imaging direction, projection direction). That is, the imaging unit 2 is provided on the head 10, and the projection unit 3 is provided on the body 20. FIG. 3B illustrates a state in which the imaging unit 2 and the projection unit 3 are both oriented in the y-axis direction, but both the head 10 and the body unit 20 are rotational axes parallel to the z-axis. , And a rotation having a rotation axis parallel to the xy plane, and thereby the imaging range of the imaging unit 2 and the projection range L on which the projection unit 3 projects an image can be moved separately. .

(Hardware configuration of display device 100)
Next, the hardware configuration of the display device 100 will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of a hardware configuration of the display device 100. As illustrated, the display device 100 includes a control unit 1, an imaging unit 2, a projection unit 3, a warning unit 4, and a motor unit 5.

The display device 100 extracts an image of a pointer from the captured image, detects the position of the pointer, and displays the image at the detected position of the pointer. The control unit 1 controls each function included in the display device 100 so that the display device 100 projects and displays an image on a desired position.

The imaging unit 2 is a camera that captures an imaging range K including an area where the projection unit 3 can project an image. As shown in FIG. 3, the direction of the imaging unit 2 can be controlled, and imaging can be performed while moving the imaging range K. For example, in the display device 100 shown in FIG. 3, an image may be taken once every 90 ° with the axis parallel to the z axis as the rotation axis. Alternatively, the imaging unit 2 may rotate 360 ° to capture a plurality of images, and one omnidirectional panoramic image may be generated from these images. Note that the orientation of the imaging unit 2 may not be variable as long as the imaging range K including the range in which the projection unit 3 can project an image can be captured. For example, in the case where the projection unit 3 has an angle of view that can capture the entire region in which video can be projected, the orientation of the imaging unit 2 may be fixed.

The projection unit 3 projects and displays the video indicated by the video data at the projection position indicated by the control unit 1. In order to simplify the description, illumination for projecting an image, a lens for adjusting the amount of light projected to the projection range L, and a lens for performing focus adjustment, and the like are not illustrated.

The warning unit 4 is a member that issues a warning (indicator presentation instruction) to the user when the display device 100 cannot detect the indicator that indicates the position to project the video. For example, if a warning is issued to the user by voice, the warning unit 4 is a speaker. The warning issued by the warning unit 4 is not limited to voice. For example, if the warning is lighting (flashing) of the lamp, the warning unit 4 is an indicator lamp. Alternatively, when a user grips a remote control device (not shown) for remotely operating the display device 100, the communication unit transmits a warning instruction for instructing to present a warning from the display device 100 to the remote control device. Also good.

The motor unit 5 is a mechanism that is controlled by the control unit 1 when the imaging range K captured by the imaging unit 2 is moved or the projection range L where the projection unit 3 projects an image is moved. For example, according to the rotation instruction acquired from the control unit 1, the head 10 and the torso part 20 shown in FIG. 3 are rotated by the rotation angle included in the rotation instruction. The display device 100 may include a plurality of motor units 5. That is, the movement of the imaging range K imaged by the imaging unit 2 and the movement of the projection range L in which the projection unit 3 projects an image may be controlled by one motor unit 5 (see FIG. 3A). These may be controlled by separate motor units 5 (see FIG. 3B).

(Configuration of display device 100)
Next, the configuration of the display device 100 will be described with reference to FIG. FIG. 1 is a block diagram showing an example of a schematic configuration of a display device 100 according to Embodiment 1 of the present invention. For convenience of explanation, members described in FIG. 2 are denoted by the same reference numerals and description thereof is omitted.

The display device 100 includes a control unit 1, an imaging unit 2, a projection unit 3 (projection unit), a warning unit 4, and a motor unit 5. The control unit 1 further includes an image detection unit 11 (indicated position determination unit), an instruction position determination unit 12 (instruction position determination unit), a projection angle determination unit 13, and a projection position control unit 14. Note that a storage unit that stores video data projected and displayed by the display device 100 and control information of various operations performed by the display device 100 is not shown here for the sake of simplicity.

The image detection unit 11 acquires a captured image captured by the imaging unit 2, and detects (extracts) an image of a pointer included in the captured image. This indicator is for instructing a position to project an image, and may be, for example, a user's hand that instructs a desired projection position, or an indicator bar having a specific shape. It may be an instrument. Alternatively, it may be an instrument including a light emitter that emits light. Hereinafter, a case where the indicator is the user's hand (palm) will be described as an example.

The indication position determination unit 12 analyzes the image of the indicator detected by the image detection unit 11, and specifies the position indicated by the indicator. A method for specifying the position indicated by the indicator (image thereof) detected from the captured image will be described later with a specific example.

The projection angle determination unit 13 calculates a target angle that is a movement angle necessary for the projection unit 3 to project an image at the position specified by the designated position determination unit 12. The target angle is an angle used to control the direction of the projection unit 3 when the projection range in which the projection unit 3 projects and displays an image is moved to an instructed position. Specifically, the projection angle determination unit 13 matches the position of the user's hand (indicator) in the imaging range K of the captured image with a predetermined position of the projection range L on which the projection unit 3 projects an image. Calculate the target angle required for. The method by which the projection angle determination unit 13 calculates the target angle will be described later with a specific example.

The projection position control unit 14 acquires the target angle calculated by the projection angle determination unit 13 and controls the motor unit 5 to rotate the direction of the projection unit 3 by the target angle.

According to such a configuration, the display device 100 including the projection unit 3 capable of adjusting the position at which the video is projected extracts the hand image that indicates the position at which the video is projected from the captured image captured by the imaging unit 2. Then, the position for projecting the image is adjusted so that the position is determined by the user's hand and the image is projected at the position determined by the position determining unit 12. Thereby, the direction (direction) of the projection unit 3 of the display device 100 can be controlled so as to project an image at a desired position. In addition, in order to determine the position to project the video based on the position of the image of the user's hand included in the captured image, the desired position can be smoothly obtained by instructing the position to project the video by an intuitive operation. An image can be projected to a position.

(Imaging range K and projection range L)
Here, the imaging range K that the imaging unit 2 captures and the projection range L that the projection unit 3 projects and displays an image will be described with reference to FIG. 4A is a diagram illustrating an imaging range K captured by the imaging unit 2, and FIG. 4B is a diagram illustrating a projection range L in which the projection unit 3 projects an image.

The imaging range K and the projection range L have coordinate systems associated with each other, and the projection angle determination unit 13 has coordinates corresponding to the position of the user's hand (indicator) in the imaging range K of the captured image. The target angle required for the projection unit 3 to coincide with the coordinates of a predetermined position of the projection range L on which the video is projected is calculated.

In the example shown in FIG. 4, positions K1, K3, K7, K9 corresponding to the four corners of the imaging range K, positions K2, K4, K6, K8 corresponding to the positions of the midpoints of the sides connecting the four corner positions, and the imaging. Positions K5 corresponding to the center point of the range K are the positions L1, L3, L7, L9 of the four corners of the projection range L, and the positions L2, L4, L6 corresponding to the positions of the midpoints of the sides connecting the positions of the four corners. , L8, and a position L5 corresponding to the center point of the projection range L.

In addition, although the case where the shape of the imaging range K and the projection range L is a rectangle was described as an example here, it may be an arbitrary shape such as a circle or a polygon. In addition, the shape of the imaging range K and the shape of the projection range L are not necessarily the same, and any shape may be used as long as the correspondence between the positions is defined.

(Extraction of the image of the indicator by the image detection unit 11)
Next, an example of the projection position indicated by the indicator image extracted from the captured image will be described with reference to FIG. FIG. 5A is a diagram illustrating an example of an indicator image extracted by the image detection unit 11, and FIG. 5B is a diagram illustrating an example of an indicator image deviating from the shape pattern extracted by the image detection unit. It is.

For example, in the case of the indicator image D1, the image detection unit 11 can detect the finger of the hand and extract the palm-shaped indicator image D1. Then, the indication position determination unit 12 generates a virtual rectangle so as to surround the palm, specifies the center point P1 of the indicator image D1, and uses the center point P1 as the indication position for indicating the projection position. You may decide.

In the case of the indicator image D2, the image detection unit 11 can extract the indicator image D2 based on the shape pattern pointed with the index finger. Then, the indication position determination unit 12 may specify the tip P2 of the index finger, and may determine the tip P2 as an indication position that indicates the projection position. In the case of the indicator image D3, the image detection unit 11 can detect that the tip of the pointer (light emitting unit P3) emits light. And the indication position determination part 12 may determine the position of the light emission part P3 of the front-end | tip of an indication rod as an indication position which instruct | indicates a projection position. It should be noted that the present invention is not limited to the example given here, and it can be set to extract images of various indicators.

For example, when the image detection unit 11 is set to detect the finger of the hand and extract the palm-shaped indicator image D1 as the indicator image, the image shown in FIG. E1 to E3 do not correspond to the shape pattern of the palm-shaped indicator image D1, and are not extracted as the indicator image.

If the indicator is not detected from the captured image captured before projecting the video, the display device 100 cannot start projection. In such a case, the display device 100 issues a warning to the user from the warning unit 4 until the position for projecting the video can be determined, and the image detection unit 11 captures the image captured by the imaging unit 2 after issuing the warning. The image of the indicator can be detected from the image. For example, the user who has received the warning opens the video by changing the orientation of the hand so that the fingers of the hand do not touch each other so that the image of the indicator detected by the image detection unit 11 is obtained. The position of the projection can be instructed again.

(Calculation of target angle)
Subsequently, a method in which the projection angle determination unit 13 calculates the target angle will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram illustrating an example of a method for calculating a target angle when a video is projected to the position of the indicator extracted from the captured image. FIG. 6A illustrates the imaging range K and the projection range L. In this case, (b) is an example when the imaging range K and the projection range L do not match.

FIG. 6A shows the position of the palm center point P1 when the palm image is extracted from the captured image when the display device 100 controls the movement of the imaging unit 2 and the projection unit 3 as a unit. The method of controlling so that the position L5 (reference position) of the projection range L matches is shown. Here, a case where the position L5 of the projection range L is set in advance as a position that matches the position of the palm center point P1 in the imaging range K will be described as an example. Specifically, using the difference from the position K5 (origin) to the coordinate of the palm center point P1 using the center position K5 of the captured image of the captured image from which the user's hand image is detected as the origin, A target angle for changing the direction of the projection unit 3 is calculated. More specifically, the projection angle determination unit 13 calculates, as a target angle, an angle necessary to match the direction from the imaging unit 2 to the position K5 and the direction from the imaging unit 2 to the palm center point P1. To do. When there is a deviation between the center position K5 of the imaging range K and the center position L5 of the projection range L due to the relative positional relationship between the imaging unit 2 and the projection unit 3, The target angle may be calculated in consideration of correction of this deviation.

On the other hand, FIG. 6B shows an imaging range of the captured image when a palm image is extracted from the captured image when the display device 100 separately controls the imaging unit 2 and the projection unit 3. A method is shown in which control is performed so that the position (relative position) of the palm center point P1 at K coincides with the corresponding position (relative position) of the projection range L. In addition, while changing the direction of the projection part 3 and moving the projection range L, it is desirable that the direction of the imaging part 2 is fixed.

In FIG. 6A, an example in which the position of the center point P1 of the palm of the user detected from the captured image is controlled to coincide with the position L5 of the center of the projection range L that projects the video has been described. However, it is not limited to this. For example, the position of the center point P1 of the palm of the user detected from the captured image may be controlled to coincide with an arbitrary position (for example, position L1: reference position) of the projection range L that projects the video.

FIG. 7 is a diagram illustrating an example of a method for calculating a target angle when a video is projected onto the position of the indicator extracted from the captured image. FIG. 7A illustrates that the imaging range K and the projection range L match. In this case, (b) is an example when the imaging range K and the projection range L do not match. That is, in both cases (a) and (b) of FIG. 7, the center position K1 of the captured image of the captured image from which the image of the user's hand is detected is the origin, and the position K1 (origin) You may calculate the target angle for changing the direction of the projection part 3 using the difference to the coordinate of the palm center point P1.

If there is a deviation between the position K1 of the imaging range K and the position L1 of the projection range L due to the relative positional relationship between the imaging unit 2 and the projection unit 3, correction of this deviation is performed. The target angle may be calculated in consideration.

(Flow of processing for controlling and displaying position where display device 100 projects image)
When the display device 100 is installed, the power is turned on, and an activation instruction is input, the imaging unit 2 monitors the imaging region including the region where the projection unit 3 can project an image and performs imaging of the imaging range K. (S1: Imaging step). The image detection unit 11 acquires the captured image captured by the imaging unit 2, and determines whether or not the captured image includes a user's palm (indicator) (S2).

When the captured image includes the palm of the user (Yes in S2), the image detection unit 11 displays the captured image and image recognition information indicating that the image of the user's palm is detected in the captured image. And sent to the designated position determination unit 12. On the other hand, if the user's palm is not detected in the captured image (No in S2), the warning unit 4 issues a warning to the user (S6), and then returns to S1 and the imaging unit 2 captures the image after issuing the warning. The indicator is detected from the captured image.

Next, the projection angle determination unit 13 is based on the image of the user's palm detected from the captured image, and is determined by the instruction position determination unit 12 (instruction position determination step). The target angle used for controlling the position of the projection range L is calculated so that an image is projected at the position of the center point P1) (S3: designated position determination step).

The projection position control unit 14 controls the projection angle of the projection unit 3 by controlling the motor unit 5 so as to change the direction of the projection unit 3 based on the target angle calculated by the projection angle determination unit 13. (S4: Projection position control step).

After the projection position control unit 14 controls the position where the projection unit 3 projects the video, the projection of the video is started (S5).

As described above, the display device 100 extracts the user's hand indicating the position to project the video from the captured image captured by the imaging unit 2, and the video is projected to the position specified by the extracted user's hand. In this way, the position where the image is projected is adjusted. Thereby, the direction (direction) of the projection unit 3 of the display device 100 can be controlled so as to project an image at a desired position. In addition, by instructing the position to project the image by an intuitive operation, the image can be smoothly projected to a desired position.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

First, the hardware configuration of the display device 100a according to the second embodiment will be described with reference to FIG. FIG. 10 is a block diagram illustrating an example of a hardware configuration of the display device 100a according to the second embodiment. As illustrated, the display device 100a is different from the display device 100 in that the display device 100a further includes a sound collection unit 6 (projection instruction acquisition unit) that receives an input of audio from a user instructing start of video projection. . The sound collection unit 6 is, for example, a microphone. Here, an example has been given in which an input of an instruction from a user instructing start of video projection is received as sound, but the present invention is not limited to this. For example, a configuration in which a light receiving unit is provided instead of the sound collecting unit 6 and the start of video projection from the user is input by light such as infrared rays may be used.

The configuration of the display device 100a will be described with reference to FIG. FIG. 9 is a block diagram illustrating an example of a schematic configuration of the display device 100a. As shown in the figure, when the control unit 1a of the display device 100a detects a voice (sound that triggers the start of projection) that matches a predetermined voice pattern from the user's utterance voice input to the sound collection unit 6, Is further provided with a projection instruction detection unit 15 (projection instruction acquisition unit) that starts the projection. The preset voice pattern may be, for example, a preset utterance voice such as “Start”, “OK”, and the like.

Subsequently, the flow of processing for controlling and displaying the position where the display device 100a projects an image will be described with reference to FIG. FIG. 11 is a flowchart illustrating an example of a process flow in which the display device 100a starts projecting an image at a position indicated by the indicator. Note that S11 to S14 and S17 in FIG. 11 are processes corresponding to S1 to S4 and S6 in FIG. 8, respectively, and will not be described here to avoid duplication.

When the projection position control unit 14 controls the position at which the projection unit 3 projects the video and then receives the sound collection at the start of projection (Yes in S15), the projection instruction detection unit 15 starts projecting the video. (S16). On the other hand, video projection does not start until the sound collection at the start of projection is received (No in S15). Note that when the projection position control unit 14 completes the control of the position at which the video is projected, the user may be notified of this. Accordingly, it is possible to notify the user that the reception of the voice that is a trigger for starting the projection has started.

According to this configuration, after the projection position of the video is determined, the projection of the video is started in response to a projection start instruction from the user. Thereby, video projection can be started at a desired timing. Therefore, it is possible to prevent the image from being projected at a timing not intended by the user.

[Embodiment 3]
The following will describe another embodiment of the present invention with reference to FIG. 12 and FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

First, a schematic configuration of the display device 100b according to the third embodiment will be described with reference to FIG. FIG. 12 is a block diagram illustrating an example of a schematic configuration of the display device 100b.

As shown in the figure, the display device 100b includes a focus control unit 16. The focus control unit 16 of the control unit 1b of the display device 100b controls the focus by controlling the lens through which the image projected from the projection unit 3 passes so that the projected image is clearly displayed.

Subsequently, the flow of processing for controlling and displaying the position at which the display device 100b projects an image will be described with reference to FIG. FIG. 13 is a flowchart illustrating an example of a processing flow in which the display device 100b starts projecting an image at a position indicated by the indicator. Note that S21 to S25 and S27 in FIG. 13 are processes corresponding to S1 to S5 and S6 in FIG. 8, respectively, and will not be described here to avoid duplication.

After the projection position control unit 14 controls the position at which the projection unit 3 projects an image, the focus control unit 16 controls the focus of the projected image (S36).

In the case of the display device 100b that does not use a laser as the light source of the projection unit 3, a process for adjusting the focus of the projected image is necessary. According to said structure, when the projection position of an image | video is started, a focus is controlled automatically so that it may project as a clear image | video.

[Example of software implementation]
The control blocks of the

display devices

100, 100a, 100b (particularly the image detection unit 11, the instruction position determination unit 12, the projection angle determination unit 13, the projection position control unit 14, the projection instruction detection unit 15, and the focus control unit 16) are integrated. It may be realized by a logic circuit (hardware) formed on a circuit (IC chip) or the like, or may be realized by software using a CPU (Central Processing Unit).

In the latter case, the

display devices

100, 100a, and 100b include a CPU that executes instructions of a program that is software that implements each function, and a ROM (Read that records the above-described program and various data so that the computer (or CPU) can read them. Only Memory) or a storage device (these are referred to as “recording media”), RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The

display devices

100, 100a, and 100b according to the first aspect of the present invention are display devices that include a projection unit (projection unit 3) that can adjust the position at which an image is projected. From the captured image captured by the imaging unit 2, An instruction position determination unit (image detection unit 11, instruction position determination unit 12) that extracts an image of a pointer that indicates a position to project the video and specifies the position indicated by the pointer, and the instruction position determination A projection position control unit for adjusting a position at which the projection unit projects the video so that the video is projected at a position determined by the unit.

According to the above configuration, the image of the indicator that indicates the position where the image is projected is extracted from the captured image captured by the imaging unit, and the image is projected so that the image is projected at the position indicated by the indicator. Adjust the projection position. Thereby, the direction of the projection unit can be controlled so as to project an image at a position instructed by hand. Therefore, the video can be smoothly projected to a desired position by instructing the position to project the video by an intuitive operation.

In the display device according to aspect 2 of the present invention, in the aspect 1, the projection position control unit is preset in a projection range in which the projection unit projects the video at the position specified by the instruction position determination unit. The position of the projection range may be adjusted so that the reference positions match.

According to the above configuration, the position of the projection range is controlled so that the preset reference position matches the position indicated by the indicator. Thereby, the position which projects an image | video can be adjusted smoothly without discomfort.

The display device according to aspect 3 of the present invention is the display apparatus according to aspect 1, wherein the projection position control unit is configured to determine the relative position of the indicator specified by the instruction position determination unit in an imaging range in which the imaging unit captures the captured image. The position of the projection range may be adjusted so that the relative position of the indicator specified by the indication position determination unit in the projection range in which the projection unit projects the video is matched.

According to the above configuration, the position of the projection range is controlled so that the relative position of the indicator in the imaging range matches the relative position of the indicator in the projection range. Thereby, the position which projects an image | video can be adjusted smoothly without discomfort.

The display device according to aspect 4 of the present invention is the display device according to any one of aspects 1 to 3, wherein the imaging unit is capable of imaging the entire region in which the projection unit can project the video. The direction may be variable.

Thereby, the entire area in which the projection unit can project an image can be designated.

The display device according to aspect 5 of the present invention provides the indicator that prompts the presentation of the indicator when the indicated position determination unit cannot determine the position at which the video is projected in any of the aspects 1 to 4. A presentation instruction may be issued.

Thereby, it is possible to smoothly project the image so as to promptly prompt the presentation of the indicator that indicates the position to project the image. Further, by issuing an indicator presentation instruction to the user, the user can be informed that it is a step of determining a position where an image is projected.

The display device according to aspect 6 of the present invention is the display device according to any one of the aspects 1 to 5, wherein the projection unit projects the image after the projection position control unit adjusts the position at which the image is projected. You may start.

This makes it possible to smoothly start projecting the image as soon as it is ready to project the image to the instructed position.

The display device according to aspect 7 of the present invention is the projection according to any one of aspects 1 to 5, wherein the projection position control unit adjusts a position at which the video is projected, and then obtains an instruction to start projection by the user. The projector may further include an instruction acquisition unit, and the projection unit may start projecting the video when the projection instruction acquisition unit acquires the projection start instruction.

According to the above configuration, when the projection instruction acquisition unit acquires an instruction to start projection, the projection of the video is started. Thereby, video projection can be started at a desired timing. Therefore, it is possible to prevent the image from being projected at a timing not intended by the user.

In the display device according to aspect 8 of the present invention, in any one of aspects 1 to 7, the imaging unit and the projection unit may be arranged so as to move together.

In the display device according to aspect 9 of the present invention, in any of the above aspects 1 to 7, the imaging unit and the projection unit may be arranged to move independently.

The display device control method according to the tenth aspect of the present invention is a display device control method including a projection unit capable of adjusting a position at which an image is projected, and an imaging step in which the imaging unit captures an image (S1, S11, S21). And an instruction position determining step (S3, S13, S23) for extracting an image of an indicator that indicates the position at which the video is projected from the captured image captured in the imaging step and specifying the position indicated by the indicator. And a projection position control step (S4, S14, S24) for adjusting the position at which the projection unit projects the video so that the video is projected at the position determined in the designated position determination step. According to said structure, there exists an effect similar to the said aspect 1. FIG.

The display device according to each aspect of the present invention may be realized by a computer. In this case, the display device is realized by the computer by operating the computer as each unit (software element) included in the display device. A control program for the display device and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

The present invention can be used for a projector that projects and displays an image.

1, 1a, 1b control unit, 2 imaging unit, 3 projection unit (projection unit), 6 sound collection unit (projection instruction acquisition unit), 11 image detection unit (instruction position determination unit), 12 instruction position determination unit, 14 projection Position control unit, 15 projection instruction detection unit (projection instruction acquisition unit), 100, 100a, 100b display device, S1, S11, S21: imaging step, S3, S13, S23: designated position determination step, S4, S14, S24: Projection position control step

Claims

A display device including a projection unit capable of adjusting a position for projecting an image,
An instruction position determining unit that extracts an image of a pointer that indicates a position at which the video is projected from a captured image captured by the imaging unit, and that specifies a position indicated by the pointer;
A display device comprising: a projection position control unit that adjusts a position at which the projection unit projects the video so that the video is projected at a position determined by the designated position determination unit.
The projection position control unit adjusts the position of the projection range such that a reference position preset in the projection range in which the projection unit projects the video matches the position specified by the designated position determination unit. The display device according to claim 1.
The projection position control unit includes the relative position of the indicator specified by the instruction position determination unit in the imaging range in which the imaging unit captures the captured image, and the instruction in the projection range in which the projection unit projects the video. The display device according to claim 1, wherein the position of the projection range is adjusted so that the relative position of the indicator specified by the position determination unit coincides.
The imaging unit according to any one of claims 1 to 3, wherein the imaging unit has a variable imaging direction so that the projection unit can capture the entire region in which the video can be projected. The display device described.
5. The indicator presentation instruction for prompting the presentation of the indicator is issued when the indication position determination unit cannot determine the position at which the video is projected. 6. Display device.
6. The display according to claim 1, wherein the projection unit starts projecting the video after the projection position control unit adjusts a position at which the video is projected. 6. apparatus.
The projection position control unit further includes a projection instruction acquisition unit that acquires a user's projection start instruction after the position for projecting the video is adjusted,
The display device according to claim 1, wherein the projection unit starts projecting the video when the projection instruction acquisition unit acquires the projection start instruction.
The display device according to claim 1, wherein the imaging unit and the projection unit are arranged so as to move as a unit.
The display device according to claim 1, wherein the imaging unit and the projection unit are arranged to move independently of each other.
A control method of a display device including a projection unit capable of adjusting a position for projecting an image,
An imaging step of imaging by the imaging unit;
An instruction position determination step for extracting an image of an indicator that indicates a position to project the video from the captured image captured in the imaging step, and specifying a position indicated by the indicator;
And a projection position control step for adjusting a position at which the projection unit projects the video so that the video is projected at the position determined in the designated position determination step.
A control program for causing a computer to function as the display device according to claim 1, wherein the control program causes the computer to function as the indicated position determination unit and the projection position control unit.
A computer-readable recording medium on which the control program according to claim 11 is recorded.