JP6938308B2 - Projector system and program for projector system - Google Patents

Description

The present invention relates to a projector system and a program for a projector system in which the screen is moved to project contents.

In recent years, projectors have been used to display lecture manuscripts on desks and recipes on countertops in cooking classes. FIG. 1 shows recipes projected from projector systems 103A and 103B provided on the ceiling 102 onto countertops 101A and 101B of a cooking class.

In the above situations, it is preferable that the recipe is displayed at a position that follows the movement of the cook. In particular, when the cook moves from one side of the countertops 101A and 101B to the opposite side, the characters are turned upside down and become difficult to read. Further, when the cook of the cooking table 101A can read only Japanese and the cook of the cooking table 101B can read only English, it is convenient to display recipes in different languages.

On the other hand, Patent Document 1 discloses that when a positioning mark and a keyword are drawn on a board, the positioning mark and the keyword are read and the content corresponding to the keyword is displayed at the position indicated by the positioning mark.

Further, in Patent Document 2, when a medium provided with a position marker is held over a display unit on which the content to be copied is displayed, a state such as the position and angle of the medium is detected from the position of the position marker and a region to be copied is determined. A system capable of copying is disclosed.

In Patent Document 3, a first image is projected on a projection surface, a range including the first image projected on the projection surface is imaged to generate a second image, and the second image is generated by the imaging unit. It is disclosed that it has a recognition unit that recognizes an instruction to the image supply device based on the second image, and gives the instruction recognized by the recognition unit to the control unit. According to this Patent Document 3, the user causes the imaging unit to capture an image different from the first image by holding his / her hand over a predetermined area in the projected first image. It becomes possible to easily give an instruction to the image supply device.

Japanese Unexamined Patent Publication No. 2013-89987 Japanese Unexamined Patent Publication No. 2005-31448 Japanese Unexamined Patent Publication No. 2011-164878

The above-mentioned Patent Document 1 is assumed to be used for teaching or the like using a whiteboard, and it is not assumed that the image is displayed upside down or slanted on the whiteboard.

In the system of Patent Document 2, the image in the position marker tilted from the object to be copied can be obtained by tilting the medium provided with the position marker. However, when the screen to be projected by the projector is tilted, the image is not properly displayed on the screen.

The invention of Patent Document 3 is for easily giving instructions such as page-up to the image supply device. Therefore, when the screen to be projected by the projector is tilted, a command or the like for appropriately displaying an image on the screen is not generated.

The present invention has been made in response to the current state of the projector system and the demand for the projector system as described above, and an object of the present invention is to be able to appropriately project an image on the screen surface after moving according to the movement of the screen surface. To provide a projector system. Another object is to provide a projector system capable of designating content by characters on the screen surface.

The projector system according to the present invention includes a projector provided with a screen state changing operation function unit that performs an operation of changing the orientation and range of a screen to be projected by receiving a drive control signal, and an image projected by the projector and an image. Is a screen surface on which a plurality of characters are arranged so as to indicate the range of the screen on which the image is projected, and image information is obtained by imaging the screen surface on which the characters are arranged so as to indicate the orientation of the screen on which the image is projected. Based on the image information obtained by the camera unit and the camera unit, character recognition at a predetermined position on the screen surface is performed to detect the vertical and horizontal directions of the characters, and the orientation information of the screen to be projected on the screen surface is detected. Orientation control that controls the orientation of the screen projected onto the screen surface by sending a drive control signal to the screen state change operation function unit of the projector based on the orientation detecting means and the orientation information detected by the orientation detecting means. Means and range detecting means for obtaining the position and arrangement of characters by performing character recognition at a predetermined position on the screen surface based on the image information obtained by the camera unit and detecting the range of the screen to be projected on the screen surface. A range control means for controlling the range of the screen projected on the screen surface by sending a drive control signal to the screen state change operation function unit of the projector based on the screen range information detected by the range detection means. A content storage unit in which a plurality of pairs of video contents projected from the projector are stored corresponding to characters, and a character recognition means for recognizing characters at a predetermined position on the screen surface based on image information obtained by the camera unit. It is characterized by comprising a content transmitting means for extracting the content corresponding to the character related to the character recognition result from the content storage unit and transmitting it as a video signal to the projector.

In the projector system according to the present invention, the characters are arranged at the four corners of a rectangle .

In the projector system according to the present invention, the range detecting means obtains a rectangle in which two characters having a predetermined positional relationship are diagonally aligned, and detects the range of this rectangle as the range of the screen to be projected on the screen surface. It is characterized by.

In the projector system according to the present invention, the characters are arranged at a plurality of positions on an elliptical arc .

The projector system according to the present invention is characterized in that the characters written on the screen surface are alphabets in which the vertical direction can be determined.

The projector system program according to the present invention is a projector provided with a screen state changing operation function unit that performs an operation of changing the orientation and range of a screen to be projected by receiving a drive control signal, and an image produced by the projector is projected. A screen surface on which a plurality of characters are arranged so as to indicate the range of the screen on which the image is projected, and the screen surface on which the characters are arranged so as to indicate the orientation of the screen on which the image is projected is imaged. A projector including a camera unit for obtaining image information, a content storage unit in which a plurality of pairs of video contents projected from the projector are stored corresponding to characters, and a control unit including a computer for controlling the projector. The computer of the system performs character recognition at a predetermined position on the screen surface based on the image information obtained by the camera unit to detect the vertical and horizontal directions of the characters, and detects the orientation information of the screen to be projected on the screen surface. Orientation control means for controlling the orientation of the screen projected on the screen surface by sending a drive control signal to the screen state change operation function unit of the projector based on the orientation information detected by the orientation detecting means. A range detecting means for detecting a range of a screen to be projected on the screen surface while obtaining the position and arrangement of characters by recognizing characters at a predetermined position on the screen surface based on the image information obtained by the camera unit. Range control means for controlling the range of the screen projected on the screen surface by sending a drive control signal to the screen state change operation function unit of the projector based on the screen range information detected by the means. Obtained by the camera unit. As a character recognizing means for recognizing a character at a predetermined position on the screen surface based on the image information, and as a content transmitting means for extracting the content corresponding to the character related to the character recognition result from the content storage unit and transmitting it as a video signal to the projector. It is characterized by making it work.

The program for a projector system according to the present invention is characterized in that the characters are arranged at the four corners of a rectangle .

In the program for a projector system according to the present invention, the computer is used as the range detecting means to obtain a rectangle having a diagonal line between two characters having a predetermined positional relationship, and the range of the rectangle is projected on the screen surface of the screen. It is characterized in that it functions to be detected as a range.

The program for a projector system according to the present invention is characterized in that the characters are arranged at a plurality of positions on an elliptical arc .

The projector system program according to the present invention is characterized in that the characters written on the screen surface are alphabets in which the vertical direction can be determined.

According to the present invention, based on image information obtained by imaging a screen surface on which an image projected by a projector is projected, character recognition at a predetermined position on the screen surface is performed to detect the vertical and horizontal directions of the characters, and the screen surface is detected. Detects the orientation information of the screen to be projected in, sends a drive control signal to the screen state change operation function unit of the projector based on the detected orientation information, and controls the orientation of the screen projected on the screen surface. It becomes possible to project an image on the screen surface after moving appropriately by following the movement of the surface.

Further, according to the present invention, character recognition at a predetermined position on the screen surface is performed based on the image information obtained by the camera unit, and the content corresponding to the character related to the character recognition result is taken out from the content storage unit and used as a video signal. Since it is sent to the projector, it is possible to specify the content by the characters on the screen surface.

The perspective view which shows the example of the kitchen using the embodiment of the projector system which concerns on this invention. The block diagram of the 1st Embodiment of the projector system which concerns on this invention. The plan view which shows an example of the screen used in embodiment of the projector system which concerns on this invention. The flowchart for demonstrating the operation of the 1st Embodiment of the projector system which concerns on this invention. The plan view which shows the posture of the screen and the projected image for demonstrating the operation by 1st Embodiment of the projector system which concerns on this invention. The block diagram of the 2nd Embodiment of the projector system which concerns on this invention. The flowchart for demonstrating the operation of the 2nd Embodiment of the projector system which concerns on this invention. The plan view which shows the screen and the projected content image for explaining the operation by 2nd Embodiment of the projector system which concerns on this invention. The plan view which shows the screen and the projected content image for explaining the operation by 2nd Embodiment of the projector system which concerns on this invention.

Hereinafter, embodiments of the projector system and its program according to the present invention will be described with reference to the accompanying drawings. In each figure, the same components are designated by the same reference numerals, and duplicate description will be omitted. As shown in FIG. 1, the projector systems 103A and 103B according to the present embodiment are provided on the ceiling 102. FIG. 1 is only an example, and the installation location and the number of projector systems 103A and 103B are not limited to this. The configurations of the projector systems 103A and 103B are the same, as shown in FIG.

The projector system includes a projector 10, a camera unit 20, and a control unit 30. The projector 10 includes a screen state change operation function unit 11 that performs an operation of changing the orientation and range of the screen to be projected by receiving the drive control signal. The screen state change operation function unit 11 may have a mechanical configuration for performing pan, tilt, and zoom operations.

The projector 10 is provided with a video output unit 12 and a control unit 13 in addition to the screen state change operation function unit 11. The control unit 13 receives the signal sent from the control unit 30, sends the signal related to the video information to the video output unit 12, and sends the signal related to the screen state changing operation to the screen state changing operation function unit 11. do. The video output unit 12 receives the signal related to the video information, visualizes it, and outputs it to the screens 104A and 104B of FIG.

The screens 104A and 104B are made of paper, an acrylic plate, cloth, or the like, and there are no restrictions on the material, thickness, size, or the like as long as they can project an image. Further, the planar shape can be rectangular as shown in FIG. Of course, the planar shape of the screens 104A and 104B may be any shape. Characters indicating the projection range 9 of the image are written (printed or the like) on the screens 104A and 104B. Since the projection range 9 of the image is usually a rectangle, a total of four characters are described at the positions of the four corners of the rectangle. If the projection range is a rectangle whose diagonal line is between two characters in a predetermined positional relationship, two characters may be used, but four characters can be used in consideration of the case where they are hidden by a hand or the like.

In addition, characters may be written at positions other than the above four characters along the boundary line of the projection range 9, but it is expected that they will interfere with the visual observation when the image is projected, so the four characters Can be. In addition, there is no particular limitation as long as the character is a character whose vertical direction can be determined, but the vertical direction in the alphabet is determined from the viewpoint that it is preferable that the accuracy and efficiency of character recognition are better. It can be a possible alphabet. The six letters "I", "O", "X", "S", "W", and "M" are not used because they are alphabets whose vertical direction cannot be determined.

The camera unit 20 obtains image information by capturing an image of a screen surface on which an image projected by the projector 10 is projected. The control unit 30 controls the screen state change of the projector 10 based on the image information obtained by the camera unit 20, and sends the video information to the projector 10.

The control unit 30 includes an arithmetic processing unit 31 composed of a CPU, a content storage unit 32 in which video information of a plurality of contents is stored, and an input unit 33 for inputting commands and data. The input unit 33 can be configured by a keyboard, a touch panel, a mouse, or the like.

The arithmetic processing unit 31 is provided with a direction detecting means 311, a direction controlling means 312, a range detecting means 313, a range controlling means 314, and a content sending means 315. The orientation detecting means 311 and the orientation controlling means 312, the range detecting means 313, the range controlling means 314, and the content transmitting means 315 are realized by a program.

The orientation detecting means 311 recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit 20, detects the vertical and horizontal directions of the characters, and detects the orientation information of the screen to be projected on the screen surface. Is what you do. For character recognition, a known configuration can be adopted in this part and other parts. The orientation control means 312 sends a drive control signal to the screen state change operation function unit 11 of the projector 10 based on the orientation information detected by the orientation detection means 311 to control the orientation of the screen projected on the screen surface. Is what you do.

The range detecting means 313 performs character recognition at a predetermined position on the screen surface based on the image information obtained by the camera unit 20 to obtain the position and arrangement of the characters and detects the range of the screen to be projected on the screen surface. It is a thing. Specifically, the range detecting means 313 obtains a rectangle in which two characters having a predetermined positional relationship are diagonally aligned, and detects the range of this rectangle as the range of the screen to be projected on the screen surface. The range control means 314 sends a drive control signal to the screen state change operation function unit 11 of the projector 10 based on the screen range information detected by the range detection means 313, and the range of the screen projected on the screen surface. Is to control.

The input unit 33 is used to input an instruction to read the content in the content storage unit 32. The content transmission means 315 takes out the content instructed to be read by the input unit 33 from the content storage unit and transmits it to the projector 10 as a video signal.

Since the projector system according to the first embodiment configured as described above operates by the program corresponding to the flowchart shown in FIG. 4, this will be described. When the power is turned on, the start is started, and the camera unit 20 captures the screen surface on which the image projected by the projector 10 is projected to obtain image information (S11). Next, character recognition is performed based on the obtained image information to detect the vertical and horizontal directions of the character, and the orientation information of the screen to be projected on the screen surface is detected (S12). Next, a drive control signal is sent to the screen state change operation function unit 11 to control the orientation of the screen projected on the screen surface (S13).

Further, character recognition is performed based on the obtained image information to obtain the position and arrangement of the characters, and the range of the projected screen on the screen surface is detected (S14). Based on the obtained screen range information, a drive control signal is sent to the screen state change operation function unit 11 of the projector 10 to control the screen range projected on the screen surface (S15).

Next, the content instructed to be read by the input unit 33 is taken out from the content storage unit (S16), transmitted as a video signal to the projector 10, and the video is projected onto the screens 104A and 104B (S17). After that, the process is repeated by this program.

According to the present embodiment, if the vertical and horizontal directions of the character postures described on the screens 104A and 104B are normal as shown in FIG. 5A, the strawberry picture 50 as the content is in the normal direction. Is projected toward the upper side). Further, as shown in FIG. 5B, if the character postures described on the screens 104A and 104B are upside down, the strawberry picture 50, which is the content, is projected in the upside down direction. Further, if the character postures described on the screens 104A and 104B are inclined upward to the right as shown in FIG. 5C, the picture 50 of the strawberry, which is the content, is also projected to be inclined upward to the right.

FIG. 6 shows the configuration of the projector system according to the second embodiment. In the present embodiment, the arithmetic processing unit 31A is provided with the character recognition means 316, and the content transmission means 315A has a new function. That is, the character recognition means 316 recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit 20.

One content is assigned to the content storage unit 32 corresponding to one character of the alphabet, and a plurality of contents are stored so that the corresponding content can be read by one character of the alphabet. The content transmission means 315A takes out the content corresponding to the character related to the character recognition result from the content storage unit 32 and transmits it to the projector 10 as a video signal.

Except for the above configuration, the configuration of the present embodiment is the same as the configuration of the first embodiment. Since the projector system according to the second embodiment configured as described above operates by the program corresponding to the flowchart shown in FIG. 7, this will be described. Since the operations of steps S11 to S15 are the same as the configurations of the first embodiment, the description thereof will be omitted. Following step S15, the corresponding content is read from the content storage unit 32 based on the character information as a result of performing character recognition at a predetermined position on the screen surface based on the image information obtained by the camera unit 20 (S21). The read content is transmitted to the projector 10 as a video signal, and the video is projected onto the screens 104A and 104B (S22). After that, the process is repeated by this program.

According to the projector system according to the second embodiment as described above, the following can be achieved. It is assumed that the content storage unit 32 stores, for example, the "strawberry content" associated with the character A and the "melon content" associated with the character B.

Therefore, as shown in FIG. 8A, when the screen 201 in which the characters A are described in the four corners is used, the characters A in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character A, and the "strawberry content" associated with the character A is read out from the content storage unit 32, and as shown in FIG. 8A, the screen 201 projection range is covered with "strawberry content". The image of "Strawberry content" is projected.

Further, as shown in FIG. 8B, when the screen 202 in which the characters B are described in the four corners is used, the characters B in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character B, and the "melon content" associated with the character B is read out from the content storage unit 32, and as shown in FIG. 8 (b), the "melon content" is displayed in the screen 202 projection range. The image of "Melon contents" is projected.

As another example, the content storage unit 32 stores, for example, "content in Japanese" associated with the character J and "content in English" associated with the character E. do.

Therefore, as shown in FIG. 9A, when the screen 203 in which the characters J are described in the four corners is used, the characters J in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character J, and the "content in Japanese" associated with the character J is read out from the content storage unit 32, and as shown in FIG. 9A, is projected on the screen 203. The image of "content in Japanese" is projected.

Further, as shown in FIG. 9B, when the screen 204 in which the characters E are described in the four corners is used, the characters E in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character E, and the "content in English" associated with the character E is read out from the content storage unit 32, and as shown in FIG. 9B, "content in English" is displayed on the screen 204 projection range. The image of "content in English" is projected.

In the above example, in FIG. 1, when the cook of the cooking table 101A can read only Japanese and the cook of the cooking table 101B can read only English, it is convenient because recipes in different languages can be displayed for each cooking table. Is.

In the above embodiment, the predetermined positions for character recognition at the predetermined positions on the screen surface are the four corners, but they can be appropriately changed depending on the frame shape of the projected image and the shape of the screen surface. For example, in addition to the four corners, a character may be written at a position between the two characters, and this may also be recognized. Further, the screen may be oval, and characters may be written at some positions on the arc to recognize the characters.

10 Projector 11 Screen state change operation function unit 12 Video output unit 13 Control unit 20 Camera unit 30 Control unit 31 Arithmetic processing unit 31A Arithmetic processing unit 32 Content storage unit 33 Input unit 101A, 101B Cooking table 102 Ceiling 103A, 103B Projector system 104A , 103B, 2011-204 Screen 311 Orientation detection means 312 Orientation control means 313 Range detection means 314 Range control means 315, 315A Content transmission means 316 Character recognition means

Claims (10)

A projector equipped with a screen state change operation function unit that changes the orientation and range of the screen to be projected by receiving a drive control signal.
A screen surface on which a plurality of characters are arranged so as to indicate the range of the screen on which the image is projected by the projector and the image is projected, and the characters are arranged so as to indicate the orientation of the screen on which the image is projected. A camera unit that captures the image of the screen surface to obtain image information,
Based on the image information obtained by the camera unit, character recognition at a predetermined position on the screen surface is performed to detect the vertical and horizontal directions of the characters, and orientation detecting means for detecting the orientation information of the screen to be projected on the screen surface.
An orientation control means that sends a drive control signal to the screen state change operation function unit of the projector based on the orientation information detected by the orientation detection means to control the orientation of the screen projected on the screen surface.
Based on the image information obtained by the camera unit, character recognition at a predetermined position on the screen surface is performed to obtain the position and arrangement of the characters, and a range detecting means for detecting the range of the screen to be projected on the screen surface.
A range control means for controlling the range of the screen projected on the screen surface by sending a drive control signal to the screen state change operation function unit of the projector based on the screen range information detected by the range detection means.
A content storage unit in which a plurality of pairs of video contents projected from the projector are stored corresponding to characters, and
A character recognition means that recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit, and
A projector system comprising: a content transmitting means for extracting a content corresponding to a character related to the character recognition result from the content storage unit and transmitting the content as a video signal to the projector. The projector system according to claim 1, wherein the characters are arranged at the four corners of a rectangle. 1. 2. The projector system according to 2. The projector system according to claim 1, wherein the characters are arranged at a plurality of positions on an elliptical arc. The projector system according to any one of claims 1 to 4, wherein the characters described on the screen surface are alphabets in which the vertical direction can be determined. A projector equipped with a screen state change operation function unit that changes the orientation and range of the screen to be projected by receiving a drive control signal, and a range of the screen on which the image is projected by the projector and the image is projected. As shown, a screen surface on which a plurality of characters are arranged, and a camera unit for obtaining image information by imaging the screen surface on which the characters are arranged so as to indicate the orientation of the screen on which an image is projected, and the projector. The computer of the projector system including a content storage unit in which a plurality of pairs of video contents projected from the projector are stored corresponding to characters and a control unit including a computer for controlling the projector.
An orientation detecting means that recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit, detects the vertical and horizontal directions of the characters, and detects the orientation information of the screen to be projected on the screen surface.
An orientation control means that sends a drive control signal to the screen state change operation function unit of the projector based on the orientation information detected by the orientation detection means to control the orientation of the screen projected on the screen surface.
A range detecting means for detecting the position and arrangement of characters by performing character recognition at a predetermined position on the screen surface based on the image information obtained by the camera unit and detecting the range of the screen to be projected on the screen surface.
A range control means that controls the range of the screen projected on the screen surface by sending a drive control signal to the screen state change operation function unit of the projector based on the screen range information detected by the range detection means.
A character recognition means that recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit.
A program for a projector system, characterized in that the content corresponding to the character related to the character recognition result is taken out from the content storage unit and functioned as a content transmission means to be transmitted to the projector as a video signal. The program for a projector system according to claim 6, wherein the characters are arranged at the four corners of a rectangle. Using the computer as the range detecting means, a rectangle having a diagonal line between two characters having a predetermined positional relationship is obtained, and the range of the rectangle is made to function to be detected as the range of the screen to be projected on the screen surface. The program for a projector system according to claim 6 or 7. The program for a projector system according to claim 6, wherein the characters are arranged at a plurality of positions on an elliptical arc. The program for a projector system according to any one of claims 6 to 9, wherein the characters described on the screen surface are alphabets in which the vertical direction can be determined.

Images