JP2019062378A - Projector system and program for projector system - Google Patents

Abstract

To properly project an image onto the screen surface after movement by following the movement of the screen surface.SOLUTION: A projector system includes a projector 10, a camera unit 20 that captures image information by capturing a screen surface on which an image is projected by the projector 10, direction detection means 311 that performs character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit 20 to detect the vertical and horizontal directions of characters and detects direction information of the projected screen on the screen surface, and direction control means 312 that transmits a drive control signal to a screen state changing operation function unit of the projector 10 based on the direction information detected by the direction detection means 311 and control the direction of the screen projected on the screen surface.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a projector system and a program for a projector system in a usage form in which a screen is moved to project content.

  In recent years, a projector is used to display a lecture manuscript on a desk or to display a recipe on a cooking table of a cooking class. FIG. 1 is a diagram in which a recipe is projected from projector systems 103A and 103B provided on a ceiling 102 to cooking tables 101A and 101B of a cooking class.

  In the above-described steating, it is preferable that the recipe is displayed at a position that follows the movement of the cook. In particular, when the cook moves from one side to the opposite side of the cooking benches 101A and 101B, the upper and lower sides of the character become opposite, making reading difficult. In addition, when the cook of the cooking table 101A can read only Japanese and the cook of the cooking table 101B can read only English, it is convenient to display recipes with different languages.

  On the other hand, Patent Document 1 discloses that when a positioning mark and a keyword are drawn on a board, they are read and content corresponding to the keyword is displayed at a position designated by the positioning mark.

  Further, according to Patent Document 2, when the medium provided with the position marker is held over the display unit on which the content to be copied is displayed, the state of the medium such as position and angle is detected from the position of the position marker and the copy area is determined. And a system capable of copying and copying is disclosed.

  In Patent Document 3, a first image is projected on a projection plane, a range including the first image projected on the projection plane is imaged to generate a second image, and the imaging unit generates the second image. A recognition unit for recognizing an instruction to the image supply device based on the second image is disclosed, and the instruction recognized by the recognition unit is given to the control unit. According to Patent Document 3, the user causes the imaging unit to capture an image different from the first image by holding the hand over a predetermined area in the first image being projected. It is possible to easily give an instruction to the image supply device.

JP, 2013-89987, A JP 2005-31448 A JP, 2011-164878, A

  In Patent Document 1 described above, it is assumed that classes are conducted using a white board, and it is not assumed that the image is displayed upside down or diagonally displayed on the white board.

  In the system of Patent Document 2, by tilting the medium provided with the position marker or the like, it is possible to obtain an image in the position marker which is tilted from the object to be copied. However, when the screen to be projected by the projector is tilted, the image is not properly displayed in the screen.

  The invention of Patent Document 3 is for easily giving an instruction such as page up to the image supply device. Therefore, when the screen to be projected by the projector is inclined, a command or the like for appropriately displaying an image on the screen is not generated.

  The present invention was made in response to the current situation of the projector system as described above and the demand for the projector system, and its object is to follow the movement of the screen surface and to project the image properly on the screen surface after movement Providing a projector system. Another object of the present invention is to provide a projector system capable of designating content by characters in a screen surface.

  A projector system according to the present invention includes a projector including a screen state change operation function unit that receives a drive control signal and changes the orientation and range of a screen to be projected, and a screen surface on which an image is projected by the projector The camera unit obtains an image information by capturing an image, and recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit to detect the upper, lower, left, and right directions of the characters, and projects the characters on the screen Direction detection means for detecting direction information of the screen, and a drive control signal is sent to the screen state changing operation function unit of the projector based on the direction information detected by the direction detection means, and the screen is projected on the screen surface And direction control means for controlling the direction.

  In the projector system according to the present invention, the character recognition of the predetermined position on the screen surface is performed based on the image information obtained by the camera unit to obtain the position and the arrangement of the characters and the range of the screen to be projected on the screen surface is detected. Driving control signal to the screen state change operation function unit of the projector based on the range detection means for detecting and the screen range information detected by the range detection means, and controlling the range of the screen projected on the screen surface And range control means.

  In the projector system according to the present invention, the range detection means obtains a rectangle having a diagonal between two characters in a predetermined positional relationship, and detects the range of the rectangle as a range of a screen to be projected on the screen surface. It is characterized by

  In the projector system according to the present invention, the content storage unit in which the content of the video projected from the projector is stored corresponding to the characters, and the character recognition of the predetermined position on the screen surface based on the image information obtained by the camera unit And content sending means for taking out the content corresponding to the character relating to the character recognition result from the content storage unit and sending it out as the video signal to the projector.

  The projector system according to the present invention is characterized in that the characters described on the screen surface are alphabets in which the vertical direction can be determined in the alphabet.

  A program for a projector system according to the present invention includes a projector including a screen state change operation function unit performing an operation of changing a direction and a range of a screen to be projected upon receiving a drive control signal, and an image by the projector is projected The computer of a projector system configured to include a camera unit that captures an image on a screen surface and obtains image information, and a control unit that includes a computer that controls the projector, based on the image information obtained by the camera unit. Character recognition of a predetermined position on the screen surface is performed to detect the vertical and horizontal directions of the character, and direction detection means for detecting direction information of the screen to be projected on the screen surface, and the direction information detected by the direction detection means Sending a drive control signal to the screen state change operation function unit of the projector; Characterized in that to function as orientation control means for controlling the orientation of the screen to be projected on the serial screen surface.

  In the projector system program according to the present invention, the computer is further subjected to character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit to obtain the position and arrangement of the characters and on the screen surface. A drive control signal is sent to the screen state change operation function unit of the projector based on the range detection means for detecting the range of the screen to be projected, and the range information of the screen detected by the range detection means, and projected on the screen surface It is characterized in that it functions as range control means for controlling the range of the screen.

  In the projector system program according to the present invention, the range detection means obtains a rectangle having a diagonal between two characters in a predetermined positional relationship, and detects the range of the rectangle as the range of the screen to be projected on the screen surface. It is characterized by

  In the projector system program according to the present invention, the projector system includes a content storage unit in which the content of the video projected from the projector is stored in correspondence to characters, and the computer is further obtained by the camera unit. Character recognition means for performing character recognition of a predetermined position on the screen surface based on image information, Function as content sending means for taking out content corresponding to the character relating to the character recognition result from the content storage unit and sending it to the projector as a video signal It is characterized by

  The projector system program according to the present invention is characterized in that the characters described on the screen surface are alphabets in which the vertical direction can be determined in the alphabet.

  According to the present invention, character recognition of a predetermined position on the screen surface is performed based on image information obtained by capturing an image of the screen surface on which an image is projected by the projector, and the vertical and horizontal directions of the character are detected. The direction information of the screen to be projected in is detected, the drive control signal is sent to the screen state changing operation function unit of the projector based on the detected direction information, and the direction of the screen projected on the screen surface is controlled. Following the movement of the surface, the image can be properly projected onto the screen surface after movement.

  Further, according to the present invention, the character recognition of the predetermined position on the screen surface is performed based on the image information obtained by the camera unit, and the content corresponding to the character related to the character recognition result is taken out from the content storage unit As it is sent to the projector, it is possible to specify the content by characters in the screen plane.

BRIEF DESCRIPTION OF THE DRAWINGS The perspective view which shows the example of the kitchen using the embodiment of the projector system which concerns on this invention. FIG. 1 is a block diagram of a first embodiment of a projector system according to the present invention. FIG. 1 is a plan view showing an example of a screen used in an embodiment of a projector system according to the present invention. 6 is a flowchart for explaining the operation of the first embodiment of the projector system according to the present invention. FIG. 5 is a plan view showing the attitude of a screen and a projected image for explaining the operation of the projector system according to the first embodiment of the present invention. FIG. 6 is a block diagram of a second embodiment of a projector system according to the present invention. The flowchart for demonstrating the operation | movement of 2nd Embodiment of the projector system which concerns on this invention. The top view which shows the screen for demonstrating the operation | movement by 2nd Embodiment of the projector system which concerns on this invention, and the projected content image | video. The top view which shows the screen for demonstrating the operation | movement by 2nd Embodiment of the projector system which concerns on this invention, and the projected content image | video.

  Hereinafter, embodiments of a projector system and a program thereof according to the present invention will be described with reference to the attached drawings. In the drawings, the same components are denoted by the same reference numerals and redundant description will be omitted. As shown in FIG. 1, the projector systems 103A and 103B according to the present embodiment are provided on a ceiling 102. FIG. 1 is merely an example, and the installation places and the number of projector systems 103A and 103B are not limited to this. The configuration of the projector systems 103A, 103B is identical and is as shown in FIG.

  The projector system includes a projector 10, a camera unit 20, and a control unit 30. The projector 10 includes a screen state change operation function unit 11 which receives the drive control signal and changes the direction and range of the screen to be projected. The screen state change operation function unit 11 can have a mechanical configuration that performs pan, tilt, and zoom operations.

  The projector 10 is provided with an image output unit 12 and a control unit 13 in addition to the screen state change operation function unit 11. The control unit 13 receives a signal sent from the control unit 30, and sends it to the video output unit 12 if it is a signal related to the video information, and sends it to the screen status change operation function unit 11 if it is a signal related to the screen status change operation. Do. The video output unit 12 receives a signal related to the video information, visualizes it, and outputs it to the screens 104A and 104B of FIG.

  The screens 104A and 104B are made of paper, acrylic plate, cloth or the like, and there is no restriction on the material, thickness, size or the like as long as an image can be projected. Also, the planar shape can be rectangular as shown in FIG. Of course, the planar shape of the screens 104A and 104B may be any shape. Characters indicating the projection range 9 of the image are described (printed etc.) on the screens 104A and 104B. Since the projection range 9 of the image is usually rectangular, a total of four characters are written at the four corners of the rectangle. Assuming that a rectangle having two characters in a predetermined positional relationship as a diagonal is a projection range, it may be two characters, but it can be four characters in consideration of a case where it is hidden by a hand or the like.

  In addition, characters may be described at positions other than the positions of the above four characters along the boundary of the projection range 9, but since it is expected that it will be a hindrance to visual observation when an image is projected, It can be done. The character is basically not limited as long as it can determine the vertical direction, but the vertical direction in the alphabet is determined from the viewpoint that better accuracy and efficiency of character recognition is preferable. It can be a possible alphabet. The six characters “I”, “O”, “X”, “S”, “W”, and “M” are not used because they are alphabets whose vertical direction can not be determined.

  The camera unit 20 picks up a screen surface on which an image is projected by the projector 10 to obtain image information. The control unit 30 controls the screen state change of the projector 10 based on the image information obtained by the camera unit 20, and sends the video information to the projector 10.

  The control unit 30 includes an arithmetic processing unit 31 configured by a CPU, a content storage unit 32 storing video information of a plurality of contents, and an input unit 33 for inputting a command or data. The input unit 33 can be configured by a keyboard, a touch panel, a mouse or the like.

  The arithmetic processing unit 31 includes an orientation detection unit 311, an orientation control unit 312, a range detection unit 313, a range control unit 314, and a content sending unit 315. The orientation detection unit 311, the orientation control unit 312, the range detection unit 313, the range control unit 314, and the content transmission unit 315 are realized by a program.

  The orientation detection unit 311 performs character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit 20 to detect the vertical and horizontal directions of the character, and detects orientation information of the screen to be projected on the screen surface. It is For character recognition, known configurations can be adopted other than this part and this part. The direction control means 312 sends a drive control signal to the screen state change operation function unit 11 of the projector 10 based on the direction information detected by the direction detection means 311, and controls the direction of the screen projected on the screen surface. It is

  The range detection means 313 performs character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit 20 to obtain the position and arrangement of the characters and detects the range of the screen to be projected on the screen surface. It is a thing. Specifically, the range detection means 313 obtains a rectangle having a diagonal between two characters in a predetermined positional relationship, and detects the range of the rectangle as the range of the screen to be projected on the screen surface. Range control means 314 sends a drive control signal to the screen state change operation function unit 11 of the projector 10 based on the range information of the screen detected by the range detection means 313, and the range of the screen projected on the screen surface Control.

  The input unit 33 is used to perform input for instructing reading of the content in the content storage unit 32. The content sending means 315 takes out the content instructed to be read by the input unit 33 from the content storage unit and sends it to the projector 10 as a video signal.

  The projector system according to the first embodiment configured as described above operates according to a program corresponding to the flowchart shown in FIG. When the power is turned on, the image becomes a start, and the camera unit 20 picks up a screen surface on which an image is projected by the projector 10 to obtain image information (S11). Next, character recognition is performed based on the obtained image information to detect the vertical and horizontal directions of the character, and direction information of the projected screen on the screen surface is detected (S12). Next, a drive control signal is sent to the screen state change operation function unit 11, and the direction of the screen projected on the screen surface is controlled (S13).

  Further, character recognition is performed based on the obtained image information to obtain the position and arrangement of the characters, and the range of the projected screen on the screen surface is detected (S14). A drive control signal is sent to the screen state changing operation function unit 11 of the projector 10 based on the obtained screen range information, and the range of the screen projected on the screen surface is controlled (S15).

  Next, the content instructed to be read out by the input unit 33 is taken out from the content storage unit (S16), sent out as the video signal to the projector 10, and the video is projected on the screens 104A and 104B (S17). Thereafter, the process is repeated by this program.

  According to the present embodiment, as shown in FIG. 5A, if the upper and lower sides and the left and right of the character posture described on the screens 104A and 104B are in the normal direction, the picture 50 of the strawberry which is the content is in the normal direction Is projected upwards). Further, as shown in FIG. 5B, if the character posture written on the screens 104A and 104B is upside down, the picture 50 of the strawberry which is the content is projected in the reverse direction. Furthermore, as shown in FIG. 5C, if the character orientation described on the screens 104A and 104B is inclined to the upper right, the picture 50 of the strawberry which is the content is also projected to the upper right.

  FIG. 6 shows the configuration of a projector system according to the second embodiment. In the present embodiment, the arithmetic processing unit 31A is provided with the character recognition means 316, and the content sending means 315A has a new function. That is, the character recognition means 316 performs character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit 20.

  In the content storage unit 32, one content is assigned corresponding to one letter of the alphabet, and a plurality of contents are stored so that the corresponding content can be read out by one letter of the alphabet. The content sending means 315A takes out the content corresponding to the character relating to the character recognition result from the content storage unit 32 and sends it to the projector 10 as a video signal.

  Except for the above configuration, the configuration of the present embodiment is the same as the configuration of the first embodiment. In the projector system according to the second embodiment configured as described above, the operation is performed by the program corresponding to the flowchart shown in FIG. The operations of steps S11 to S15 are the same as the configuration of the first embodiment, and thus the description thereof is omitted. Following step S15, the corresponding content is read out from the content storage unit 32 based on the character information as a result of the character recognition of the predetermined position on the screen surface based on the image information obtained by the camera unit 20 (S21). The read content is sent as the video signal to the projector 10, and the video is projected on the screens 104A and 104B (S22). Thereafter, the process is repeated by this program.

  According to the projector system of the second embodiment as described above, the following is possible. In the content storage unit 32, for example, it is assumed that "content of strawberry" is stored in association with the character A, and "content of melon" is stored in association with the character B.

  Therefore, as shown in FIG. 8A, when the screen 201 in which the letter A is written at the four corners is used, the letter A at the four corners is read by the camera unit 20 and made into image data to perform character recognition. Therefore, the "strawberry content", which is character-recognized as the character A and associated with the character A, is read from the content storage unit 32, and as shown in FIG. The image of "content of strawberry" is projected.

  Further, as shown in FIG. 8B, when the screen 202 in which the letter B is written at the four corners is used, the letter B at the four corners is read by the camera unit 20 and made into image data to perform character recognition. Therefore, the "melon content" that is recognized as the letter B and is associated with the letter B is read from the content storage unit 32, and as shown in FIG. The image of "melon content" is projected.

  As another example, in the content storage unit 32, for example, "content in Japanese" is stored in association with the character J, and "content in English" is stored in association with the character E. Do.

  Therefore, as shown in FIG. 9A, when the screen 203 in which the characters J are written at the four corners is used, the characters J at the four corners are read by the camera unit 20 and made into image data to perform character recognition. Therefore, “content in Japanese”, which is character-recognized as the character J and associated with the character J, is read from the content storage unit 32 and, as shown in FIG. The image of "content in Japanese" is projected.

  Further, as shown in FIG. 9B, when the screen 204 in which the letter E is written at the four corners is used, the letter E at the four corners is read by the camera unit 20 and made into image data and character recognition is performed. Therefore, the "English content" which is character-recognized as the character E and associated with the character E is read from the content storage unit 32, and as shown in FIG. An image of "content in English" is projected.

  In the above example, when the cook of cooking table 101A can read only Japanese in FIG. 1 and the cook of cooking table 101B can read only English, it is convenient because recipes with different languages can be displayed for each cooking table. It is.

  In the above embodiment, the predetermined positions in the case where character recognition at a predetermined position on the screen surface is performed are at four corners, but may be appropriately changed depending on the frame shape of the image to be projected and the shape of the screen surface. For example, in addition to the four corners, a character may be written at the middle position of the two characters and recognition may be performed for this as well. Also, the screen may be elliptical, and characters may be described at several positions on the arc, and recognition may be performed on this.

DESCRIPTION OF REFERENCE NUMERALS 10 projector 11 screen state change operation function unit 12 image output unit 13 control unit 20 camera unit 30 control unit 31 arithmetic processing unit 31A arithmetic processing unit 32 content storage unit 33 input unit 101A, 101B cooking platform 102 ceiling 103A, 103B projector system 104A , 103B, 201-204 Screen 311 Direction detection means 312 Direction control means 313 Range detection means 314 Range control means 315, 315A Content sending means 316 Character recognition means

Claims (10)

A projector provided with a screen state change operation function unit that receives a drive control signal and changes the orientation and range of a screen to be projected;
A camera unit that captures an image of a screen surface on which an image is projected by the projector and obtains image information;
Orientation detection means for performing character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit to detect upper, lower, left, and right directions of the character, and detecting orientation information of the projected screen on the screen surface;
Orientation control means for transmitting a drive control signal to the screen state change operation function unit of the projector based on the orientation information detected by the orientation detection means, and controlling the orientation of the screen projected on the screen surface. Projector system characterized by. Range detection means for performing character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit to obtain the position and arrangement of the characters and detecting the range of the projected screen on the screen surface;
Range control means for transmitting a drive control signal to the screen state change operation function unit of the projector based on the range information of the screen detected by the range detection means, and controlling the range of the screen projected on the screen surface The projector system according to claim 1, further comprising:   3. The apparatus according to claim 2, wherein said range detection means obtains a rectangle having a diagonal between two characters in a predetermined positional relationship, and detects the range of the rectangle as a range of a screen to be projected on the screen surface. Projector system as described. A content storage unit in which the content of video projected from the projector is stored in correspondence with characters;
Character recognition means for performing character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit;
The content sending means for taking out the content corresponding to the character according to the character recognition result from the content storage unit as the video signal and sending it to the projector. Projector system.   The projector system according to any one of claims 1 to 4, wherein the characters described on the screen surface are alphabets in the alphabet that can be determined in the vertical direction. Obtains image information by capturing a screen surface on which an image is projected by the projector, the projector having a screen state change operation function unit performing an operation of changing the orientation and range of the screen to be projected upon receiving a drive control signal A computer of a projector system including a camera unit and a control unit including a computer for controlling the projector;
Orientation detection means for performing character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit to detect upper, lower, left, and right directions of the character, and detecting orientation information of a projected screen on the screen surface;
Driving control signal is sent to the screen state changing operation function unit of the projector based on the direction information detected by the direction detecting means, and functions as direction control means for controlling the direction of the screen projected on the screen surface. A program for the projector system that is featured. Furthermore, the computer
Range detection means for performing character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit to obtain the position and arrangement of the characters and detecting the range of the projected screen on the screen surface;
A drive control signal is sent to the screen state change operation function unit of the projector based on the range information of the screen detected by the range detection means, and functions as a range control means for controlling the range of the screen projected on the screen surface. The program for a projector system according to claim 6, characterized in that:   8. The apparatus according to claim 7, wherein said range detecting means obtains a rectangle having a diagonal between two characters in a predetermined positional relationship, and detects the range of the rectangle as a range of a screen to be projected on the screen surface. The program for the projector system described. The projector system includes a content storage unit in which the content of the video projected from the projector is stored in correspondence to characters.
Furthermore, the computer
Character recognition means for performing character recognition of a predetermined position on the screen surface based on the image information obtained by the camera unit;
The content transmitting device according to any one of claims 6 to 8, characterized in that it functions as content sending means for taking out the content corresponding to the character according to the character recognition result from the content storage unit as the video signal and sending it to the projector. Projector system program.   The program for a projector system according to any one of claims 6 to 9, wherein the character described on the screen surface is an alphabet in the alphabet that can be determined in the vertical direction.

Images