JP2015106147A - Projector, image projection system, and control method of projector - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projector that can guide the operation for an object.SOLUTION: A projector 100 includes an imaging unit 51 that photographs an area including an object, an analysis unit (image analysis unit 52 and image recognition unit 53) that analyzes a result of the photographing by the imaging unit to recognize the object, a guidance information acquisition unit 30 that acquires guidance information for guiding the operation for the object, a guidance image creation unit 32b that creates a first guidance image based on the guidance information acquired by the guidance information acquisition unit 30, and a projection unit (image projection unit 10) that projects the first guidance image created by the guidance image creation unit 32b onto the object.

Description

  The present invention relates to a projector, an image projection system, and a projector control method.

  2. Description of the Related Art Conventionally, an electronic learning system for a learner to learn on a computer or a computer system has been disclosed in which a learning story is developed and the learning story is changed by a learner's operation (Patent Document 1). ). In Patent Document 1, an electronic learning system takes in initial learning information presented by an electronic recording medium or communication means into a computer, and develops an initial learning story using the initial learning information according to the learner's operation. Then, the learner's operation information and the like are stored, and the information and the initial learning information are changed into a learning story different from the initial learning story, and the execution is enabled. The learner's purpose is to learn the learning story while exchanging information on the computer with the electronic learning material and the learner in the electronic learning information including the initial learning information captured in the computer by the electronic recording medium or communication means. To match.

JP 2006-308815 A

  In an electronic learning system such as that described in Patent Document 1, a user can obtain information by display on a computer. However, it is not possible to instruct (guide) what kind of operation should be performed on the object to be practiced when performing practical skills rather than learning on a computer.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 A projector according to this application example includes an imaging unit that captures an area including an object, an analysis unit that analyzes an imaging result of the imaging unit and recognizes the object, and an operation on the object A guide information acquisition unit for acquiring guide information for guiding the user, a guide image generation unit for generating a first guide image based on the guide information acquired by the guide information acquisition unit, and the guide image generation unit A projection unit configured to project the generated first guide image onto the object.

  According to such a projector, the analysis unit analyzes the imaging result of the imaging unit and recognizes the object. The guidance image generation unit generates a first guidance image based on the guidance information acquired by the guidance information acquisition unit. The projection unit projects the first guide image onto the object. Thereby, the projector can guide the operator of the content of the operation performed on the object by projecting the first guidance image onto the object.

  Application Example 2 In the projector according to the application example described above, the analysis unit analyzes an imaging result of the imaging unit to recognize the object and the indicator, and the guidance information acquisition unit is configured by the analysis unit. The guide information is acquired based on the recognized operation of the indicator.

  According to such a projector, the analysis unit analyzes the imaging result and recognizes the object and the indicator. And a guidance image acquisition part acquires the guidance information based on operation of a pointer. Accordingly, the projector can acquire guidance information and guide the operator as the first guidance image in accordance with the operation of the operating tool.

  Application Example 3 In the projector according to the application example, the first guide image includes an image representing a position where an operation is performed on the object.

  According to such a projector, the operator can be guided to the position for performing an operation on the object by the first guidance image.

  Application Example 4 In the projector according to the application example, the imaging unit includes a plurality of imaging elements, and the analysis unit recognizes the object and the operation body in a three-dimensional manner. Features.

  According to such a projector, the imaging unit includes a plurality of imaging elements, and the analysis unit can recognize the object and the operating body in a three-dimensional manner. Thereby, the recognizability of a target object can be improved.

  Application Example 5 In the projector according to the application example described above, the projector further includes a correction unit that corrects the first guide image according to the shape of the object captured by the imaging unit and recognized by the analysis unit. Features.

  According to such a projector, the correction unit corrects the first guide image according to the shape of the object recognized by the analysis unit. Thereby, the corrected first guide image is projected onto the object. Therefore, when the first guide image does not conform to the shape of the object, the first guide image can be corrected and projected so as to conform to the shape of the object.

  Application Example 6 In the projector according to the application example, the guide image generation unit further generates a second guide image based on the guide information, and the projection unit uses the second guide image as the object. Is characterized by projecting to different positions.

  According to such a projector, the second guide image is projected at a position different from the object. Thereby, the projector can provide (guide) a lot of information regarding the operation to the operator by projecting the second guide image in addition to the first guide image to the object.

  Application Example 7 In the projector according to the application example, the second guide image includes an image representing a sample of an operation on the object.

  According to such a projector, it is possible to guide a sample of the operation on the target object to the operator using the second guidance image.

  Application Example 8 In the projector according to the application example, the guidance information acquired by the guidance information acquisition unit includes guidance voice information that is voice information for guidance, and outputs the guidance voice information. It further has a section.

  According to such a projector, the voice output unit outputs guidance voice information. Accordingly, since the projector guides by voice in addition to the first guide image and the second guide image to the object, the projector can guide a lot of information regarding the operation to the operator.

  Application Example 9 An image projection system according to this application example is an image projection system including an imaging device that captures an object, an analysis device that analyzes image information, and an image projection device that projects an image. The imaging device includes an imaging unit that images the object and generates captured image information, and a first output unit that outputs the captured image information to the analysis device, and the analysis device includes: A first input unit that inputs the captured image information output from the imaging device, an analysis unit that analyzes the captured image information and recognizes the target, and guidance information for guiding operations on the target A guide information acquisition unit that acquires the guide information, a guide image generation unit that generates a first guide image based on the guide information acquired by the guide information acquisition unit, and the first guide image generated by the guide image generation unit Information on the picture A second output unit that outputs to the projection device, wherein the image projection device receives a second input unit that inputs information of the first guide image output from the analysis device, and the first guide image. And a projection unit that projects onto the object.

  According to such an image projection system, the imaging device captures an object and generates captured image information. The analysis device analyzes captured image information and recognizes an object. Also, guidance information for guiding operations on the object is acquired. And the 1st guidance image based on guidance information is generated. The image projection device projects the first guide image onto the object. Thereby, the image projection system can guide the operator of the content of the operation performed on the object by projecting the first guidance image onto the object.

  Application Example 10 A projector control method according to this application example is a projector control method including an imaging unit, and an imaging step of imaging an area including an object by the imaging unit, and imaging by the imaging step. Based on the guide information acquired by the analysis step of analyzing the result and recognizing the object, the guide information acquisition step of acquiring guide information for guiding operations on the target object, and the guide information acquisition step A guide image generating step for generating the first guide image; and a projecting step for projecting the first guide image generated by the guide image generating step onto the object.

  According to such a projector control method, the projector can guide the contents of the operation performed on the object to the operator by projecting the first guidance image onto the object.

  In addition, when the projector, the image projection system, and the projector control method described above are constructed using a computer provided in the projector or the analysis apparatus, the mode and the application example realize the function. It is also possible to constitute in the form of a program for recording or a recording medium on which the program is recorded so as to be readable by the computer. Recording media include flexible disk, HDD (Hard Disk Drive), CD-ROM (Compact Disk Read Only Memory), DVD (Digital Versatile Disk), Blu-ray (registered trademark) Disc, magneto-optical disk, nonvolatile memory card The computer can read the internal storage device of the projector or analyzer (semiconductor memory such as RAM (Random Access Memory) and ROM (Read Only Memory)), and external storage device (USB (Universal Serial Bus) memory, etc.) Various types of media can be used.

FIG. 2 is a perspective view illustrating a projector and a projection state according to the first embodiment. 1 is a block diagram illustrating a configuration of a projector according to a first embodiment. The flowchart of the process which guides the operation content of a projector. The perspective view showing the image projection system and projection state concerning a 2nd embodiment. The block diagram which shows the structure of the image projection system which concerns on 2nd Embodiment.

(First embodiment)
Hereinafter, as a first embodiment, a projector that has an interactive function of capturing a projection image and detecting an object and a pointer in the projection image based on the captured image and guiding operation contents will be described.

FIG. 1 is a perspective view illustrating a projector and a projection state according to the first embodiment.
FIG. 1 shows a projector 100, a table T that is a projection surface, a real fish F1 that is an object, a knife P1 that is an indicator, and a projection image DA. An operator H is also displayed. The projector 100 is fixed or placed on the table T and projects an image on the table T.

  The projector 100 includes a projection lens 13 and four imaging cameras C1, C2, C3, and C4. The projection lens 13 projects the projection image DA on the table T, and the imaging cameras C1, C2, C3, and C4 capture the range including the projection image DA.

  In the projector 100 according to the first embodiment, an operation for handling a fish is guided. Therefore, the operator H places the real fish F1 on the table T, and uses the knife P1 to determine the fish F1. Moreover, the projector 100 can compare with the state of the real fish F1 by projecting on the table the sample image D1 of the fish that represents a mode of operation.

  On the fish sample image D1 of the projector 100, an image representing an operation, that is, an instruction line D2 representing a position to be cut by the knife P1 is projected. And the guide line L1 showing the position (cutting position) operated with the kitchen knife P1 is projected on the real fish F1. At this time, the projector 100 recognizes an image of the real fish F1 and projects the guide line L1. The guide line L1 is not displayed in the shadow of the real fish F1 when viewed from the projection lens 13 side, but is shown in FIG. 1 of the present embodiment for explanation. Further, a guide character D3 for guiding the operation is projected beside the sample image D1 (on the front side as viewed from the operator H). In FIG. 1, “Standing a knife across a fin” is displayed.

  Furthermore, the projector 100 projects buttons B1, B2, and B3 for switching the projection image DA. In the present embodiment, the character “next” for switching the projection image DA for guiding the fish handling operation to the image of the next scene (scene) is displayed on the button B1. In addition, a letter “return” for returning to the image of the previous scene is displayed on the button B2. In addition, on the button B3, a character “END” for ending the guidance of the operation for handling fish is displayed.

  When the operator H performs an operation of instructing the buttons B1, B2, and B3 with an indicator such as a finger (not shown) or a knife P1, the image is captured by the imaging cameras C1, C2, C3, and C4 of the projector 100. Recognizing the operation, the projector 100 projects an image corresponding to the operated button.

  The projector 100 includes a zoom function, a keystone correction function, and a focus function. Then, using these functions, the operator H adjusts to project the projection image DA so as to fit in the rectangular table T as shown in FIG. The projector 100 detects the frame of the table T or displays a predetermined test pattern by using the projection lens 13 and the imaging cameras C1, C2, C3, and C4, so that the zoom function, the keystone correction function, The focus function may be automatically adjusted so that the projected image DA is projected so as to fit on the rectangular table T. Hereinafter, descriptions of the zoom function, the keystone correction function, and the focus function are omitted. In the projector 100, it is assumed that calibration, which is a procedure for associating a predetermined location in the captured projection image DA with a predetermined location in the image based on the image signal (image information), is performed.

FIG. 2 is a block diagram illustrating a configuration of the projector 100 according to the first embodiment.
In FIG. 2, in addition to the projector 100, a network NW, a database DB connected to the network NW, a table T serving as a projection plane, a real fish F1 as a target, a knife P1 as an indicator, and the like are shown. ing. Thus, the guidance image can be projected by the interactive function.

  The projector 100 includes an image projection unit 10 as a projection unit, a control unit 20, an operation reception unit 21, a guidance information acquisition unit 30, a guidance information processing unit 31, an image processing unit 32, an image information input unit 35, an audio output unit 40, A speaker 41, an imaging analysis unit 50, and the like are provided.

  The image projection unit 10 includes a light source 11, three liquid crystal light valves 12R, 12G, and 12B as light modulation devices, a projection lens 13 as a projection optical system, a light valve drive unit 14, and the like. The image projection unit 10 modulates the light emitted from the light source 11 with the liquid crystal light valves 12R, 12G, and 12B to form image light, and projects the image light from the projection lens 13 to form a table T that is a projection surface. Etc.

  The light source 11 includes a discharge-type light source lamp 11a made of an ultra-high pressure mercury lamp, a metal halide lamp, or the like, and a reflector 11b that reflects light emitted from the light source lamp 11a toward the liquid crystal light valves 12R, 12G, and 12B. ing. The light emitted from the light source 11 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and each color light of red R, green G, and blue B, which are the three primary colors of light, by a color separation optical system (not shown). After being separated into components, they are incident on the liquid crystal light valves 12R, 12G, and 12B, respectively.

  The liquid crystal light valves 12R, 12G, and 12B are configured by a liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. In the liquid crystal light valves 12R, 12G, and 12B, a plurality of pixels (not shown) arranged in a matrix are formed, and a driving voltage can be applied to the liquid crystal for each pixel. When the light valve driving unit 14 applies a driving voltage corresponding to the input image information to each pixel, each pixel is set to a light transmittance corresponding to the image information. For this reason, the light emitted from the light source 11 is modulated by transmitting through the liquid crystal light valves 12R, 12G, and 12B, and an image corresponding to the image information is formed for each color light. The formed color images are synthesized for each pixel by a color synthesis optical system (not shown) to form a color image, and then projected from the projection lens 13.

  The control unit 20 includes a CPU (Central Processing Unit), a RAM used for temporary storage of various data, and a non-volatile memory such as a mask ROM, flash memory, FeRAM (Ferroelectric RAM), etc. (Not shown) and functions as a computer. The control unit 20 performs overall control of the operation of the projector 100 by the CPU operating according to a control program stored in a nonvolatile memory.

  The operation reception unit 21 receives an input operation from the operator H, and includes a plurality of operation keys for the operator H to give various instructions to the projector 100. The operation keys included in the operation receiving unit 21 are a power key for switching power on / off, a menu key for switching display / non-display of a menu image for performing various settings, a cursor movement in the menu image, and the like. Cursor keys to be displayed, determination keys for determining various settings, and the like. When the operator H operates (presses) various operation keys of the operation reception unit 21, the operation reception unit 21 receives this input operation and outputs an operation signal corresponding to the operation content of the operator H to the control unit 20. .

  The operation receiving unit 21 may be configured using a remote control (not shown) capable of remote operation. In this case, the remote controller transmits an operation signal such as an infrared ray according to the operation content of the operator H, and a remote control signal receiving unit (not shown) receives this and transmits it to the control unit 20.

  The guidance information acquisition unit 30 acquires guidance information from the database DB via the network NW using a protocol such as TCP / IP according to an instruction from the control unit 20. Here, the guidance information is information for guiding operations on the object, and is configured to include image information, audio information, and the like for each scene. In the guide information, a serial number is set for each scene, and it is possible to determine the number of the scene in the guide information. When the guide information acquisition unit 30 acquires the guide information, the guide information acquisition unit 30 notifies the control unit 20 of the acquisition. The acquired guidance information is output to the guidance information processing unit 31. In the present embodiment, the guide information is acquired from the database DB via the network NW, but may be acquired from a memory card or other storage medium. Further, guide information may be stored in advance in a nonvolatile memory or the like in the projector 100 and acquired from this memory.

  The guidance information processing unit 31 performs processing on the inputted guidance information according to an instruction from the control unit 20. Specifically, the guidance information is divided into image information and audio information. The guidance information processing unit 31 converts the image information into image information in a format that can be processed by the image processing unit 32 and outputs the image information to the image processing unit 32. At this time, the guidance information processing section 31 recognizes an image of the instruction line D2 drawn on the fish sample image D1. Then, the positional information of the instruction line D2 in the sample image D1 is also output to the image processing unit 32. In addition, the guidance information processing unit 31 converts the voice information into a format that can be processed by the voice output unit 40 and outputs the converted information to the voice output unit 40. The guidance information processing unit 31 notifies the control unit 20 of the scene number input in the image information.

  The image processing unit 32 includes an OSD processing unit 32a and a guide image generation unit 32b. The image processing unit 32 converts the image information input from the guidance information processing unit 31 or the image information input unit 35 into image data representing the gradation of each pixel of the liquid crystal light valves 12R, 12G, and 12B, and drives the light valve. To the unit 14. Here, the converted image data is for each color light of R, G, B, and is composed of a plurality of pixel values corresponding to all the pixels of each liquid crystal light valve 12R, 12G, 12B. The pixel value determines the light transmittance of the corresponding pixel, and the intensity (gradation) of light emitted from each pixel is defined by the pixel value. Further, the image processing unit 32 performs image quality adjustment processing for adjusting brightness, contrast, sharpness, hue, and the like on the converted image data based on an instruction from the control unit 20.

  The OSD processing unit 32a performs an OSD (on-screen display) such as a menu image or a message image on an image based on input image information (hereinafter also referred to as “input image”) based on an instruction from the control unit 20. A process for superimposing and displaying an image is performed. The OSD processing unit 32a includes an OSD memory (not shown) and stores OSD image information representing graphics, fonts, and the like for forming an OSD image. When the control unit 20 instructs to superimpose the OSD image, the OSD processing unit 32a reads out necessary OSD image information from the OSD memory and adds the OSD image to the image information so that the OSD image is superimposed at a predetermined position on the input image. This OSD image information is synthesized.

  The guide image generation unit 32b projects a guide line L1 (first guide image), a sample image D1 (second guide image), an instruction line D2 (second guide image), and a guide to be projected onto the real fish F1 that is the object. Character D3 (second guide image) is generated. The sample image D1, the instruction line D2, and the guide character D3 are generated as images based on the input image. The guide line L1 is generated as an OSD image and is superimposed on an image based on the input image.

  The guide image generation unit 32b corresponds to the real fish F1, which is an object recognized by the imaging analysis unit 50 described later, based on the positional information of the instruction line D2 in the sample image D1 input from the guide information processing unit 31. The guide line L1 is combined with the position image information as an OSD image. Here, the real fish F1 is three-dimensional, and if the guide line L1 is displayed as a straight line, the real fish F1 may be distorted on the real fish F1. For this reason, the guide image generation unit 32b corrects the guide line L1 to a curve or the like so as not to be distorted on the real fish F1. Specifically, the actual fish F1 is imaged from a plurality of directions by the plurality of imaging cameras C1, C2, C3, and C4 of the imaging unit 51 of the imaging analysis unit 50. Thereby, the actual fish F1 can be recognized three-dimensionally. Further, the guide line L1 is corrected so as not to be distorted on the real fish F1 based on the captured image. The guide image generation unit 32b corresponds to a correction unit.

  The image information input unit 35 includes a plurality of input terminals, and various types of image information (image signals) are input to these input terminals from an external image supply device (not shown) such as a video playback device or a personal computer. Is done. Based on an instruction from the control unit 20, the image information input unit 35 selects image information and outputs the selected image information to the image processing unit 32. In the present embodiment, the image processing unit 32 processes and outputs the image information input from the guidance information processing unit 31 instead of the image information input from the image information input unit 35.

  When the light valve driving unit 14 drives the liquid crystal light valves 12R, 12G, and 12B according to the image data (image information) input from the image processing unit 32, the liquid crystal light valves 12R, 12G, and 12B display images corresponding to the image data. And this image is projected from the projection lens 13.

  The imaging analysis unit 50 includes an imaging unit 51, an image analysis unit 52, and an image recognition unit 53. The imaging analysis unit 50 is controlled by the control unit 20. The imaging analysis unit 50 captures an image of the table T that is the projection plane, analyzes the image, and recognizes the image of the fish F1 that is the object. The image analysis unit 52 and the image recognition unit 53 correspond to an analysis unit.

  The imaging unit 51 includes a plurality of imaging cameras C1, C2, C3, and C4. The imaging cameras C1, C2, C3, and C4 each include an imaging element (not shown) such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, and light emitted from an imaging target. Is provided with an imaging lens (not shown) for forming an image on the imaging device. The imaging unit 51 captures an area including an image projected on the table T that is a projection plane (hereinafter also referred to as “projection image”) based on an instruction from the control unit 20. Then, the imaging unit 51 sequentially generates image information representing captured images (hereinafter also referred to as “captured images”) and outputs the image information to the image analysis unit 52.

  The image analysis unit 52 includes a processing device for image analysis, a memory, and the like (none of which are shown). The image analysis unit 52 analyzes the captured image information input from the imaging unit 51. The image analysis unit 52 outputs the analysis result to the image recognition unit 53. Further, the image analysis unit 52 performs conversion from position information on the captured image to position information on the image based on the image signal of the input image.

  The image recognition unit 53 performs image recognition based on the analysis result of the image analysis unit 52, and recognizes the shape information and position information of the real fish F1 that is the object and the finger or knife P1 that is the indicator. The image recognition unit 53 outputs the shape information and position information of the real fish F1 and the finger or knife P1 to the control unit 20 and the image processing unit 32.

  The nonvolatile memory of the control unit 20 stores software (device driver) for using an indicator such as a finger or a knife P1 as an operation device. When the software is activated, the image processing unit 32 operates the finger or the knife P1 in the projected image based on the position information (control information) input from the imaging analysis unit 50 via the control unit 20. Recognize the position where each was made. Then, based on the position information of the operation of the finger or the knife P1, the image processing unit 32 notifies the control unit 20 of information on whether or not an instruction for the buttons B1, B2, B3, etc. has been made.

  The audio output unit 40 includes an amplification circuit (not shown) and the like, and outputs audio based on the audio information input from the guidance information processing unit 31 from the speaker 41. The voice information guides the operation to the operator H.

Next, a process in which the projector 100 guides the operation content will be described using a flowchart.
FIG. 3 is a flowchart of processing for guiding the operation content of the projector 100 according to the present embodiment. In the present embodiment, it is assumed that “how to fish” is selected in advance as the operation content to be guided.

  The control unit 20 of the projector 100 instructs the guidance information acquisition unit 30 to acquire the guidance information of the first scene of “how to judge fish” from the database DB via the network NW (step S101). . The control unit 20 instructs the guidance information processing unit 31 to cause the image processing unit 32 to output image information in the guidance information, and to project an image based on the image information. Further, the control unit 20 instructs the guidance information processing unit 31 to output the voice information in the guidance information to the voice output unit 40 and to output the guidance voice from the speaker 41 (step S102).

  The control unit 20 issues an instruction to the guidance information processing unit 31, recognizes the instruction line D2 in the sample image D1 on the image information, and detects position information (step S103).

  The control unit 20 issues an instruction to the imaging unit 51 of the imaging analysis unit 50 to capture an area including the table T, which is a projection plane, and generate a captured image (step S104). The image analysis unit 52 analyzes the captured image (step S105). Then, the image recognition unit 53 recognizes the shape information and position information of the real fish F1, which is the object, based on the analysis result (step S106).

  Based on the shape information and position information of the real fish F1, which is the object, and the position information of the instruction line D2 in the sample image D1, the control unit 20 superimposes the guide line L1 based on the OSD image on the image information, The guide line L1 is displayed on the fish F1 (step S107).

  The control unit 20 issues an instruction to the image recognizing unit 53, and image-recognizes the shape information and position information of the finger or knife P1 that is the indicator based on the analysis result (step S108). The control unit 20 determines whether or not the indicator indicates the “next” button B1 (step S109).

  When the indicator indicates the “next” button B1 (step S109: YES), the control unit 20 determines whether or not the operation guidance has ended, that is, all the guidance scenes have ended. (Step S110). If the operation guidance has been completed (step S110: YES), the process of guiding the operation content (the flowchart) is terminated.

  When the operation guidance has not ended (step S110: NO), the control unit 20 instructs the guidance information acquisition unit 30 to acquire the guidance information of the next scene (scene) from the database DB (step S110). S111). The control unit 20 instructs the guidance information processing unit 31 to cause the image processing unit 32 to output image information in the guidance information, and to project an image based on the image information. Further, the control unit 20 instructs the guidance information processing unit 31 to output voice information in the guidance information to the voice output unit 40 and to output guidance voice from the speaker 41 (step S112). Then, the process proceeds to step S103.

  When the indicator does not instruct the “next” button B1 (step S109: NO), the control unit 20 determines whether or not the “return” button B2 is instructed (step S113).

  When the indicator indicates the “return” button B2 (step S113: YES), the control unit 20 issues an instruction to the guidance information acquisition unit 30, and the previous scene (scene from the database DB) ) Guidance information is acquired (step S114). The control unit 20 instructs the guidance information processing unit 31 to cause the image processing unit 32 to output image information in the guidance information, and to project an image based on the image information. Further, the control unit 20 instructs the guidance information processing unit 31 to output the voice information in the guidance information to the voice output unit 40 and output the guidance voice from the speaker 41 (step S115). Then, the process proceeds to step S103.

  When the indicator does not indicate the “return” button B2 (step S113: NO), the control unit 20 determines whether or not the “end” button B3 is specified (step S116).

  When the indicator indicates the “end” button B3 (step S116: YES), the process of guiding the operation content (the flowchart) is ended. When the indicator does not instruct the “end” button B3 (step S116: NO), the process proceeds to step S104.

  Thus, the projector 100 can guide the operation of “how to judge fish” with images and sounds by executing the process of guiding the operation content. The guide line L1 can be displayed on the real fish F1. The operation content to be guided is not limited to “how to handle fish”, and other guidance operations can be selected. In this case, the control unit 20 issues an instruction to the guidance information acquisition unit 30, acquires various “operation contents to be guided” stored in the database DB, and causes the image projection unit 10 to project. Then, the operator H is selected by an indicator, and is recognized and executed by the imaging analysis unit 50.

According to the first embodiment described above, the following effects can be obtained.
(1) The imaging analysis unit 50 of the projector 100 analyzes the captured image and recognizes the real fish F1 that is the target. Based on the guide information acquired by the guide information acquiring unit 30, the guide image generating unit 32b has a guide line L1 (first guide image) at a position in the image information where an operation is performed on the real fish F1, which is the target object. ) As an OSD image. The image projection unit 10 projects an image based on the image information. Thus, the projector 100 can project the guide line L1 onto the real fish F1 that is the target object, and what operation should be performed on the target object (where the knife P1 is used to cut) This is useful because it can be guided to the operator H and supported.

  (2) The imaging analysis unit 50 of the projector 100 analyzes the imaging result, and recognizes the real fish F1, which is the object, and the indicator such as the finger of the operator H and the knife P1. Then, based on the instruction operation by the indicator (the instruction operation of the “next” button), the control unit 20 issues an instruction to the guidance information acquisition unit 30 to guide the next scene (scene) from the database DB. Information can be acquired. The guide information processing unit 31 and the guide image generation unit 32b of the image processing unit 32 generate image information on which the guide line L1 is superimposed. The image projection unit 10 projects a guide image on the object. Thus, the projector 100 can guide the operator H what operation should be performed next in response to the instruction operation of the operator H. Further, it is useful because it is possible to return to the previous scene or end the guidance by an instruction operation by the indicator.

  (3) The projector 100 is configured to include a plurality of imaging cameras C1, C2, C3, and C4 as the imaging unit 51, and the imaging analysis unit 50 includes a real fish F1 that is a target and an operation body. A certain finger or knife P1 can be recognized in three dimensions. Thereby, the accuracy of image recognition can be improved.

  (4) The guide image generation unit 32b of the projector 100 corrects the guide line L1 according to the shape of the object. That is, the guide image generation unit 32b corrects the guide line L1 (first guide image) so as not to be distorted according to the three-dimensional shape of the real fish F1, which is the object recognized by the imaging analysis unit 50. Thereby, the operator H can recognize the correct operation position on the object, which is beneficial.

  (5) The projector 100 projects a fish sample image D1, an instruction line D2, and a guide character D3 that guides the operation, which represent a sample operation, at a position different from the object. Thereby, the projector 100 can provide the operator H with a lot of information regarding the operation by projecting the sample image D1, the instruction line D2, and the guide character D3 in addition to the guide line L1 to the object. . Therefore, the operator H can efficiently perform an operation on the object.

  (6) The projector 100 outputs a guidance voice by the voice output unit 40 and the speaker 41. Thereby, since the projector 100 guides by voice in addition to the guide line L1, the sample image D1, the instruction line D2, and the guide character D3 to the object, the projector 100 can provide the operator H with a lot of information regarding the operation. it can. Therefore, the operator H can efficiently perform an operation on the object.

(Second Embodiment)
In the second embodiment, an image projection system includes an imaging device that captures a projected image, an analysis device that analyzes image data, and an image projection device that projects an image, and performs projection based on the captured image. An image projection system having an interactive function for detecting an object and an indicator in an image and guiding operation contents will be described.

FIG. 4 is a perspective view illustrating an image projection system and a projection state according to the second embodiment.
FIG. 4 shows a projector 200 as an image projection apparatus, a PC 300 as an analysis apparatus, and an imaging unit 400 (imaging cameras C5 and C6) as an imaging apparatus as the image projection system 1. FIG. 4 further shows a table T that is a projection surface, a fish F1 that is an object, a knife P1 that is an indicator, and a projection image DA. An operator H is also displayed. The projector 200 is fixed or placed on the table T and projects an image on the table T. Here, the same code | symbol is attached | subjected to the structure part similar to 1st Embodiment. In the second embodiment, it is assumed that “how to treat fish” is selected as the operation content to be guided.

  The projector 200 of the image projection system 1 includes a projection lens 13. The projection lens 13 projects the projection image DA on the table T based on the input image information input from the PC 300. The imaging unit 400 includes a plurality of imaging cameras C5 and C6, and images the projection surface. The captured image information captured by the imaging cameras C5 and C6 is output to the PC 300.

  In the image projection system 1 according to the second embodiment, an operation for handling a fish is guided as in the first embodiment. Therefore, the operator H places the real fish F1 on the table T, and uses the knife P1 to determine the fish F1. Further, the projector 200 of the image projection system 1 can compare the state of the real fish F1 by projecting the fish sample image D1 representing the sample operation on the table.

  On the fish sample image D1 projected by the projector 200 of the image projection system 1, an image representing an operation, that is, an instruction line D2 representing a position to be cut by the knife P1 is projected. And the guide line L1 showing the position (cutting position) operated with the knife P1 is projected on the real fish F1. At this time, the image projection system 1 recognizes an image of the real fish F1 and projects the guide line L1. The guide line L1 is not displayed in the shadow of the real fish F1 when viewed from the projection lens 13 side, but is displayed for explanation in FIG. 4 of the present embodiment. Further, a guide character D3 for guiding the operation is projected next to the sample fish sample image D1 (on the front side as viewed from the operator H). In FIG. 1, “Standing a knife across a fin” is displayed.

  Further, the projector 200 of the image projection system 1 projects buttons B1, B2, and B3 for switching the projection image DA. In the present embodiment, on the button B1, characters “next” are displayed for switching the projected image DA for guiding the operation of handling fish to the next image. In addition, on the button B2, characters “return” for returning to the previous image are displayed. In addition, on the button B3, a character “END” for ending the guidance of the operation for handling fish is displayed.

  When the operator H performs an operation of instructing the buttons B1, B2, and B3 with an indicator such as a finger (not shown) or a knife P1, the imaging is performed by the imaging cameras C5 and C6, and the operation is recognized by the PC 300. The projector 200 projects an image corresponding to the operated button.

  Note that the projector 200 of the image projection system 1 has a zoom function, a keystone correction function, and a focus function. Then, using these functions, the operator H adjusts to project the projection image DA so as to fit in the rectangular table T as shown in FIG. The image projection system 1 uses the projection lens 13 and the imaging cameras C5 and C6 to detect the frame of the table T and display a predetermined test pattern, so that the zoom function and the keystone correction function of the projector 200 are detected. The focus function may be automatically adjusted so that the projected image DA is projected so as to fit on the rectangular table T. Hereinafter, descriptions of the zoom function, the keystone correction function, and the focus function are omitted. In the image projection system 1, calibration is performed as a procedure for associating a predetermined location in the captured projection image DA with a predetermined location in the image based on the image signal (image information). To do.

FIG. 5 is a block diagram showing a configuration of the image projection system 1 according to the second embodiment.
The image projection system 1 includes a projector 200 as an image projection device, a personal computer (PC) 300 as an analysis device, and an imaging unit 400 as an imaging device.

  In FIG. 5, in addition to the image projection system 1, a network NW, a database DB connected to the network NW, a table T serving as a projection surface, a real fish F1 as a target, a kitchen knife P1 as an indicator, and the like. It is represented. As a result, an interactive function is realized, and a guidance image is projected.

  The projector 200 includes an image projection unit 10 as a projection unit, a control unit 220, an operation reception unit 21, an image information input unit 230, an image processing unit 231, an audio information input unit 240, an audio output unit 241, a speaker 242, and the like. It is configured.

  The image projection unit 10 and the operation reception unit 21 are the same as the image projection unit 10 and the operation reception unit 21 of the projector 100 according to the first embodiment. Therefore, the description is omitted. In this way, the same reference numerals are given to the same components.

  The control unit 220 includes a CPU, a RAM used for temporary storage of various data, and a non-volatile memory such as a mask ROM, flash memory, and FeRAM (none of which are shown), and functions as a computer. is there. The control unit 220 performs overall control of the operation of the projector 200 by the CPU operating according to a control program stored in a nonvolatile memory.

  The image information input unit 230 includes a plurality of input terminals, and various types of image information (image signals) are input to these input terminals from an external image supply device (not shown) such as a video playback device or a PC. The Based on an instruction from the control unit 220, the image information input unit 230 selects image information and outputs the selected image information to the image processing unit 231. In the present embodiment, the image information input unit 230 is connected to the PC 300 in order to realize the image projection system 1. The image information input unit 230 corresponds to the second input unit.

  The image processing unit 231 converts the image information input from the image information input unit 230 into image data representing the gradation of each pixel of the liquid crystal light valves 12R, 12G, and 12B, and outputs the image data to the light valve driving unit 14. Here, the converted image data is for each color light of R, G, B, and is composed of a plurality of pixel values corresponding to all the pixels of each liquid crystal light valve 12R, 12G, 12B. The pixel value determines the light transmittance of the corresponding pixel, and the intensity (gradation) of light emitted from each pixel is defined by the pixel value. Further, the image processing unit 32 performs image quality adjustment processing for adjusting brightness, contrast, sharpness, hue, and the like on the converted image data based on an instruction from the control unit 220.

  When the light valve driving unit 14 drives the liquid crystal light valves 12R, 12G, and 12B according to the image data (image information) input from the image processing unit 32, the liquid crystal light valves 12R, 12G, and 12B display images corresponding to the image data. And this image is projected from the projection lens 13.

  The audio information input unit 240 includes an audio input terminal, and receives audio information (audio signal). The input audio information is output to the audio output unit 241.

  The audio output unit 241 includes an amplifier circuit (not shown) and the like, and outputs audio based on the audio information input from the audio information input unit 240 from the speaker 242. The voice information guides the operation to the operator H.

  The PC 300 includes a control unit 320, a communication unit 330, a guidance information processing unit 331, a guidance image generation unit 332, a guidance image output unit 333, an image input unit 335, an image analysis unit 352, an image recognition unit 353, a guidance voice output unit 340, and the like. It is configured with.

  The control unit 320 includes a CPU, a RAM used for temporary storage of various data, and a non-volatile memory such as a mask ROM, flash memory, HDD (hard disk drive), and FeRAM (none of which are shown). It functions as a computer. The control unit 320 performs overall control of the operation of the PC 300 when the CPU operates according to a control program stored in a nonvolatile memory.

  The communication unit 330 acquires guide information from the database DB via the network NW using a protocol such as TCP / IP according to an instruction from the control unit 320. The communication unit 330 corresponds to a guidance information acquisition unit. When acquiring the guidance information, the communication unit 330 notifies the control unit 320 of the acquisition. The acquired guidance information is output to the guidance information processing unit 331. In the present embodiment, the guide information is acquired from the database DB via the network NW, but may be acquired from a memory card or other storage medium.

  The guidance information processing unit 331 performs processing on the inputted guidance information according to an instruction from the control unit 320. Specifically, the guidance information is divided into image information and audio information. Then, the guidance information processing unit 31 converts the image information into image information in a format that can be processed by the guidance image generation unit 332 and outputs the image information to the guidance image generation unit 332. At this time, the guidance information processing section 31 recognizes an image of the instruction line D2 drawn on the fish sample image D1. Then, the position information of the instruction line D2 in the sample image D1 is also output to the guidance image generation unit 332. In addition, the guidance information processing unit 331 outputs voice information to the guidance voice output unit 340. The guidance information processing unit 331 notifies the control unit 320 of the scene number (scene number) input in the image information.

  The guide image generation unit 332 guides a guide line L1 (first guide image), a sample image D1 (second guide image), an instruction line D2 (second guide image), and a guide to be projected onto a real fish F1 that is an object. Character D3 (second guide image) is generated. The sample image D1, the instruction line D2, and the guide character D3 generate an image based on the input image information. The guide line L1 is generated as a superimposed image that is superimposed on the image information. The guide image generation unit 332 corresponds to the real fish F1 that is an object that has been image-recognized by the image recognition unit 353, which will be described later, based on the position information of the instruction line D2 in the sample image D1 input from the guide information processing unit 331. The guide line L1 is combined with the position image information as a superimposed image. Here, the real fish F1 is three-dimensional, and when the guide line L1 is displayed as a straight line, the real fish F1 may be distorted on the real fish F1. For this reason, the guide image generation unit 332 corrects the guide line L1 to a curve or the like so as not to be distorted on the real fish F1. Specifically, the actual fish F1 is imaged from a plurality of directions by the plurality of imaging cameras C5 and C6 of the imaging unit 400. Thereby, the actual fish F1 can be recognized three-dimensionally. Further, the guide line L1 is corrected so as not to be distorted on the real fish F1 based on the captured image.

  The guide image output unit 333 receives image information from the guide image generation unit 332. Then, the guidance image output unit 333 outputs image information to the image information input unit 230 of the projector 200. The guide image output unit 333 corresponds to a second output unit.

  The guidance voice output unit 340 inputs voice information from the guidance information processing unit 331. Then, the guidance voice output unit 340 outputs voice information to the voice information input unit 240 of the projector 200.

  The image input unit 335 inputs captured image information from the imaging unit 400 according to an instruction from the control unit 320. The image input unit 335 outputs the captured image information to the image analysis unit 352 and notifies the control unit 320 that the captured image information has been input. The image input unit 335 corresponds to the first input unit.

  The image analysis unit 352 includes a processing device for image analysis, a processing program, a memory, and the like (all not shown). The image analysis unit 352 analyzes the captured image information input from the image input unit 335. The image analysis unit 352 outputs the analysis result to the image recognition unit 353. In addition, the image analysis unit 352 converts position information on the captured image into position information on the image based on the image signal (image information to be output).

  The image recognizing unit 353 performs image recognition based on the analysis result of the image analyzing unit 352, and recognizes the shape information and position information of the real fish F1 that is the object and the finger or knife P1 that is the indicator. The image recognition unit 353 outputs the shape information and position information of the real fish F1 and the finger or knife P1 to the control unit 320 and the guide image generation unit 332. The image analysis unit 352 and the image recognition unit 353 correspond to the analysis unit.

  The nonvolatile memory of the control unit 320 stores software (device driver) for using an indicator such as a finger or a knife P1 as an operation device. When the software is activated, the guidance information processing unit 331 determines the position where the finger or the knife P1 is operated in the projected image based on the position information (control information) input from the image recognition unit 353. Recognize each. Then, based on the position information of the operation of the finger or the knife P1, the guidance information processing unit 331 notifies the control unit 320 of information on whether or not an instruction for the buttons B1, B2, B3, etc. is made.

  The imaging unit 400 includes a plurality of imaging cameras C5 and C6. The imaging cameras C5 and C6 are each an imaging element (not shown) composed of a CCD sensor or a CMOS sensor, and an imaging lens (not shown) for forming an image of light emitted from an imaging target on the imaging element. )). The imaging unit 400 captures an area including an image projected on the table T, which is a projection plane, based on an instruction from the control unit 20. Then, the imaging unit 400 sequentially generates image information (captured image information) representing the captured image and outputs the image information to the image input unit 335 of the PC 300. The imaging unit 400 when outputting captured image information to the PC 300 corresponds to the first output unit.

  Similar to the projector 100 of the first embodiment, the image projection system 1 described above can guide the operation of “fish handling” with an image and sound by executing a process for guiding the operation content. . Moreover, the guide line L1 can be displayed on the real fish F1. The operation content to be guided is not limited to “how to judge fish”, and other operation content can be selected. In this case, the control unit 320 of the PC 300 issues an instruction to the communication unit 330, acquires various “guidance operation contents” stored in the database DB, and causes the projector 200 to project them. Then, it is assumed that the operator H is selected by an indicator, picked up by the image pickup unit 400, recognized by the PC 300, and executed.

According to the second embodiment described above, the following effects can be obtained.
(1) In the image projection system 1, the image analysis unit 352 and the image recognition unit 353 of the PC 300 analyze the captured image and recognize the real fish F1 that is the target. Based on the guide information acquired by the communication unit 330, the guide image generation unit 332 sets a guide line L1 (first guide image) at a position where an operation is performed on the real fish F1, which is the object, in the image information. Composite as a superimposed image. The projector 200 inputs image information and projects an image based on the image information. Thereby, the projector 200 can project the guide line L1 onto the real fish F1 that is the object, and what operation should be performed on the object (where the knife P1 is used) This is useful because the operator H can be guided and supported.

  (2) The image analyzing unit 352 and the image recognizing unit 353 of the PC 300 of the image projection system 1 analyze the imaging result, and the actual fish F1, which is the object, and the indicator such as the finger of the operator H and the knife P1 Recognize Then, based on the pointing operation of the indicator (the “next” button pointing operation), the control unit 320 issues an instruction to the communication unit 330, and guides the next scene (scene) guidance information from the database DB. Can be acquired. Then, the guidance information processing unit 331 and the guidance image generation unit 332 generate image information on which the guide line L1 is superimposed. Then, the guidance image output unit 333 outputs the image information to the projector 200. The projector 200 projects a guide image on the object. As a result, the projector 200 can guide the operator H what operation should be performed next in response to the instruction operation of the operator H. In addition, it is useful because it is possible to return to the previous scene or end the guidance by the pointing operation of the pointer.

  (3) The image projection system 1 includes a plurality of imaging cameras C5 and C6 as the imaging unit 400, and the image analysis unit 352 and the image recognition unit 353 of the PC 300 are the actual fish F1 that is the object and the operation. It is possible to three-dimensionally recognize a finger or a knife P1 that is a body. Thereby, the accuracy of image recognition can be improved.

  (4) The guide image generation unit 332 of the PC 300 of the image projection system 1 corrects the guide line L1 according to the shape of the object. That is, the guide image generation unit 332 corrects the guide line L1 (first guide image) so as not to be distorted according to the three-dimensional shape of the real fish F1, which is the object recognized by the image analysis unit 352. Thereby, the operator H can recognize the correct operation position on the object, which is beneficial.

  (5) The image projection system 1 projects a fish sample image D1, an instruction line D2, and a guide character D3 for guiding the operation, which represent a sample of the operation, at a position different from the object. Thereby, the image projection system 1 provides the operator H with a lot of information regarding the operation by projecting the sample image D1, the instruction line D2, and the guide character D3 in addition to the guide line L1 to the object. be able to. Therefore, the operator H can efficiently perform an operation on the object.

  (6) The image projection system 1 outputs the guidance sound by the sound output unit 241 and the speaker 242 of the projector 200. As a result, the image projection system 1 provides the operator H with a lot of information related to the operation in order to guide by voice in addition to the guide line L1, the sample image D1, the instruction line D2, and the guide character D3 to the object. be able to. Therefore, the operator H can efficiently perform an operation on the object.

  (7) Since the projector 200 of the image projection system 1 does not need to incorporate the imaging unit 400, the image recognition unit 353, the communication unit 330, and the like, it is useful because a general projector can be used.

  (8) The PC 300 of the image projection system 1 can implement functions such as the image analysis unit 352, the image recognition unit 353, the guidance information processing unit 331, and the guidance image generation unit 332 as software. Therefore, since processing can be performed using a general PC, it is beneficial.

  In addition, it is not limited to embodiment mentioned above, It is possible to implement by adding various change, improvement, etc. A modification will be described below.

  (Modification 1) In the first embodiment, the imaging unit 51 includes four imaging cameras C1, C2, C3, and C4. In the second embodiment, the imaging unit 400 includes two imaging cameras. C5 and C6 were provided. However, the number of imaging cameras is not limited to this, and may be plural. Moreover, the imaging camera may be single. In the case of a single unit, stereoscopic image recognition cannot be performed, but the configuration of the projector 100 and the image projection system 1 can be simplified.

  (Modification 2) In the above embodiment, the buttons B1, B2, and B3 that are projected and displayed are displayed with characters “next”, “return”, and “end” for switching the projected image DA. However, the buttons to be projected and displayed are not limited to these. For example, buttons such as instruction buttons “with scales” and “without scales” for causing the operator H to select the presence or absence of fish scales may be projected and displayed. Then, when “with scales” is instructed, an operation for taking scales may be guided. Further, the number of buttons is not limited. It may be singular or four or more.

  (Modification 3) In the above embodiment, the projected image DA is switched by the instruction operation of the buttons B1, B2, and B3. However, the imaging unit of the projector 100 or the image projection system 1 captures an image, and the image analysis unit and the image recognition unit recognize the image of the real fish F1 that is the object and the knife P1 that is the indicator, so It is also possible to recognize the state of the fish F1 and the state of the knife P1 and switch the projected image DA. For example, the projector 100 and the image projection system 1 may recognize that the head of the real fish F1 has been cut off, and switch to a scene image for guiding the next operation.

(Modification 4) In the above embodiment, the operation content guided by the projector 100 and the image projection system 1 is assumed to have an order of operations, such as “How to judge fish”, but the operation regardless of the order is guided. It may be a thing. For example, it is possible to guide the operation content such as arranging a plurality of components on the board. Specifically, the imaging unit images the substrate and a plurality of components placed on the table T, and the image recognition unit recognizes the image. When the operator H selects an arbitrary component, the projector 100 and the image projection system 1 can recognize the component and project and display a predetermined mark on the arrangement destination on the substrate. And the operator H can arrange | position components on a predetermined mark.
In addition, for example, it is possible to guide an operation for sorting the harvested fruits. Specifically, for example, an apple is placed on the table T, the imaging unit of the projector 100 or the image projection system 1 images the apple, and the image recognition unit recognizes the image. Then, the projector 100 and the image projection system 1 determine and rank the color and size of the apple based on the image recognition result, and project the rank information as an image on the apple. Thereby, the operator H can sort apples based on the rank information projected on the apples.

  (Modification 5) In the above embodiment, the projector 100 and the image projection system 1 project and display the guide line L1, the sample image D1, the instruction line D2, the guide character D3, and various buttons. A white image may be projected on an area other than the guide line L1, the sample image D1, the instruction line D2, the guide character D3, and various buttons in the projection image DA. In this way, the projection area is illuminated brightly, and the operator H can perform the operation in a bright environment. In addition, a black image may be projected on an area other than the guide line L1, the sample image D1, the instruction line D2, the guide character D3, and various buttons in the projection image DA. Thus, the operator H can clearly see the guide line L1, the sample image D1, the instruction line D2, the guide character D3, and various buttons.

  (Modification 6) In the above embodiment, the light source 11 of the projectors 100 and 200 is configured to include the discharge-type light source lamp 11a, but a solid light source such as an LED (Light Emitting Diode) light source or a laser, Other light sources can also be used.

  (Modification 7) In the above embodiment, the projectors 100 and 200 use the transmissive liquid crystal light valves 12R, 12G, and 12B as the light modulators. It is also possible to use a modulation device. Further, a micromirror array device that modulates the light emitted from the light source by controlling the emission direction of the incident light for each micromirror as a pixel can be used as the light modulation device.

  DESCRIPTION OF SYMBOLS 1 ... Image projection system, 10 ... Image projection part, 11 ... Light source, 11a ... Light source lamp, 11b ... Reflector, 12R, 12G, 12B ... Liquid crystal light valve, 13 ... Projection lens, 14 ... Light valve drive part, 20 ... Control , 21 ... Operation accepting part, 30 ... Guidance information acquisition part, 31 ... Guidance information processing part, 32 ... Image processing part, 32a ... OSD processing part, 32b ... Guidance image generation part, 35 ... Image information input part, 40 ... Audio output unit, 41 ... speaker, 50 ... imaging analysis unit, 51 ... imaging unit, 52 ... image analysis unit, 53 ... image recognition unit, 100, 200 ... projector, 220 ... control unit, 230 ... image information input unit, 231 DESCRIPTION OF SYMBOLS ... Image processing part 240 ... Audio | voice information input part 241 ... Audio | voice output part 242 ... Speaker ... 300 ... PC, 320 ... Control part 330 ... Communication part 331 ... Guidance information processing 332 ... Guide image generation unit 333 ... Guidance image output unit 335 ... Image input unit 340 ... Guidance voice output unit 352 ... Image analysis unit 353 ... Image recognition unit 400 ... Imaging unit C1, C2, C3, C4, C5, C6 ... imaging camera, F1 ... real fish, P1 ... kitchen knife, B1, B2, B3 ... button, D1 ... sample image, D2 ... indicator line, D3 ... guide character, L1 ... guide line, T …table.

Claims (10)

An imaging unit that images an area including the object;
Analyzing the imaging result of the imaging unit and recognizing the object;
A guidance information acquisition unit for acquiring guidance information for guiding operations on the object;
A guide image generating unit that generates a first guide image based on the guide information acquired by the guide information acquiring unit;
A projection unit that projects the first guidance image generated by the guidance image generation unit onto the object;
A projector comprising: The projector according to claim 1,
The analysis unit analyzes the imaging result of the imaging unit, recognizes the object and the indicator,
The projector is characterized in that the guidance information acquisition unit acquires the guidance information based on an operation of the indicator recognized by the analysis unit. The projector according to claim 1 or 2,
The projector according to claim 1, wherein the first guide image includes an image representing a position where an operation is performed on the object. The projector according to any one of claims 1 to 3,
The imaging unit is configured to include a plurality of imaging elements,
The analysis unit recognizes the object and the operation body three-dimensionally. The projector according to claim 4,
The projector further comprising a correction unit that corrects the first guide image according to the shape of the object captured by the imaging unit and recognized by the analysis unit. A projector according to any one of claims 1 to 5,
The guide image generation unit further generates a second guide image based on the guide information,
The projector projects the second guide image at a position different from the object. The projector according to claim 6, wherein
The projector according to claim 2, wherein the second guide image includes an image representing a sample of an operation on the object. A projector according to any one of claims 1 to 7,
The guidance information acquired by the guidance information acquisition unit includes guidance voice information that is voice information for guidance, and further includes a voice output unit that outputs the guidance voice information. An image projection system comprising: an imaging device that captures an object; an analysis device that analyzes image information; and an image projection device that projects an image.
The imaging device
An imaging unit that images the object and generates captured image information;
A first output unit that outputs the captured image information to the analysis device;
Have
The analysis device includes:
A first input unit for inputting the captured image information output from the imaging device;
An analysis unit that analyzes the captured image information and recognizes the object;
A guidance information acquisition unit for acquiring guidance information for guiding operations on the object;
A guide image generating unit that generates a first guide image based on the guide information acquired by the guide information acquiring unit;
A second output unit that outputs information of the first guide image generated by the guide image generation unit to the image projection device;
Have
The image projector is
A second input unit for inputting information of the first guide image output from the analysis device;
A projection unit that projects the first guide image onto the object;
An image projection system comprising: A method for controlling a projector having an imaging unit,
An imaging step of imaging an area including the object by the imaging unit;
Analyzing the imaging result of the imaging step and recognizing the object; and
Guidance information acquisition step for acquiring guidance information for guiding operations on the object;
A guide image generating step for generating a first guide image based on the guide information acquired by the guide information acquiring step;
A projecting step of projecting the first guide image generated by the guide image generating step onto the object;
A projector control method comprising:

Images