JP2017162334A - Information processing device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To form an image by properly recognizing an operation corresponding to a touch on a projection image by a stylus and a finger.SOLUTION: An information processing device includes: a position specification part for detecting touches for an operation to projected image data, and specifying the position of the touch; an extraction part for extracting erroneous touches among the detected respective touches; and a generation part for specifying a trajectory of positions of the touches except the erroneous touches from the respective specified positions of the touches, and generating information corresponding to contents of the operation on the basis of the specified trajectory. When a second touch is detected during a prescribed period after the first touch is detected, the extraction part extracts the first touch as the erroneous touch.SELECTED DRAWING: Figure 8

Description

  The present invention relates to an information processing apparatus and a program.

  It is widely performed that a user draws on a projection screen of a projector using a stylus or a finger. In this case, the locus of the contact position of the stylus or finger with respect to the projection screen is specified, and an image is formed at a location corresponding to the locus on the projection screen.

  When the user uses a stylus, a part of the user's hand holding the stylus (hereinafter referred to as a hand-held part) may touch the projection screen. In order to prevent the formation of an image corresponding to the locus of the hand-held part, various proposals have been made regarding a method for distinguishing between contact by the stylus and contact by the hand-held part and forming only the image of the stylus locus. (For example, Patent Document 1).

  However, using the conventionally proposed method, when drawing with a hand in contact with the projection screen, the hand contact is recognized as a “hand-held part” when using the stylus, and the hand is used appropriately. There was a problem that it was difficult to perform drawing and the like.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to appropriately recognize an operation corresponding to contact with a stylus or a finger on a projection image and execute the operation on the projection image.

  According to one aspect, a contact for operation on the projected image data is detected, a position specifying unit that specifies the position of the contact, and an erroneous contact is extracted from each of the detected contacts. An extraction unit and a contact position locus that excludes the erroneous contact position from each of the identified contact positions are identified, and information corresponding to the content of the operation is generated based on the identified locus. And when the second contact is detected in a predetermined period after the first contact is detected, the extraction unit extracts the first contact as the erroneous contact. An information processing apparatus is provided.

  It is possible to appropriately recognize an operation corresponding to contact with a stylus or a finger on the projection image and execute the operation on the projection image.

It is a figure showing an example of a system configuration figure concerning a 1st embodiment. It is a figure which shows an example of the operation | movement sequence which concerns on 1st Embodiment. It is a figure which shows an example of a mode that a stylus etc. contact the screen which concerns on 1st Embodiment. It is a figure which shows an example of imaging | photography data when the stylus which concerns on 1st Embodiment contacts. It is a figure which shows an example of the hardware constitutions of the image projector which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the light curtain module which concerns on 1st Embodiment. It is a figure which shows an example of a function structure of the image projection system which concerns on 1st Embodiment. It is FIG. (1) which shows an example of the operation | movement flow which concerns on 1st Embodiment. It is FIG. (2) which shows an example of the operation | movement flow which concerns on 2nd Embodiment. It is a figure which shows an example of the operation | movement sequence which concerns on 2nd Embodiment. It is a figure which shows an example of a function structure of the image projection system which concerns on 2nd Embodiment. It is a figure which shows an example of the operation | movement flow which concerns on 2nd Embodiment.

[First Embodiment]
<System configuration>
An image projection system 1 according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of an image projection system 1 according to the first embodiment. The image projection system 1 includes an image projection device 10, a camera 20, a light curtain module 30, and a screen 40.

  The image projection device 10 receives input of image data (first image data) and projects the first image data onto the screen 40. A projected image is formed on the screen 40.

  In response to an instruction from the image projection device 10, the light curtain module 30 emits invisible light in a direction parallel to the surface of the screen 40 (invisible light emission direction 35). When the stylus (indicator, pen) or finger touches the screen 40, the invisible light is reflected by the stylus and the like, and the reflected light is generated. The light curtain module 30 and the image projection apparatus 10 may be connected by a cable or the like, or may be connected wirelessly such as Bluetooth (registered trademark) or a wireless LAN.

  The camera 20 is connected to the image projection apparatus 10 via a USB cable or the like. The camera 20 shoots the screen 40 and generates shooting data. The camera 20 transmits the generated shooting data to the image projection device 10.

  The image projecting device 10 specifies the coordinates of the position touched by the stylus or finger from the captured data. The image projector 10 calculates the coordinates of the locus of the contact position of the stylus or finger. The image projection apparatus 10 forms image data (second image data) corresponding to the locus of the contact position of the stylus or the finger. The image projection device generates image data (third image data) in which the second image data is superimposed on the first image data, and projects the image data onto the screen 40. Third image data is projected onto the screen 40.

  The image projection device 10 distinguishes between contact with a stylus or a finger for drawing and contact with a handed part when using the stylus, forms an image corresponding to a drawing operation with the stylus or finger, and supports contact with a handed part Do not form images. A method of distinction will be described later.

  In the above-described embodiment, the image projection device 10 executes the process of superimposing the first image data and the second image data. However, the image projection device 10 is connected to an external device such as a PC, The external device may execute a process of superimposing the image data from the shooting data or the coordinate data of the trajectory, and the image projection apparatus 10 may acquire newly generated image data from the external device.

<Operation sequence>
The operation sequence of the first embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of an operation sequence according to the first embodiment.

  In step S201, the image projection apparatus 10 instructs the light curtain module 30 to emit invisible light.

  In step S202, the light curtain module 30 starts emitting invisible light.

  In step S <b> 203, the image projection apparatus 10 projects the first image data that has received the input onto the screen 40.

  In step S <b> 204, the image projection apparatus 10 instructs the camera 20 to capture the screen 40.

  In step S205, the camera 20 captures the screen 40 and stores the captured result as captured data.

  In step S <b> 206, the camera 20 transmits the shooting data to the image projection device 10.

  In step S207, when the image projection apparatus 10 receives the shooting data, the image projection apparatus 10 detects the contact of the stylus or the finger with the screen 40 and calculates the coordinates of the contact position on the screen 40. The image projection apparatus 10 calculates the coordinates of the locus of the contact position such as a stylus from the photographing data for a predetermined period.

  The image projecting device 10 distinguishes the contact for operation on the first image data projected by the stylus or the finger and the contact of the hand-held portion when using the stylus from the timing of detecting the contact. The image projecting device 10 distinguishes contact with a stylus or a finger from contact with a handed portion when the stylus is used based on the area of a contact point formed on the screen 40. Alternatively, the image projection apparatus 10 distinguishes contact with a stylus or a finger from contact with a hand portion when using the stylus from the timing of detecting contact and the area of the contact point.

  In step S208, the image projection apparatus 10 generates image data (second image data) corresponding to the locus of the contact position such as a stylus.

  In step S <b> 209, the image projection apparatus 10 projects image data on which the first image data and the second image data are superimposed on the screen 40.

  Next, the timing for detecting contact will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of timing at which the stylus 60 and the like come into contact with the screen 40.

  FIG. 3A shows how the finger 65 contacts the screen 40. The image projecting device 10 detects that the finger 65 is in contact with the captured data.

  (B1) and (B2) of FIG. 3 show how the hand-held portion 55 contacts the screen 40 when the stylus 60 is used. When the user draws using the stylus 60, the hand-held portion 55 is first brought into contact with the screen 40 as shown in (B1) of FIG. 3, and then (B2 of FIG. 3). In many cases, the user brings the stylus 60 into contact with the screen 40.

  When the second contact is detected within a predetermined period ΔT after the first contact is detected in the predetermined region, the image projection apparatus 10 sets the first contact as the contact of the hand-held portion 55. Extract. In this case, the image projection apparatus 10 generates the second image data except for the contact with the hand-held portion 55 and the extracted portion. Here, a fixed-size area is set as the predetermined area. For example, when the coordinates of the position of the first contact are within 100 pixels in the vertical direction (Y-axis direction) and the horizontal direction (X-axis direction) from the coordinates of the second contact position, the image projector 10 The position of the first contact may be determined to be included in the predetermined area. Further, the size of the predetermined area may be set based on the size of a general human hand. For example, when the coordinates of the position of the first contact are within 10 cm from the coordinates of the position of the second contact, the image projection apparatus 10 determines that the position of the first contact is included in the predetermined area. May be. The predetermined period ΔT is preferably set based on the time for a general user to bring the hand-held portion 55 into contact with the screen 40 and then the stylus 60 into contact with the screen 40. A relatively short time, for example, 500 ms is set as the predetermined period ΔT.

  Next, with reference to FIG. 4, photographing data when a stylus or the like comes into contact will be described.

  FIG. 4A shows image data when a finger or stylus is in contact with the screen 40. In this case, the hand-held portion is not in contact with the screen 40. The invisible light is reflected at a portion where the invisible light from the light curtain module 30 is blocked by contact with a finger or the like. For this reason, the area 42 other than the contact position such as the finger of the photographing data is black, and the contact position 41 such as the finger of the photographing data has high luminance.

  (B1) of FIG. 4 shows imaging data when the hand-held portion is in contact with the screen 40. Also in this case, the invisible light from the light curtain module 30 is blocked and the invisible light is reflected by the contact of the hand-held portion. For this reason, the area 44 other than the contact position of the hand-held portion of the photographing data is black, and the contact position 43 of the hand-held portion of the photographing data has high luminance.

  (B2) in FIG. 4 shows photographing data when the stylus is in contact with the screen 40 in addition to the hand-held portion after a lapse of a predetermined period from (B1) in FIG. Also in this case, similarly to B1 in FIG. 4 and the like, the area 46 other than the contact position of the shooting data, such as the stylus, is black, and the contact position 43 of the hand-held part of the shooting data and the contact position 45 of the stylus have high brightness. Have.

  As shown in FIGS. 4B1 and 4B2, the size of the contact position 43 of the hand-held portion is larger than the size of the contact position 41 of the finger and the size of the contact position 45 of the stylus. For this reason, when the size of the contact position is larger than the predetermined size, the image projecting device 10 extracts the contact with the hand-held portion. In this case, the image projection apparatus 10 generates the second image data except for the position extracted as the contact of the hand-held part.

  Even when the stylus is used, if the hand-held portion does not contact the screen 40, the same processing as that performed when the finger contacts is executed.

<Hardware configuration>
(1) Image Projecting Device FIG. 5 is a diagram illustrating an example of a hardware configuration of the image projecting device 10 according to the first embodiment. The image projection apparatus 10 includes a CPU 1001 that controls the operation of the entire image projection apparatus 10, a ROM 1002 that stores a program used to drive the CPU 1001, and a RAM 1003 that is used as a work area of the CPU 1001. Further, the image projection apparatus 10 includes a memory module 1004 that stores various data such as image data and a program for the image projection apparatus 10.

  The image projection apparatus 10 includes a plurality of network I / Fs 1005 for performing data communication using a wired or wireless network.

  The image projection apparatus 10 includes a cable I / F 1006 for connecting to the camera 20, the light curtain module 30, and external devices such as a PC. The cable I / F 1006 is realized by, for example, a USB (Universal Serial Bus) I / F port.

  The image projection apparatus 10 includes an image signal reception I / F 1007 for receiving image data from an external device such as a PC. The image signal reception I / F 1007 is provided for each format of the input image signal. For example, the image signal reception I / F 1007 performs transmission / reception of image data conforming to a D-Sub (D-subminiature), HDMI (registered trademark) (High-Definition Multimedia Interface), or VGA (Video Graphics Array) format. .

  The image projection apparatus 10 includes an image signal processing module 1008, and the image signal processing module 1008 processes the image data received by the image signal receiving unit 1007.

  The image projection apparatus 10 includes an operation reception module 1009. The operation reception module 1009 is a device for receiving an operation from the user of the image projection device 10 and is realized by, for example, an operation key.

  The image projection apparatus 10 includes an optical module 1010. The optical module 1010 is a device that generates a projected image. When the image projection apparatus 10 is a DLP (Digital Light Processing) projector, it is realized by a DMD (Digital Mirror Device) or a color wheel.

  The image projection apparatus 10 includes a lamp 1011 and a lamp control module 1012. Based on an instruction from the lamp control module 1012, the lamp 1011 emits light.

  The image projector 10 has a fan 1013. The fan 1013 is used for cooling the image projector 10.

  In the image projection apparatus 10, the above-described apparatuses are connected to each other via a bus line B. The image projection apparatus 10 may have a camera. Each function of the image projection apparatus 10 to be described later is realized by the CPU 1001 executing a program stored in the ROM 1002 or the like.

(2) Light Curtain Module FIG. 6 is a diagram illustrating an example of a hardware configuration of the light curtain module 30 according to the first embodiment. The light curtain module 30 includes a CPU 3001 that controls the operation of the entire light curtain module 30, a ROM 3002 that stores a program used to drive the CPU 3001, and a RAM 3003 that is used as a work area for the CPU 3001.

  The light curtain module 30 includes a light emission module 3004, and the light emission module 3004 emits invisible light. The light curtain module 30 has a cable I / F 3005. The cable I / F 3005 is realized by, for example, a USB (Universal Serial Bus) I / F port.

  In the light curtain module 30, the above-described devices are connected to each other via a bus line B. Each function of the light curtain module 30, which will be described later, is realized by the CPU 3001 executing the program stored in the ROM 3002.

<Functional configuration>
The functional configuration of the image projection system 1 according to the first embodiment will be described with reference to FIG.

(1) Image Projecting Device The image projecting device 10 includes a device control unit 105, a transmission / reception unit 110, a projection unit 120, an image input reception unit 130, an image editing unit 140, a position coordinate calculation unit 150, a hand extraction unit 160, and a drawing unit 170. , An information storage unit 180, and an input unit 190. The information storage unit 180 includes a projection data storage unit 181 and a hand extraction setting storage unit 182.

  The device control unit 105 instructs the camera 20 to shoot the screen 40. The device control unit 105 instructs the light curtain module 30 to emit invisible light. In addition, the device control unit 105 controls each functional block in the image projection apparatus 10.

  The transmission / reception unit 110 transmits / receives various data to / from the camera 20 and the light curtain module 30 via a network or a cable.

  The projection unit 120 acquires image data from the image editing unit 140 and projects the acquired image data onto the screen 40.

  The image input receiving unit 130 receives an image input from an external device such as a PC, a tablet terminal, and a smartphone (input reception of first image data). Interfaces such as HDMI and VGA may be used for image input. In addition, the image input receiving unit 130 may receive an input of an image from an external device via the transmission / reception unit 110.

  The image editing unit 140 performs a process of combining the first image data received by the image input receiving unit 130 and the second image data generated by the drawing unit 170. In addition, the image editing unit 140 executes an editing process on the projected image such as scaling. Note that the image editing unit 140 may acquire the first image data from the projection data storage unit 181.

  The position coordinate calculation unit 150 receives image data captured by the camera 20, detects contact with the image data projected by a stylus or the like based on the image data, and specifies coordinates of the detected position of the contact. To do.

  The hand extraction unit 160 determines whether each of the contact positions specified by the position coordinate calculation unit 150 is due to contact with a stylus for drawing or a finger, or contact with a hand portion when the stylus is used. Extract false contacts due to parts. The hand extraction unit 160 uses the information stored in the extraction setting storage unit 182 to perform extraction processing.

  The drawing unit 170 generates an image of the locus of contact with the stylus or finger specified by the position coordinate calculation unit 150 (second image data). When generating the second image data, the drawing unit 170 acquires the erroneous contact information extracted from the hand-held extraction unit 160 and does not generate an image at the contact position extracted as the erroneous contact due to the hand-held portion. Here, the contact trajectory is formed based on one or more contacts to the image data projected by the stylus or the finger.

  The information storage unit 180 stores various types of information. The projection data storage unit 181 stores first image data acquired from a PC or the like. The extraction setting storage unit 182 stores information used by the hand-held extraction unit 160 to extract contact with a hand-held portion. The extraction setting storage unit 182 stores a predetermined period ΔT from when the first contact is detected to when the second contact is detected. Also, information regarding the size of a predetermined area is stored. When the hand-held extraction unit 160 detects the first contact and the second contact within a predetermined region within the range of the predetermined period ΔT, the first contact is determined to be a contact with a hand-held portion, One contact is extracted as an erroneous contact. Further, the extraction setting storage unit 182 stores a predetermined size related to the size of the hand-held part, and the hand-extracting extraction unit 160 extracts the contact by the hand-held part when the size of the contact position exceeds the predetermined size.

  The extraction setting storage unit 182 may store a predetermined distance between the position of the first contact and the position of the second contact instead of the size of the predetermined area. In this case, the manual extraction unit 160 has a time period from when the first contact is detected to when the second contact is detected is equal to or less than a predetermined period ΔT, and the first contact position and the second contact are detected. When the distance from the contact position is equal to or less than the predetermined distance, the first contact is determined to be a touch by hand, and the first contact is extracted as an erroneous contact.

  The input unit 190 receives an instruction from the user for the image projection apparatus 10.

(2) Camera The functional configuration of the camera 20 will be described with reference to FIG. The camera 20 includes a transmission / reception unit 210 and an imaging unit 220. The transmission / reception unit 210 transmits / receives data to / from the image projection apparatus 10 via a network or a cable. In response to an instruction from the image projection apparatus 10, the imaging unit 220 captures the screen 40 and generates captured data. The imaging unit 220 transmits the generated shooting data to the image projection device 10.

(3) Light Curtain Module A functional configuration of the light curtain module 30 will be described with reference to FIG. The light curtain module 30 includes a transmission / reception unit 310 and a light emission unit 320. The transmission / reception unit 310 transmits / receives data to / from the image projection apparatus 10 via a network or a cable. Upon receiving an instruction from the image projection apparatus 10, the light emitting unit 320 emits invisible light in a direction parallel to the surface of the screen 40 (invisible light emitting direction 35 in FIG. 1).

<Operation flow>
The operation flow of the image projection apparatus 10 will be described with reference to FIGS.

(1) Operation flow (1)
FIG. 8 is a diagram illustrating an example of an operation flow of the image projection apparatus 10 according to the first embodiment.

  In step S801, when the image input receiving unit 130 receives input of first image data from a PC or the like, the projecting unit 120 projects the first image data on the screen 40. Note that the projection unit 120 may project the first image data stored in the projection data storage unit 181 in response to the input unit 190 receiving a projection instruction from the user.

  In step S <b> 802, the device control unit 105 instructs the light curtain module 30 to emit invisible light.

  In step S803, the device control unit 105 instructs the camera 20 to shoot the screen 40. The camera 20 images the screen 40 and generates image data.

  In step S <b> 804, the position coordinate calculation unit 150 acquires shooting data from the camera 20 and calculates the coordinates of a contact position such as a stylus on the screen 40.

  In steps S805 to S808, the hand extraction unit 160 determines whether each of the contact positions calculated by the position coordinate calculation unit 150 is due to contact with a drawing by a stylus or a finger, or due to contact with a hand portion. , Extract false contact by the handed part.

  In step S <b> 805, the hand extraction unit 160 determines whether or not the contact position calculated by the position coordinate calculation unit 150 is the first contact (first contact) within a prescribed area of the screen 40. When it is determined that the first contact has been made (step S805 Yes), the process proceeds to step S806. If it is not determined to be the first contact (No in step S805), the process proceeds to step S809. Here, the inside of the prescribed area of the screen 40 is an area where invisible light is emitted by the light curtain module 30, for example.

  In step S806, the hand extraction unit 160 refers to the extraction setting storage unit 182 and specifies a predetermined period ΔT. The hand extraction unit 160 acquires information on the position of the contact detected by the position coordinate calculation unit 150 within a predetermined period ΔT after the first contact is detected.

  In step S807, the hand extraction unit 160 refers to the extraction setting storage unit 182 and identifies the size of a predetermined area. Then, the manual extraction unit 160 determines whether or not a second contact (second contact) has been detected within a predetermined region within a predetermined period ΔT after the first contact is detected. When the second contact is detected (Yes in step S807), the process proceeds to step S808. When the second contact is not detected (No at Step S807), the process proceeds to Step S809.

  Here, the predetermined area may be formed within a predetermined distance starting from the first contact.

  In step S808, the hand extraction unit 160 notifies the drawing unit 170 of a contact position corresponding to the first contact. In addition to the notification, the hand-held extraction unit 160 instructs the drawing unit 170 not to draw because the contact position corresponding to the first contact corresponds to an erroneous contact due to the hand-held portion.

  In step S809, the drawing unit 170 generates image data of the locus of contact with the stylus or the finger specified by the position coordinate calculation unit 150 (second image data). When generating the second image data, the drawing unit 170 does not draw the contact position notified from the hand-held extraction unit 160 as a portion corresponding to the hand-held portion. In other words, the drawing unit 170 generates image data corresponding to the locus of the contact position excluding the contact position (erroneous contact position) due to the hand-attached portion from each of the detected contact positions.

  In step S810, the image editing unit 140 generates third image data by combining the first image data and the second image data.

  In step S811, the projection unit 120 acquires the third image data from the image editing unit 140 and projects the third image data on the screen 40.

  The second image data is generated based on a preset color and thickness. Further, when the contact with the stylus or the like is set to operate as an eraser, the image generated in the portion corresponding to the locus is erased.

  In step S806 and step S807, when the input unit 190 accepts a predetermined period ΔT and a predetermined region (predetermined distance) from the user and sets them in the image projection device 10, the hand-held extraction unit 160 The second contact is detected using a predetermined period ΔT set by the user. When the predetermined period ΔT is not set by the user, the second contact is detected using the default value of the parameter of the predetermined period ΔT set in the image projection apparatus 10.

Operation flow (2)
FIG. 9 is a diagram illustrating an example of an operation flow of the image projection apparatus 10 according to the first embodiment. In the operation flow of FIG. 9, the hand extraction unit 160 determines whether or not the size of the first contact position is a predetermined size. If the size exceeds the predetermined size, it is determined that the contact is due to a hand portion and is extracted as an erroneous contact. It is characterized by doing.

  Since steps S901 to S907 are the same as steps S801 to S807, description thereof will be omitted.

  In step S908, the hand-held extraction unit 160 refers to the extraction setting storage unit 182 and identifies a predetermined size related to the hand-held portion. Then, it is determined whether or not the size of the first contact exceeds a predetermined size.

  If it exceeds the predetermined size (step S908 Yes), the process proceeds to step S909. On the other hand, if it is equal to or smaller than the predetermined size (No in step S908), the process proceeds to step S910.

  Steps S909 to S912 are the same as steps S808 to S811, and a description thereof will be omitted.

  In step S908, when the input unit 190 accepts a predetermined size from the user and sets the image projection apparatus 10, the hand extraction unit 160 uses the predetermined size set by the user to 2 contact is detected. When the predetermined size is not set by the user, the second contact is detected using the default value of the parameter of the predetermined size set in the image projector 10.

[Second Embodiment]
Next, a second embodiment will be described. Description of parts common to the first embodiment will be omitted, and only different parts will be described.

<System configuration>
The image projection system 1 according to the second embodiment includes an image projection device 10, a camera 20, a light curtain module 30, and an external device 50. Here, the external device 50 is a PC or the like.

  In the second embodiment, the image projecting device 10 projects image data received from the external device 50 onto the screen 40, detects contact with the projected image data, and recognizes it as a predetermined operation by the user. It is said.

  The external device 50 is connected to, for example, the image projection apparatus 10 by a video input cable and an operation signal transmission / reception cable. The cable for transmitting and receiving the operation signal is realized by a USB cable, for example.

  The image projection device 10 receives input of image data from the external device 50 and projects the image data onto the screen 40. The image projection apparatus 10 detects contact with the image data projected on the screen 40 using the same method as in the first embodiment, generates operation information corresponding to the contact content, and generates the generated operation. Information is transmitted to the external device 50.

  The external device 50 performs an operation on the received operation information on the image data. Here, the operation information includes a click operation, a tap operation, a drag operation, and the like on the image data.

  The image projection apparatus 10 and the external device 50 may be connected by a wireless LAN or the like.

<Operation sequence>
The operation sequence according to the second embodiment will be described with reference to FIG.

  In step S <b> 1001, the external device 50 inputs image data to the image projecting device 10 and instructs the image data to be projected.

  The procedure from step S1002 to step S1008 is the same as the procedure from step S201 to step S207, and a description thereof will be omitted.

  In step S1009, the image projection device 10 generates operation information corresponding to the contact content.

  In step S <b> 1010, the image projection apparatus 10 transmits operation information to the external device 50.

  In step S1011, the external device 50 performs an operation on the operation information on the image data, and updates the image data. Here, the image data is, for example, an application window displayed on the screen of the external device 50.

  In step S <b> 1012, the external device 50 transmits the updated image data to the image projection apparatus 10.

  In step S <b> 1013, the image projection apparatus 10 projects the updated image data on the screen 40.

<Functional configuration>
The functional configuration of the image projection system 1 according to the second embodiment will be described with reference to FIG.

(1) Image Projecting Device The image projecting device 10 includes a device control unit 105, a transmission / reception unit 110, a projection unit 120, an image input reception unit 130, an image editing unit 140, a position coordinate calculation unit 150, a hand extraction unit 160, and a drawing unit 170. , An information storage unit 180, an input unit 190, and an operation information conversion unit 195.

  The device control unit 105 causes the image projection apparatus 10 to operate in either the drawing mode or the operation mode.

  When the image projection apparatus 10 is operating in the drawing mode, the device control unit 105 operates the drawing unit 170 and the image editing unit 140 when contact is detected by the position coordinate calculation unit 150.

  When the image projection apparatus 10 is operating in the operation mode, the device control unit 105 operates the operation information conversion unit 195 when contact is detected by the position coordinate calculation unit 150.

  The operation information conversion unit 195 identifies an operation received by the projected image data from the user from the locus of contact by the stylus or finger identified by the position coordinate calculation unit 150. The operation information conversion unit 195 generates operation information corresponding to the specified operation. The operation information conversion unit 195 acquires the information on the position of the erroneous contact extracted from the hand-held extraction unit 160, and does not use the contact position extracted as the contact of the hand-held portion to specify the operation. Here, the locus of contact is formed based on one or more contacts to the projected image data. The generated operation information is generated in accordance with, for example, a USB HID (USB Human Interface Device) format.

  The device control unit 105, the transmission / reception unit 110, the projection unit 120, the image input reception unit 130, the image editing unit 140, the position coordinate calculation unit 150, the hand extraction unit 160, the drawing unit 170, the information storage unit 180, and the input unit 190. Has the same function as the first embodiment.

(2) External device 50
The external device 50 includes a transmission / reception unit 510, an image output unit 520, and a process execution unit 530.

  The transmission / reception unit 510 transmits / receives various data to / from the image projection apparatus 10.

  The image output unit 520 transmits the image data to the image projection device 10 via the transmission / reception unit 510.

  The process execution unit 530 performs an operation corresponding to the received operation information on the image data output via the image projection device 10.

  The light curtain module 30 and the camera 20 have the same functional configuration as in the first embodiment.

<Operation flow>
The operation flow according to the second embodiment will be described with reference to FIG.

  In step S <b> 1201, when the image input receiving unit 130 receives input of image data (first image data) from the external device 50, the projecting unit 120 projects the first image data on the screen 40.

  The procedure from step S1202 to step S1208 is the same as that from step S802 to step S808, and the description thereof will be omitted.

  In step S1209, the device control unit 105 determines whether or not the image projection apparatus 10 is operating in the operation mode. When operating in the operation mode (step S1209 Yes), the process proceeds to step S1210. When not operating in the operation mode, that is, when operating in the drawing mode (No in step S1209), the process proceeds to step S1212.

  In step S <b> 1210, the operation information conversion unit 195 identifies an operation that the projected image data has received from the user from the locus of contact with the stylus or finger. At this time, the operation information conversion unit 195 acquires information for specifying the extracted erroneous contact position from the hand-extracted extraction unit 160, and specifies the operation for the contact position extracted as the contact of the hand-attached part. Not used for The operation information conversion unit 195 generates operation information corresponding to the specified operation and transmits it to the external device 50.

  In step S1211, the image input receiving unit 130 receives image data (fourth image data) on which processing corresponding to the operation information has been executed.

  Since the procedure of step S1212 and step S1213 is the same as that of step S809 and step S810, description is abbreviate | omitted.

  In step S1214, the projection unit 120 projects the third image data acquired from the image editing unit 140 or the fourth image data received by the image input reception unit 130.

  Note that after step S1207, the same processing as step S908, that is, whether or not the size of the first contact exceeds a predetermined size may be executed. Also in the second embodiment, as in the first embodiment, the input unit 190 receives a predetermined period ΔT, a predetermined area (predetermined distance), and a predetermined size related to the hand-held portion from the user. When the image projection device 10 is set, the hand extraction unit 160 detects the second contact using a set value such as a predetermined period ΔT set by the user. On the other hand, when the predetermined period ΔT or the like is not set by the user, the second contact is detected using the default value of the parameter set in the image projection apparatus 10.

[Others]
In the above-described embodiment, the image projecting device 10 and the camera 20 are realized by separate devices. However, a camera may be provided in the image projecting device 10 to capture the projected image data. Of course, the above-described embodiment can be realized by an information processing apparatus such as a PC or a server.

  Of course, the division of functions between the image projection apparatus 10 and the external device 50 such as a PC is not limited to the above-described embodiment. For example, functions similar to the position coordinate calculation unit 150, the hand extraction unit 160, the drawing unit 170, and the operation information conversion unit 195 may be provided in the external device 50.

  Further, the above-described embodiment can be applied to other than the image projection apparatus 10. For example, it is needless to say that the above-described embodiment can be applied to an electronic whiteboard (Interactive White Board).

  The position coordinate calculation unit 150 is an example of a position specifying unit. The hand extraction unit 160 is an example of an extraction unit. The image editing unit 140 and the operation information conversion unit 195 are an example of a generation unit. The image input receiving unit 130 is an example of a receiving unit. The transmission / reception unit 110 is an example of a transmission unit.

  A storage medium that records software program codes that implement the functions of the above-described embodiments may be supplied to the image projection apparatus 10. Needless to say, the above-described embodiment is also achieved when the image projection apparatus 10 reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes any of the embodiments. Here, the storage medium is a recording medium or a non-transitory storage medium.

  The functions of the above-described embodiments are not only realized by executing the program code read by the computer device. An operating system (OS) or the like operating on the computer device may perform part or all of the actual processing in accordance with the instruction of the program code. Furthermore, it goes without saying that the functions of the above-described embodiments may be realized by the processing.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to such embodiment, A various deformation | transformation and substitution can be added in the range which does not deviate from the summary of this invention.

DESCRIPTION OF SYMBOLS 1 Image projection system 10 Image projection apparatus 20 Camera 30 Light curtain module 35 Invisible light emission direction 40 Screen 50 External apparatus 105 Device control part 110 Transmission / reception part 120 Projection part 130 Image input reception part 140 Image editing part 150 Position coordinate calculation part 160 Extraction Unit 170 drawing unit 180 information storage unit 181 projection data storage unit 182 extraction setting storage unit 190 input unit 195 operation information conversion unit 210 transmission / reception unit 220 imaging unit 310 transmission / reception unit 320 light emission unit 510 transmission / reception unit 520 image output unit 530 processing execution unit

JP2013-114688A

Claims (7)

A position specifying unit that detects a contact for operation on the projected image data and specifies the position of the contact;
An extraction unit for extracting an erroneous contact from each of the detected contacts;
A generation unit that identifies a locus of a contact position, excluding the erroneous contact position from each of the identified contact positions, and generates information according to the content of the operation based on the identified locus;
Have
The information processing apparatus, wherein when the second contact is detected in a predetermined period after the first contact is detected, the extraction unit extracts the first contact as the erroneous contact.   The extraction unit according to claim 1, wherein when the distance between the position of the first contact and the position of the second contact is shorter than a predetermined distance, the extraction unit extracts the first contact as the erroneous contact. Information processing device.   The information processing apparatus according to claim 1, wherein when the magnitude of the first contact exceeds a predetermined size, the extraction unit extracts the first contact as the erroneous contact. An input unit that receives input of the predetermined period, the predetermined distance, and the predetermined size;
The information processing apparatus according to any one of claims 1 to 3, wherein when the input unit does not accept an input, a default value of a parameter that does not accept the input is set. A drawing data generation unit for generating drawing data corresponding to the locus;
The information processing apparatus according to claim 1, further comprising: an image composition unit configured to compose the drawing data and the image data and generate image data to be newly projected. A receiving unit for receiving image data input from an external device;
A transmission unit that transmits operation information, which is information for performing an operation on the image data, to an external device;
The information processing apparatus according to claim 1, wherein the generation unit specifies an operation on the image data based on the trajectory, and generates operation information corresponding to the specified operation. . Detecting a contact for operation on the projected image data and identifying the position of the contact;
Extracting false contacts from each of the detected contacts;
Identifying the locus of the contact position, excluding the erroneous contact position from each of the identified contact positions, and generating information according to the content of the operation based on the identified locus; and A program to be executed by an information processing apparatus,
A program in which, when a second contact is detected in a predetermined period after the first contact is detected, the first contact is extracted as the erroneous contact.

Images