JP2009237950A - Presentation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a presentation system simplifying three-dimensional coordinate arithmetic processing and having an operation method along a habit of a presenter. <P>SOLUTION: This presentation system 1 has: a display surface 2 expanding in an X-axis direction and a Y-axis direction; a display control means 22 displaying an already created image; a pointer 3; cameras 4, 5 photographing a three-dimensional coordinate space; a coordinate value arithmetic means 23 calculating three-dimensional coordinate values of the pointer from a photographic image simultaneously photographed by the cameras 4, 5; and a drawing means 24. The three-dimensional coordinate values x1, y1, z1 of the pointer at time t1 and those x2, y2, z2 of the pointer at time t2 are calculated, image correction is performed according to the value of z1, a starting point of drawing is fixed according to the values of x1, y1, and a finishing point of the drawing is fixed according to the values of x2, y2. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a presentation system in which an image is displayed on a display body such as a screen or a display and a presenter performs a presentation, and a pointer can be moved to add a line or the like to the image.

  A conventional hand pointing device displays an image showing a three-dimensional space on a display, images a person to be recognized from a plurality of different directions, and determines the coordinates of a specific point indicated by the person to be recognized (for example, , See Patent Document 1).

The hand point device obtains the three-dimensional coordinates of the feature point whose position changes when the recognition target person flexes and extends the arm and the reference point whose position does not change even when the recognition target person flexes and extends the arm, The specific 3D coordinates in the 3D space intended by the person to be recognized are determined.
Japanese Patent Application Laid-Open No. 11-134089

  The above-described conventional hand point device constantly obtains the positions of feature points and reference points during operation of the device, and the arithmetic processing of the device becomes congested. In addition, it is necessary to take measures such as changing the reference point depending on whether the person to be recognized faces the front or the back.

  Further, in the presentation, the presenter simultaneously performs various actions such as explanation, selection of a display image, instruction of a specific position of the image, tracking of the reaction of the audience, and in addition, there is a mental tension. It is preferable that the apparatus used in such a situation performs an operation in accordance with the presenter's universal behavior as much as possible.

  An object of the present invention is to obtain a presentation system that simplifies three-dimensional coordinate calculation processing. Moreover, this invention makes it a subject to obtain the presentation system provided with the operation method according to the presenter's custom.

  Other problems of the present invention will become apparent from the description of the present invention.

A presentation system according to one aspect of the present invention includes:
Display surface extending in the X-axis and Y-axis directions An already-created image storage unit that stores an already-created image to be displayed on the display surface,
Pre-created image selection means for selecting a pre-created image stored in the pre-created image storage unit;
Display control means for displaying the already created image selected by the already created image selecting means on the display surface;
Two cameras for photographing a three-dimensional coordinate space including the display surface;
An indicator that may move in the three-dimensional coordinate space;
A photographed image storage unit for storing photographed images taken by the two cameras at the same time;
Coordinate value calculation means for calculating a three-dimensional coordinate value of the indicator with a single fixed point in the three-dimensional coordinate space as a reference point from the simultaneous captured image stored in the captured image storage unit,
An indicator coordinate value storage unit for storing the three-dimensional coordinate value;
With reference to a three-dimensional coordinate value of the indicator stored in the indicator coordinate value storage unit, and a drawing means for generating a drawing image according to the three-dimensional coordinate value of the indicator;
The display control means displays the drawing image simultaneously with the already-created image selected and displayed on the display surface,
The coordinate value calculation means calculates x1, y1, z1 which are the three-dimensional coordinate values of the indicator at time t1, stores the coordinate values in the indicator coordinate value storage unit, and calculates the coordinate values. The means calculates x2, y2, z2 which are three-dimensional coordinate values of the indicator at time t2 after a predetermined time has elapsed from time t1, and stores the coordinate values in the indicator coordinate value storage unit.
The drawn image generated by the drawing means is corrected according to the value of z1 that is the Z-axis coordinate value at time t1, and corresponds to the values of x1 and y1 that are the X-axis and Y-axis coordinate values at time t1. Thus, the drawing start point is determined, and the drawing end point is determined in accordance with the values of x2 and y2 which are the X-axis and Y-axis coordinate values at time t2.

  In the present invention, the three-dimensional coordinate value of the indicator is calculated and calculated using a fixed value as a reference point. The drawing image generated by the drawing means is determined in accordance with the value of z1, which is the Z-axis coordinate value at time t1, that is, the depth direction position of the indicator.

  In a preferred embodiment of the present invention, the rendered image in the presentation system is a line, and when the value of z1 is relatively close to the display surface, image correction is performed to make a relatively thick line, When the value of z1 is relatively far from the display surface, image correction with a relatively thin line may be performed.

  According to this preferred embodiment, a relatively thick line is drawn when the indicator is close to the display surface, and a thin line is drawn when the indicator is far from the display surface. Generally, a presenter has a habit of bringing an indicator close to a display surface when indicating a portion to be emphasized. For this reason, a thick underline or a thick overmark is drawn in a portion to be emphasized. Therefore, this preferred embodiment is a presentation system that further conforms to the inventor's habits.

  However, in the present invention, the image correction is not limited to this preferred embodiment, and may be corrected to a relatively thin line when the indicator is close to the display surface, for example.

In another preferred embodiment of the present invention, the presentation system comprises:
Furthermore, it has a depth value storage unit and a depth determination means for storing a predetermined depth value,
The depth determination means compares the value of z1 with the depth value, and when the value of z1 satisfies the depth value,
The drawing unit may generate the drawing image.

  According to this preferred embodiment, the drawing is performed when the indicator is located within a certain range of depth. For example, when the presenter approaches the display surface and moves the indicator, drawing is performed. On the other hand, when the presenter leaves the display surface and moves the indicator near the podium, for example, drawing is not performed. The operation of the indicator near the podium is defined as an operation for inputting a command, and the presentation system can be configured in this way.

  In general, a presenter has a habit of moving in a certain depth direction, for example, by approaching a display surface and tracing the display surface with an indicator when explaining an already created image such as a slide. Therefore, this preferred embodiment is a presentation system that further conforms to the inventor's habits.

In another preferred embodiment of the present invention, the presentation system comprises:
Furthermore, it has a movement distance value storage unit for storing a predetermined movement distance value and a first operation determination means,
The first operation determination means calculates a distance between the position of the indicator at time t1 and the position of the indicator at time t2 and compares the distance with the movement distance value, and the calculated distance satisfies the movement distance value. In this case, the first predetermined operation may be performed.

  According to this preferred embodiment, when the indicator moves at a specific speed, it is determined as a predetermined operation input (for example, command input), and a predetermined operation such as changing a display image can be performed. it can. Generally, the presenter has a habit of moving the indicator quickly when requesting slide feed or the like, and slowly moving the indicator when explaining the slide. Therefore, in the present preferred embodiment, the presentation system is more in line with the inventor's habits by incorporating an input of a predetermined operation by changing the moving speed of the indicator.

  Examples of the predetermined operation include page turning and page returning of an already created image, so-called animation start / stop in which a display image changes, and sound generation stop.

  The present invention described above, preferred embodiments of the present invention, and components included in these can be implemented in combination as much as possible.

  According to the present invention, the three-dimensional coordinate value of the indicator is calculated and calculated using one fixed point as a reference point. The fixed point is constant while the present presentation system continues steady operation. Therefore, the three-dimensional coordinate value calculation process is performed only for the indicator. For this reason, calculation efficiency improves. As a result, it becomes a presentation system that realizes an improvement in processing speed and prevention of malfunction.

  In addition, since the image correction is performed according to the value of z1 which is the Z-axis coordinate value at time t1, that is, the depth direction position of the indicator, the presenter is able to draw more prominently on the portion that the presenter wants to emphasize. It will be a presentation system that can be operated according to the habits of. As a result, ease of use and operability are improved.

  Hereinafter, the presentation system 1 according to the embodiment of the present invention will be further described with reference to the drawings. The dimensions, materials, shapes, relative positions, etc. of the members and parts described in the embodiments of the present invention are not intended to limit the scope of the present invention only to those unless otherwise specified. It is just an illustrative example.

  FIG. 1 is a configuration diagram of the presentation system 1. The presentation system 1 includes a display surface 2, which is a screen, an indicator 3, a first camera 4, a second camera 5, and a system controller 8.

  The image display in this embodiment is performed by the projector 6 and the screen. However, in the present invention, the display surface 2 is not limited to the screen, and may be a display surface such as a liquid crystal display, for example.

  The display surface 2 is a plane that extends in the X-axis direction and the Y-axis direction. In the present invention, the plane includes a plane defined by geometry and a curved surface according to the characteristics of the projector and the display. In the present invention, the X axis and the Y axis represent a relative relationship with the Z axis that expresses the distance from the display surface.

  The first camera 4 and the second camera 5 are cameras that capture a three-dimensional space including the display surface 2, and may be a moving image camera or a still image camera. However, in order to perform smooth drawing or the like, it is preferable to obtain an image at a speed of, for example, about 60 frames / second or more. Therefore, the first camera 4 and the second camera 5 are preferably moving image cameras. For example, a CCD camera can be used as the first camera 4 and the second camera 5.

  The first camera 4 and the second camera 5 preferably have the entire surface of the display surface 2 as the field of view, and preferably include the contour region of the display surface 2 as shown in the field of view 7 in FIG.

  The number of cameras is not limited to two and may be three or more.

  The indicator 3 is, for example, a red or green object. The shape of the object is, for example, a spherical body or a cube. In order to facilitate the operation of the presentation system 1 by moving the indicator 3, the indicator 3 is preferably attached to the tip of the bar. Also, the presenter may wear, for example, a red or green glove on one hand and use the glove as the indicator 3.

  The indicator 3 is a means for operating the presentation system 1. The indicator 3 moves within the field of view of the first camera 4 and the second camera 5 or stops. Also. Move out of the field of view or move still. An indicator in the field of view is detected and the presentation system 1 is operated.

  The system controller 8 is, for example, a computer. The system controller 8 includes an already created image storage unit 11, a target color LUT 12 that is a target color lookup table, a three-dimensional coordinate storage unit 13, a lens correction coefficient storage unit 14, an image-space conversion coefficient storage unit 15, and a movement distance value storage. 16, a drawing image type storage unit 17, a drawing correction storage unit 18, a depth value storage unit 19, a captured image storage unit 31, a lens corrected image storage unit 32, and a pointer coordinate value storage unit 33. Image selection means 21, display control means 22, coordinate value calculation means 23, drawing means 24, first operation determination means 25, command control means 26, target color determination means 27, depth determination means 30 and further main control unit 28 and a peripheral device control unit 29.

  Each of the above means can be realized by a program incorporated in a computer, a CPU, a RAM, a ROM, and the like. Each said memory | storage part is realizable by allocating the fixed part in the hard memory of a computer, for example. Furthermore, the already created image selection means 21 can use a commercially available presentation system program, for example.

  The main control unit 28 performs overall operation control of the system controller 8. The peripheral device control unit 29 performs operations of the first camera 4 and the second camera 5, image processing, control of the projector 6, and the like. Further, the system controller 8 includes a system display device 41 and an input device 42. The system display device 41 is a liquid crystal display attached to the computer, and the input device 42 is a keyboard and a pointer, for example, a mouse.

(Initial setting)
The initial setting operation of the presentation system 1 will be described.

  An already created image to be displayed on the display surface 2 is created and stored in the already created image storage unit 11. The already created image is a character, a figure, a photograph, an illustration, a mixture of these, or the like. The already created image may be a blank image. A specific example of the created image is a slide document for presentation.

  The drawing image type is stored in the drawing image type storage unit 17. The drawing image types are, for example, a solid line, a broken line, an alternate long and short dash line, a circle mark, a triangle mark, a square mark, and an arrow. A single drawing image type may be stored.

  The drawing correction storage unit 18 stores the correction items of the drawing image. The correction items include, for example, line thickness, color shading, and hue. Then, a relational expression with the value of z1 is described. For example, when correcting the line thickness, when 0 ≦ z1 <50, the line thickness is 100 pixels, when 50 ≦ z1 <100, the line thickness is 70 pixels, and when 100 ≦ z1 <150 The line thickness is described as 40 pixels. For example, if the hue is to be corrected, it is described as red when 0 ≦ z1 <100, orange when 100 ≦ z1 <200, and yellow when 200 ≦ z1 <300.

(Environmental setting)
Next, environment setting is performed. The environment setting is a setting in which the presentation system 1 is installed in an actual use place and necessary data is input to the presentation system 1 according to the lighting state, the indicator movement range, and the like.

  The presentation system 1 is installed at the presentation place, and the display surface 2 and the projector 6 are arranged. The 1st camera 4 and the 2nd camera 5 are arrange | positioned, and the camera visual field 7 is adjusted. The camera field of view is fixed during environment setting and during subsequent steady operation.

  Next, the presentation system 1 is taught the recognition target color. FIG. 3 is a flowchart of the recognition target color teaching process, and FIG. 2 is an explanatory diagram of the contents of the target color LUT 12.

  In S11, the indicator 3 is positioned in the camera visual field 7, and an image including the indicator 3 is taken by the first camera 4 and the second camera 5. In S 12, the captured image of the first camera 4 and the captured image of the second camera 5 are stored in the captured image storage unit 31.

  In S13, the captured image of the first camera 4 is called from the captured image storage unit 31 and displayed on the system display device 41. In S14, the indicator 3 area on the system display device is designated by the input device 42. By this operation, the first recognition target color C1 is taught. In S15, the first recognition target color C1 is stored in the target color LUT12.

  In S16, a non-indicator region is designated for the same image displayed on the system display device 41. By this operation, the first non-recognition target color NC1-1 is taught. In S17, the first unrecognized target color NC1-1 is stored in the target color LUT12. Repeat S16 and S17 to teach other unrecognized colors.

  Here, when there is no non-recognition target color to be taught in the same image displayed on the system display device 41 in S16, the following photographing operation is repeated. That is, an image including the specific non-recognition target color is displayed on the display surface 2, or an object of the specific non-recognition target color is positioned in the camera visual field 7 and photographed with the first camera, and S12, S13 , S16, S17.

  As described above, the first recognition target color C1 and the first non-recognition target colors NC1-1 and NC1-2 --- NC1-n are taught and stored in the target color LUT 12 for the first camera photographed image.

  Next, the process proceeds to S19, and the operations of S13 to S18 are repeated for the second camera image. The second recognition target color C2 specified in S14 and the first recognition target color C1 described above are substantially the same, but are color data reflecting the color characteristics of the second camera and the first camera, respectively.

  When the above recognition target color teaching is completed, as shown in FIG. 2, the target color LUT 12 includes the recognition target color C1 and the non-recognition target colors NC1-1 and NC1-2 in the target camera LUT12. -N is stored, and the recognition target color C2 and the non-recognition target colors NC2-1 and NC2-2 for the second camera photographed image are stored.

  In a presentation system including three or more cameras, a recognition target color and a non-recognition target color are taught for a third camera photographed image and the like.

  Next, with reference to FIG. 4, the environment setting for image-space conversion will be described.

  In S21, the image on which the reference point for correction is drawn is displayed on the display surface 2. A similar printed material may be attached to the display surface instead of the image display. The image on which the correction reference point is drawn is, for example, a grid image or a checkered pattern image. Then, the display is photographed by the first camera 4 and the second camera 5.

  In S 22, the captured image of the first camera 4 and the captured image of the second camera 5 are stored in the captured image storage unit 31. In S23, the captured image of the first camera 4 is called from the captured image storage unit 31 and displayed on the system display device 41. An image coordinate value of a reference point for correction on the display image is detected.

  In S24, the reference point for correction in the three-dimensional coordinates (world coordinates) is associated with the image coordinate value detected in S23. In S25, the three-dimensional coordinate value and the image coordinate value are stored in a temporary memory.

  The operations of S23 to S25 are repeated for other correction reference points.

  In S26, the three-dimensional coordinate value group and the image coordinate value group corresponding to each one-to-one are called from the temporary memory. calculate. The lens correction coefficient is a coefficient value, and the image-space conversion coefficient is a matrix value.

  In S <b> 27, the lens correction coefficient of the first camera image is stored in the lens correction coefficient storage unit 14. In S 28, the image-space conversion coefficient of the first camera image is stored in the image-space conversion coefficient storage unit 15.

  In S29, the same operation as in S23 to S28 is performed on the image captured by the second camera. With this operation, the lens correction coefficient of the second camera photographed image is stored in the lens correction coefficient storage unit 14, and the image-space conversion coefficient of the second camera photographed image is stored in the image-space conversion coefficient storage unit 15.

(Steady operation-1)
Next, the steady operation process will be described with reference to the steady operation flowchart shown in FIG. 5 and the three-dimensional coordinate determination process flowchart of the indicator 3 shown in FIG.

  Steady operation is started in S40. During steady operation, the indicator 3 moves or stops according to the operation of the presenter.

  In S <b> 41, the already created image selection unit 21 selects one image from the already created image storage unit 11. In S <b> 42, the display control unit 21 displays the image on the display surface 2.

  In S430, the first camera 4 and the second camera 5 simultaneously photograph each field of view, and calculate the three-dimensional coordinate value of the indicator 3 from the position of the indicator 3 in the photographed image. Detailed processing of S430 will be separately described below.

  With this calculation, the three-dimensional coordinate values x1, y1, and z1 of the indicator 3 at time t1 and the coordinate values x2, y2, and z2 at time t2 are stored in the indicator coordinate value storage unit 33.

  In S51, the drawing unit 24 selects one drawing image type from the drawing image type storage unit 17. For example, the drawing image type may be programmed in advance so that the same drawing image type is always selected during one steady operation, and the drawing image type is determined according to the values of x1, y1, and z1. May be programmed to be selected.

  In S52, the drawing unit 24 refers to the indicator coordinate value storage unit 33 and corrects the drawing image according to the value of z1. When the drawing image type is a line, for example, when the value of z1 is relatively close to the display surface, image correction is performed so that the line is relatively thick, and the value of z1 is relative to the display surface. When the image is far from the image, the image is corrected so that the line is relatively thin.

  In S <b> 53, the drawing unit 24 refers to the values of x <b> 1 and y <b> 1 in the indicator coordinate value storage unit 33 and determines the starting point of the drawn image. In S54, the drawing unit 24 refers to the x2 and y2 values in the indicator coordinate value storage unit 33 to determine the end point of the drawn image.

  In S55, the drawing means calls the already created image that is selected in S41 and that is currently displayed on the display surface 2 from the already created image storage means 11. A process of superimposing the drawing image created and corrected in S51 to S54 on the already created image is performed. The drawing process may be such that the drawn image is displayed in the foreground and the previously created image that is overlapped is not visible, or the drawn image may be drawn with a transparency of 50%, for example. Then, the image is sent to the display control means 22.

  In S <b> 56, the display control unit 22 displays the superimposed image on the display surface 2.

  When S56 ends, the data of x2, y2, and z2 in the coordinate value storage unit 32 are defined as new x1, y1, and z1.

(Steady operation-2, three-dimensional coordinate determination processing)
The three-dimensional coordinate determination process of the indicator 3 in S430 will be described.

  In S61, the first camera 4 and the second camera 5 photograph the fixed visual field simultaneously. In S 62, the captured image of the first camera 4 and the captured image of the second camera 5 are stored in the captured image storage unit 31.

  In S63, the captured image of the first camera 4 is called from the captured image storage unit 31. In step S64, lens correction is performed on the first camera photographed image using the lens correction coefficient of the first camera photographed image stored in the lens correction coefficient storage unit. In step S65, the first camera lens corrected image is stored in the lens corrected image storage unit 32.

  In S66, the same process as in S61 to S65 is performed on the image captured by the second camera. The lens correction coefficient used for this processing is the lens correction coefficient of the second camera photographed image. Accordingly, the second camera lens corrected image is also stored in the lens corrected image storage unit 32.

  In S67, the first point in the three-dimensional coordinate space stored in the three-dimensional coordinate storage unit 13 is extracted. The coordinate value of the extracted point is called “extracted three-dimensional coordinate value”. The three-dimensional coordinate space is a space that includes the display surface 2 (expanding in the X-axis and Y-axis directions) and extends forward (in the direction in which the presenter and audience are located (Z-axis)) and backward from the display surface. At the same time, the three-dimensional coordinate space is a space photographed with the camera visual field 7. The three-dimensional coordinate storage unit 13 stores coordinate points on a space obtained by dividing the three-dimensional coordinate space into a minute cube or a minute rectangular parallelepiped. Although the Z-axis positive / negative of the three-dimensional coordinate value is defined in the right-handed coordinate system, the positive / negative of the Z-axis may be corrected as necessary.

  In S <b> 68, the coordinate value calculation unit 23 uses the image-space conversion coefficient of the first camera photographed image stored in the image-space conversion coefficient storage unit 15 to extract the extracted three-dimensional coordinate value of the first camera photographed image. Convert to coordinate values. The converted image coordinate value is referred to as “extracted image coordinate value”.

  In S69, the target color determination unit calls the first camera lens corrected image, recognizes the target color C1 for the first camera photographed image in the target color LUT12, the non-recognition target color NC1-1, NC1-2 --- NC1. With reference to -n, it is determined whether or not the pixel of the extracted image coordinate value corresponds to the recognition target color. If it falls under the recognition target color, the process proceeds to S70. If the color does not correspond to the recognition target color, the process returns to S67, the second point in the three-dimensional coordinate space stored in the three-dimensional coordinate storage unit 13 is extracted, and the same processes of S68 and S69 are performed.

  In S70, the same processing as S68 and S69 is performed on the second camera lens corrected image. At this time, the image-space conversion coefficient used for conversion of the extracted image coordinate value is an image-space conversion coefficient of the second camera photographed image. Further, the color data in the target color LUT 12 referred to by the target color determination means are the recognition target color C2 for the second camera photographed image, the non-recognition target color NC2-1, NC2-2 --- NC2-n.

  In S <b> 71, the target color determination unit 27 determines whether or not a recognition target color is detected in the first camera captured image and the second camera captured image. That is, when the pixel of the extracted image coordinate point in the second camera photographed image is determined as the recognition target color, the extracted three-dimensional coordinate value is regarded as the detected coordinate point of the indicator 3 and the detection instruction is given to the coordinate value storage unit 32. The extracted three-dimensional coordinate value is stored as a body coordinate point. When the recognition target color is not detected in the second camera photographed image, the process returns to S67, the second point in the three-dimensional coordinate space stored in the three-dimensional coordinate storage unit 13 is extracted, and the same processing as in S68 and S69 is performed. I do.

  In S72, the process from S67 to S71 is repeated, and the target color detection process is performed at all points in the three-dimensional coordinate space.

  In S73, if the target color is detected in the above process, the process proceeds to S74. If no target color is detected in the above processing, the process proceeds to S76.

  In S74, the detected indicator coordinate value group stored in the indicator coordinate value storage unit 33 is determined as one point by the coordinate value calculation means. For example, the center of the detection indicator coordinate value group may be obtained, or the point closest to the display surface may be selected from the detection indicator coordinate value group. Good.

  In S75, the determined detection indicator coordinate point is stored as x1, y1, and z1 at time t1.

  In S76, the process returns to S61, and pointer coordinate detection is performed on the captured image in the next frame (time t2). Thereby, the coordinate point x2, y2, z2 of the indicator at time t2 is stored in the indicator coordinate value storage unit 33.

  If the presentation system has three or more cameras, the processing similar to S68 and S69 for the second camera lens corrected image in S70 is followed by the same processing as S68 and S69 for the third camera lens corrected image. Etc.

  In a presentation system using a huge display surface 2, the environment setting for image-space conversion is performed by the above-described operation, and the three-dimensional coordinates to be extracted are calculated in the indicator three-dimensional coordinate value during steady operation. The value range may be limited to the range in which the indicator moves. In this way, it is possible to obtain an effect such as an increase in calculation speed.

(Second embodiment)
A presentation system 1 (second embodiment) to which the depth position determination of the indicator as a preferred embodiment is added will be described. The added depth position determination is a process for determining whether or not to perform drawing processing based on the depth position of the indicator in the three-dimensional space.

  FIG. 7 is a flowchart for explaining the second embodiment. In the second embodiment, in the steady operation described above, the processes from S81 to S84 are inserted between S430 (determining the three-dimensional coordinates of the indicator) and S51 (drawing start).

  In the depth value storage unit 19, the Z-axis threshold value of the indicator is stored in advance. Alternatively, both end values of the Z axis are stored. In the case of the threshold value, it is described that the process proceeds to the drawing process when z1 is larger (or smaller) than the threshold value. In the case of both-end values, it is described that the process proceeds to the drawing process when z1 is between the end-values (or when it is outside). The values and conditions stored in the depth value storage unit 19 are collectively referred to as “threshold conditions”.

  After the detection of the indicator coordinate value in S430, the depth determination means 30 compares the value stored in the depth value storage unit 19 in S81 with the value z1 stored in the indicator coordinate value storage unit 33.

  If z1 satisfies the threshold condition in S82, the process proceeds to S83. If the z1 value is outside the threshold condition, the process proceeds to S84. In S83, the process proceeds to S51 and a drawing process is performed.

  In S84, for example, command recognition processing is started. Command recognition is recognized as a specific command by a combination of indicator coordinate values (x1, y1, z1) (x2, y2, z2)-(xn, yn, zn) at a plurality of times t1, t2, --tn. It is processing to do.

  When the command recognition process is entered and the command is not recognized, the process returns to S430.

  The above command processing is an example of predetermined processing. If the threshold condition is not satisfied, the process may simply return to S430 without performing a predetermined process.

(Third embodiment)
The presentation system 1 (third embodiment) to which the determination of the moving speed of the indicator as another preferred embodiment is added will be described. The added moving speed determination is a process of determining whether to perform a drawing process or a predetermined operation based on the moving speed of the indicator in the three-dimensional space.

  FIG. 8 is a flowchart for explaining the third embodiment. In the third embodiment, in the steady operation described above, the processes from S91 to S96 are inserted between S430 (determining the three-dimensional coordinates of the indicator) and S51 (drawing start).

  A movement distance value of the indicator is stored in advance in the movement distance value storage unit 16. In this embodiment, the movement distance value is a single value (threshold value).

  After the detection of the indicator coordinate value in S430, the first operation determination means 25 in S91 determines the distance between the position of the indicator at time t1 stored in the indicator coordinate value storage unit 33 and the position of the indicator at time t2 ( Calculate travel distance). In S92, the first operation determination unit 25 compares the calculated movement distance with the movement distance value stored in the movement distance value storage unit 16.

  When the calculated movement distance is larger than the movement distance value (threshold value), the process moves to S93. If the calculated movement distance is smaller than the movement distance value (threshold value), the process moves to S96.

  In S93, the first operation determination means sends a command signal to the command control means 26. Upon receiving the command signal in S94, the command control means 26 performs a predetermined process on the already created image currently displayed or the already created image selection means.

  In S95, the display control means 22 displays the processed already created image on the display surface 2.

  In S96, the process proceeds to S51 and a drawing process is performed.

The value stored in the movement distance storage unit 16 and the determination performed by the first operation determination unit 25 are, for example,
(1) A single threshold value is stored and compared with the calculated travel distance.
(2) Memorize both end values of a single range, and compare and judge whether the calculated moving distance falls within the range,
(3) Store both end values of 2 in 2 ranges, and compare and determine which range the calculated moving distance falls into,
It may be.

  Upon receiving the command signal, the command control means 26 may perform page turning page return, animation start / stop, or sound generation stop for the already created image.

1 is a configuration diagram of a presentation system 1. FIG. It is a content explanatory drawing of object color LUT12. It is a flowchart of a recognition target color teaching process. It is a flowchart of the environment setting concerning image-space conversion. It is a flowchart of steady operation. 3 is a three-dimensional coordinate determination process flowchart of an indicator 3. It is a flowchart of the depth position determination addition part of the indicator. It is a flowchart of the moving speed judgment addition part of the indicator 3.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Presentation system 2 Display surface 3 Indicator 4 1st camera 5 2nd camera 7 Camera view 8 System controller

Claims (4)

Display surface extending in the X-axis and Y-axis directions An already-created image storage unit that stores an already-created image to be displayed on the display surface,
Pre-created image selection means for selecting a pre-created image stored in the pre-created image storage unit;
Display control means for displaying the already created image selected by the already created image selecting means on the display surface;
Two cameras for photographing a three-dimensional coordinate space including the display surface;
An indicator that may move in the three-dimensional coordinate space;
A photographed image storage unit for storing photographed images taken by the two cameras at the same time;
Coordinate value calculation means for calculating a three-dimensional coordinate value of the indicator with a single fixed point in the three-dimensional coordinate space as a reference point from the simultaneous captured image stored in the captured image storage unit,
An indicator coordinate value storage unit for storing the three-dimensional coordinate value;
With reference to a three-dimensional coordinate value of the indicator stored in the indicator coordinate value storage unit, and a drawing means for generating a drawing image according to the three-dimensional coordinate value of the indicator;
The display control means displays the drawing image simultaneously with the already-created image selected and displayed on the display surface,
The coordinate value calculation means calculates x1, y1, z1 which are the three-dimensional coordinate values of the indicator at time t1, stores the coordinate values in the indicator coordinate value storage unit, and calculates the coordinate values. The means calculates x2, y2, z2 which are three-dimensional coordinate values of the indicator at time t2 after a predetermined time has elapsed from time t1, and stores the coordinate values in the indicator coordinate value storage unit.
The drawn image generated by the drawing means is corrected according to the value of z1 that is the Z-axis coordinate value at time t1, and corresponds to the values of x1 and y1 that are the X-axis and Y-axis coordinate values at time t1. Then, the drawing start point is determined, and the drawing end point is determined in accordance with the values of x2 and y2 which are the X-axis and Y-axis coordinate values at time t2.   The drawn image is a line, and when the value of z1 is relatively close to the display surface, image correction is performed so that the line is relatively thick, and the value of z1 is relatively far from the display surface. The presentation system according to claim 1, wherein the image is corrected so as to be a relatively thin line when it is a thing. Furthermore, it has a depth value storage unit and a depth determination means for storing a predetermined depth value,
The depth determination means compares the value of z1 with the depth value, and when the value of z1 satisfies the depth value,
The presentation system according to claim 1, wherein the drawing unit generates the drawing image. Furthermore, it has a movement distance value storage unit for storing a predetermined movement distance value and a first operation determination means,
The first operation determination means calculates a distance between the position of the indicator at time t1 and the position of the indicator at time t2 and compares the distance with the movement distance value, and the calculated distance satisfies the movement distance value. If you want to
The presentation system according to claim 1, wherein a first predetermined operation is performed.

Images