JP2005312605A5

JP2005312605A5 -

Info

Publication number: JP2005312605A5
Application number: JP2004132981A
Authority: JP
Filing date: 2004-04-28
Publication date: 2007-06-14
Anticipated expiration: 2024-04-28

Claims

A gazing point position display system for displaying a position of a gazing point of a subject in an image obtained by photographing a situation in the visual field of the subject,
  A field-of-view camera that images the front of the subject;
  An eyeball camera that images the subject's eyeball;
  A pupil center coordinate detection unit that calculates the coordinates of the position where the pupil center of the subject is reflected in the image captured by the eyeball camera;
  The pupil center coordinates calculated by the pupil center coordinate detection unit, and the coordinates of the position on the image captured by the visual field camera corresponding to the gaze point of the subject when the pupil center coordinate is calculated by the pupil center coordinate detection unit A coordinate conversion table describing the correspondence of
  A gazing point mark synthesizing unit that synthesizes a gazing point mark representing a gazing point into coordinates obtained by converting the pupil center coordinates calculated by the pupil center coordinate detecting unit on the image captured by the visual field camera using the coordinate conversion table. A gazing point position display system characterized by comprising:

  A gazing point position display system according to claim 1,
  A calibration coordinate detection unit that detects the coordinates of a position in the image captured by the field-of-view camera as a calibration point coordinate of a predetermined calibration tool reflected in the image captured by the field-of-view camera;
  Corresponding to the pupil center coordinate calculated by the pupil center coordinate detection unit in the coordinate conversion table, the calibration coordinate detection is performed on the image taken by the visual field camera at the same time as the image where the pupil center coordinate is calculated. And a calibration processing unit for registering the calibration point coordinates detected by the unit.

  A gazing point position display system according to claim 2,
  The calibration processing unit
  The calibration coordinate detection is performed on the image taken by the visual field camera at the same time as the image at which the pupil center coordinate is calculated at the address of the coordinate conversion table corresponding to the pupil center coordinate calculated by the pupil center coordinate detection unit. Conversion coordinate registration means for registering calibration point coordinates detected by the unit as data,
  Interpolation coordinate registration means for registering, as data, coordinates generated by interpolation processing from calibration point coordinates registered as data at other addresses of the coordinate conversion table at addresses where the data of the coordinate conversion table is not registered; A gazing point position display system characterized by comprising:

  A gazing point position display system for displaying a position of a gazing point of a subject in an image obtained by photographing a situation in the visual field of the subject,
  A left visual field camera that photographs the front of the subject from a position near the left eye of the subject,
  A right-view camera that photographs the front of the subject from a position near the subject's right eye;
  A left eyeball camera that images the subject's left eyeball;
  A right eye camera that images the subject's right eyeball;
  Based on the image captured by the left eyeball camera, a left gazing point corresponding coordinate detection unit that detects coordinates on the image captured by the left visual field camera corresponding to the gazing point of the subject as left gazing point corresponding coordinates;
  A right gazing point corresponding coordinate detection means for detecting a coordinate on the image captured by the right visual field camera as a right gazing point corresponding coordinate based on an image captured by the right eyeball camera;
  A left-eye image generating means for generating a left-eye image obtained by synthesizing a gazing point mark representing a gazing point on the left gazing point-corresponding coordinates on an image captured by the left visual field camera;
  Left eye image generation means for generating a right eye image obtained by synthesizing a gazing point mark representing the gazing point on the right gazing point corresponding coordinates on an image captured by the right field of view camera;
  A gazing point position display system comprising: a three-dimensional display image generation unit that generates a three-dimensional display image using the left-eye image and the right-eye image as a stereo image.

  A gazing point position display system for displaying a position of a gazing point of a subject in an image obtained by photographing a situation in the visual field of the subject,
  A left visual field camera that photographs the front of the subject from a position near the left eye of the subject,
  A right-view camera that photographs the front of the subject from a position near the subject's right eye;
  An eye photography camera for photographing the eyeball of the subject;
  Based on the image photographed by the eyeball camera, the coordinates on the image photographed by the left visual field camera corresponding to the subject's gaze point are detected as left gaze point correspondence coordinates, and the right side corresponding to the subject's gaze point Gazing point corresponding coordinate detecting means for detecting coordinates on the image captured by the visual field camera as the right gazing point corresponding coordinate;
  Gazing point distance calculating means for estimating a distance from the subject to the gazing point based at least on an image captured by the eyeball camera;
  A left-eye image generating means for generating a left-eye image obtained by synthesizing a gazing point mark representing a gazing point on the left gazing point-corresponding coordinates on an image captured by the left visual field camera;
  A right-eye image generating means for generating a right-eye image obtained by synthesizing a gazing point mark representing the gazing point on the coordinates corresponding to the right gazing point on the image captured by the right-view camera;
  A three-dimensional display image generation unit that generates a three-dimensional display image using the left-eye image and the right-eye image as a stereo image;
  The left eye image generation means reduces the size of the gazing point mark to be combined with the image captured by the left visual field camera as the distance estimated by the gazing point distance calculation means increases, and the right eye image generation means A gazing point position display system characterized in that the size of the gazing point mark to be combined with an image photographed by the right field of view camera is reduced as the distance estimated by the gazing point distance calculation unit increases.

  A gazing point position display system for displaying a position of a gazing point of a subject in an image obtained by photographing a situation in the visual field of the subject,
  A left visual field camera that photographs the front of the subject from a position near the left eye of the subject,
  A right-view camera that photographs the front of the subject from a position near the subject's right eye;
  An eye photography camera for photographing the eyeball of the subject;
  Gazing point position calculating means for calculating the position of the gazing point of the subject based on at least an image captured by the eyeball camera;
  A left-eye image generating means for generating a left-eye image obtained by synthesizing a gazing point mark representing a gazing point on an image taken by the left visual field camera;
  A right-eye image generating means for generating a right-eye image obtained by synthesizing a gazing point mark representing the gazing point on an image captured by the right-view camera;
  A three-dimensional display image generation unit that generates a three-dimensional display image using the left-eye image and the right-eye image as a stereo image;
  When the three-dimensional image is displayed, the left-eye image generation unit and the right-eye image generation unit calculate the gazing point mark in the three-dimensional space in which the gazing point mark is represented by the three-dimensional image. A gazing point position display system that synthesizes each gazing point mark so as to be visually recognized as being present at a position corresponding to the position of the gazing point.

In the gazing point position display system that displays the position of the gazing point of the subject in the image obtained by photographing the situation in the visual field of the subject, the subject unit is used by being attached to the subject,
A frame attached to the subject by means of a hanging part on the subject's ear and a pad part placed on the subject's nose, a field of view camera fixed to the frame and photographing the front of the subject wearing the frame; It has an arm that is fixed to the frame and extends obliquely downward and forward to the eye of the subject wearing the frame, and a pupil photographing camera that is fixed to the tip of the arm and photographs the subject's eye from diagonally downward and forward. Subject unit.

A photographing unit for photographing a stereo image for generating a three-dimensional image,
A frame that is attached to the photographer by means of a hanging part that hangs on the ear of the photographer and a pad part that is placed on the nose of the subject, and the left eye of the photographer in front of the photographer wearing the frame fixed to the frame An imaging unit comprising: a left visual field camera that captures an image from a nearby position; and a right visual field camera that captures an image of the front of the photographer wearing the frame from a position near the photographer's right eye.