JP5040061B2 - Video display device and information providing system - Google Patents

Description

  The present invention relates to a video display device and an information providing system.

2. Description of the Related Art Conventionally, a system has been developed that provides guidance to elderly people and visually impaired persons who have difficulty in recognizing the structure of a building such as stairs and elevator positions and road conditions.
For example, there has been proposed a technology related to a guidance system that detects a surrounding situation with a sensor device such as an infrared sensor when guiding a user and notifies a voice (see Patent Document 1).
In addition, a route guidance method has been proposed in which the surrounding situation is detected from the reflection of electromagnetic waves, the detected object is photographed, the name is identified by comparing it with a pre-stored image, and the sound is presented with sound. (See Patent Documents 2 and 4).
In addition, a walking guidance and guidance information system has been proposed that provides guidance information by placing a non-contact IC card in a place where information provision is required and reading it with a card reader (see Patent Document 3).
JP-A-8-66441 JP-A-8-252279 JP-A-11-175017 JP 2001-319288 A

  However, in the configuration in which an obstacle is captured by a sensor or an imaging device, there is a possibility that a blind spot may be generated in the measurement range depending on the configuration of the building, and there is a problem that accurate guidance cannot be performed. In particular, visually impaired people may find it difficult to determine whether they are going up or down stairs, and simply presenting warnings and route information about obstacles is not a user-friendly guide and further development is desired. It was.

Therefore, the present invention has been made in view of the above circumstances, and it is an object of the present invention to provide an image display apparatus that allows the user to walk more safely.
Moreover, this invention makes it a subject to provide the information provision system which a user can walk in comfort.

In order to solve the above-described problem, the invention according to claim 1 is an eyepiece that has light transmission and guides an image captured by an imaging unit that captures an image of the outside world in front of the user's eyes to the user's eyes. A head-mounted display type video display device having a display unit having an optical system, the receiving unit receiving wireless transmission guide information about a guidance target location, and the self-position positioning unit positioning the position of the video display device Storage means for storing the display setting of the guidance information, the guidance information received by the receiving means, the location of the video display device measured by the self-position positioning means, and the storage means Processing means for generating image processing instruction information based on the displayed display settings, and display content related to the guidance information based on the image processing instruction information and the captured image. Comprising image processing means for generating processed image, wherein the display means, and displaying the processed image generated by the image processing means.

According to a second aspect of the present invention, there is provided a display unit having an eyepiece optical system that has light permeability and guides an image picked up by an image pickup unit that picks up an image of the outside world in front of the user's eyes to the user's eyes. A head mounted display type video display device,
Guidance information acquisition means for acquiring guidance information of posted guidance target locations;
Self-positioning positioning means for positioning the position of the video display device;
Storage means for storing display settings of the guidance information;
Based on the guidance information received by the receiving means, the presence position of the video display device measured by the self-positioning means, and the display settings stored in the storage means, image processing instruction information is obtained. Processing means to generate;
Image processing means for generating a processed image including display contents related to the guidance information based on the image processing instruction information and the captured image,
The display means displays the processed image generated by the image processing means.
The invention described in claim 3 is the invention described in claim 1 or 2, characterized in that the image processing of the captured image by the image processing means emphasizes the contour of the captured image.

The guide information providing system according to claim 4 is the invention according to any one of claims 1 to 3, wherein the self-positioning means measures the presence position of the video display device and the direction with respect to geomagnetism, Based on the orientation with respect to the geomagnetism measured by the self-positioning means, the apparatus further comprises an azimuth calculating means for calculating a direction in which the user is facing, and the image processing means is calculated by the azimuth calculating means. A processed image including the guidance information and display content related to the direction of the user is generated based on the direction of the user, the image processing instruction information, and the captured image. .

The invention according to claim 5 is characterized in that, in the invention according to any one of claims 1 to 4 , the guidance information of the guidance target location is information relating to a dangerous location.

The invention described in claim 6 is characterized in that, in the invention described in any one of claims 1 to 5 , the guide information of the guide target portion is information relating to stairs.

The invention according to claim 7 is the invention according to any one of claims 1 to 6 , wherein the guidance information of the guidance target location includes the ascending / descending direction of the staircase, the extending direction of the staircase, the number of steps of the staircase, and the staircase Including the start position of the stairs, the end position of the stairs, the height per step of the stairs, the position of the landing, the number of steps from the start position of the stairs to the landing, and the number of steps between the landing stage and the end position of the stairs. To do.

The invention according to an eighth aspect is the invention according to any one of the first to seventh aspects, wherein the lens is provided with the display means, and a nose pad attached near the center in the left-right direction of the lens. And a pair of eyeglass-shaped mounting means that includes a mounting portion that is attached to both ends of the lens in the left-right direction and includes a pair of temples that contact the ear, the temporal region, or the back of the head.

The invention according to claim 9 is the invention according to any one of claims 1 to 8 , wherein the display means is a reflection type or a diffraction type hologram display.

The invention described in claim 10 is characterized in that in the invention described in any one of claims 1-9, the transmittance of light passing through the display means is 30% or more.

The invention according to claim 11 is an information providing system using the video display device according to any one of claims 1, 3 to 10 .
Further, the invention of claim 12 is an information providing system using an image display device according to any one of claims 2-10.

According to the first aspect of the present invention, since the guide information transmitted wirelessly is received and displayed so that the guide information can be seen by the user, the user can easily check the guide information. Can walk with peace of mind.
In addition, according to the first aspect of the invention, the acquired image of the outside world is converted and displayed according to the guide information. To provide a safer walking environment.

According to the second aspect of the present invention, for example, the guide information posted by, for example, two-dimensional code information is acquired and displayed so that the guide information can be viewed by the user. Guidance information can be easily confirmed, and people can walk with peace of mind.
According to the second aspect of the present invention, the acquired image of the outside world is converted and displayed in accordance with the guidance information. To provide a safer walking environment.
According to the third aspect of the present invention, the outline of the image of the outside world is emphasized and displayed according to the guidance information, so that the user can accurately recognize the shape of a dangerous part such as a staircase or an obstacle. Therefore, it is possible to walk with peace of mind even when passing through a dangerous place.

According to the fourth aspect of the present invention, the azimuth from the point where the guidance is performed to the guidance target and the azimuth facing the device are detected, and guidance information corresponding to the azimuth facing the user is provided. Therefore, it is possible to provide easy-to-understand guidance for the user and improve the sense of security during walking.

According to the fifth aspect of the present invention, since the information about the dangerous place is displayed, it is possible to notify the user of a particularly dangerous place accurately and to provide safe guidance by the user. .

According to the invention described in claim 6 , since it is configured to display information about the staircase, even a visually handicapped person who feels anxiety about the staircase can walk with peace of mind.

According to the seventh aspect of the invention, since it is configured to display detailed information about the stairs, a visually handicapped person who is particularly worried about the stairs can walk on the stairs with peace of mind.

According to the invention described in claim 8 , since it can be a glasses-type image display device, the burden when using the image display device can be suppressed to the extent that normal glasses are worn, and it is easier and safer. User guidance can be provided.

According to invention of Claim 9 , this invention can be implemented in the structure provided with the reflection type or the diffraction type hologram display.

According to the invention described in claim 10 , since the display means has a transmittance of 30% or more, it is possible to check the image of the outside world more clearly, so that it is not disturbed during walking and is safer. A walking environment can be provided.

[First Embodiment]
Embodiments of the present invention will be described below, but the present invention is not limited to these embodiments. The embodiment of the present invention shows the most preferable mode of the invention, and the terminology of the invention is not limited to this.

  First, the configuration of an information providing system 100 according to the present invention will be described with reference to FIG. The information providing system 100 includes a video display device 1 that is carried by the user and displays the route information from the guidance information displayed on the screen to the destination and the surrounding situation so that the surrounding situation can be confirmed at the same time, and the video display device 1 is guided. .. That provide information through wireless communication N, and a server S that controls information transmitted from each communication device.

The server S is composed of information devices such as a PC (Personal Computer) and WS (Work Station), and communicates by a communication method such as a telephone line, a LAN (Local Area Network) line, a WAN (Wide Area Network) line, and wireless communication. .. Are connected to the devices M1, M2,..., And control each communication device based on information such as a keyboard instruction (not shown) and a control program and control data stored in the storage device.
In this embodiment, since the server S is configured to centrally control the communication device, it is possible to easily update the guidance / dangerous spot information transmitted from each communication device.

  Communication devices M1, M2,... As transmission devices transmit guidance / dangerous spot information (guidance information) to the video display device 1 through wireless communication N by a communication circuit (not shown) based on control information from the server S. The wireless communication N mentioned here is a GSM (Global System for Mobile communication) system, a GPRS (General Packet Radio System) system, a PDC (Personal Digital Cellular) system, or a CDMA (Code Division Multiple Access) system. Connect each communication device and video display device 1 according to the standards and communication methods of various mobile phones, wireless modems, wireless communication tags such as PHS (Personal Handyphone System), Bluetooth wireless communication, wireless LAN, wireless tag, etc. Communication channel. The wireless communication N may be a communication path using infrared communication.

  The video display device 1 includes a display unit 10, a storage unit 40, an imaging unit 50, an image processing unit 60, a control unit 70, a communication unit 80, and a positioning unit 90.

  The display unit 10 as a display means is configured as shown in FIG. 4 to be described later, and displays a processed image information as a video, and guides the light from the display to the eye to display a visible image to the observer. And an eyepiece optical system for displaying. In addition, the display unit 10 transmits status information indicating the state of the device to the control unit 70 according to an instruction from the control unit 70.

  The storage unit 40 includes an EEPROM (Electrically Erasable and Programmable ROM) which is an electrically erasable and rewritable nonvolatile memory, a flash memory, and the like, and various types of the video display device 1 used during control processing by the control unit 70. Setting data, a processing program, image data, and the like are stored, and corresponding data is transmitted to the control unit 70 in response to a processing data request from the control unit 70. The various setting data of the video display device 1 is information related to the display layout on the display unit 10, and the image data is a moving image or a still image displayed on the display unit 10.

  The imaging unit 50 as an acquisition unit performs imaging using, for example, a CCD (Charge-Coupled Device) camera, and performs focus control, aperture control, viewing angle control, zoom control, gradation control according to control commands from the control unit 70. Etc., and the subject is imaged. The captured image information and status information indicating various control states are sent to the control unit 70.

  An image processing unit 60 as image processing means includes a CPU (Central Processing Unit) that controls the entire image processing, a ROM (Read Only Memory) that stores an image processing program, a RAM (Random Access Memory) that temporarily stores data, and the like. The image processing described later is performed based on the image processing instruction information and the image information from the control unit 70, and an image to be displayed on the display unit 10 as a processed image is output to the control unit 70. Further, the image processing unit 60 performs image processing so that an image obtained by imaging with the imaging unit 50 or an image stored in the storage unit 40 can be displayed as a video.

  The image processing unit 60 also performs image processing such as gradation conversion, color conversion, sharpness processing, image extraction, and the like of the image captured by the imaging unit 50 under the control of the control unit 70. For example, the outline of an object in the outside world can be easily grasped by enhancing the outline by, for example, frequency correction image processing or binarization of luminance with a predetermined threshold. In addition, in the color tone correction image processing performed using the color table stored in the storage unit 40, a specific color is emphasized and displayed in black and white so that it can be easily viewed by a user with a visual impairment such as color blindness. can do. In addition, when the user has a weak color or the like, it is possible to make it easy to see by replacing the color that has not been distinguished in the past and displaying it with a different density or color. Further, in the image processing of the luminance compression by the visually impaired person, the luminance of the entire screen is logarithmically converted and displayed with reduced contrast, and it can be made easier to see by increasing the luminance as a whole.

  The control unit 70 includes a CPU that controls the entire control, a ROM that stores a control program, a RAM that temporarily stores data, a battery, and the like. In the CPU, a predetermined area of the RAM is stored in the ROM as a work area. In accordance with various control programs, a control signal is sent to each unit to control the overall operation of the video display device 1. Moreover, you may make it supply electricity with a power cable etc. as a battery separately. The battery of the control unit 70 is a power source for the video display device 1 in general.

  Specifically, the control unit 70 is a storage unit for guidance / dangerous spot information received by the communication unit 80 described later, status information from the display unit 10, the imaging unit 50, the positioning unit 90, display layout and device settings. The image processing instruction information is created based on the processing data stored in 40, and the image information obtained by imaging by the imaging unit 50 and the image processing instruction information are sent to the image processing unit 60. The processed image information that has been subjected to image processing is received. And the control part 70 displays an image | video on the above-mentioned display by sending the processed image information sent from the image process part 60 to the display part 10. FIG.

  The communication unit 80 as a receiving unit is a communication circuit that receives guidance / dangerous part information from each communication device (communication devices M1, M2,...) By the communication method described above, and outputs the received information to the control unit 70. .

The positioning unit 90 as the self-positioning means is composed of, for example, a magnetic sensor (not shown in particular) that can detect weak magnetism using the magneto-impedance effect or the like, and is mutually on a plane perpendicular to the vertical direction. Positioning is performed by detecting the direction of geomagnetism by two magnetic sensors that detect magnetic components in the X-axis direction and the Y-axis direction orthogonal to each other. Specifically, a constant bias current is applied as a driving current to the magnetic sensor, a detection voltage signal corresponding to the magnetic field strength in each axial direction is measured, and the detection voltage signal is output to the control unit 70 as status information. Is done.
In the control unit 70, as the azimuth calculating means, the direction of the video display device 1 (the video display device 1 is attached) is calculated by calculating the direction of geomagnetism on a plane orthogonal to the vertical direction based on the received detection voltage signal. The direction in which the user who uses it is facing is detected.

  The positioning unit 90 may be configured to receive and measure a signal from a GPS (Global Positioning System) satellite (not shown) in addition to the above-described magnetic sensor.

Next, the external configuration of the video display device 1 will be described with reference to FIGS.
FIG. 1 is a diagram showing an appearance of the video display device 1. The video display device 1 of this embodiment has one display unit 10, an imaging unit 50, an image processing unit 60, a control unit 70, a communication unit 80, a positioning unit 90, and a pair of left and right prisms 20L and 20R in appearance. The nose pad 31 and a pair of left and right temples 32L and 32R are mounted in front of the user's face so that the prisms 20L and 20R are positioned in front of the left and right eyes.

As shown in FIG. 2, in the video display device 1, the image processing unit 60, the control unit 70, the communication unit 80, and the positioning unit 90 are integrated into the information providing system 100, and the imaging unit 50 and the display are displayed with the cable 102. A power source may be applied to the unit 10 to transmit and receive signals.
In this case, the eyeglass part to be worn in front of the face is separated from the information providing system 100 without providing an extra structure, and the weight burden on the user can be distributed. To reduce user fatigue.

  The nose pad 31 is attached to the prisms 20L and 20R and connects them. The temples 32L and 32R are attached to the ends of the prisms 20L and 20R, respectively. At the time of wearing, the nose pad 31 hits the nose and the temples 32L and 32R hit the ear, temporal region or occipital region, and the video display device 1 is supported by these three parts. The temples 32L and 32R can be rotated around a vertical axis (not particularly shown) provided in the vicinity of the prisms 20L and 20R, and can be folded inward when not in use.

  The display unit 10 is attached to the right prism 20R. A cross section including the display unit 10 is shown in FIG. The display unit 10 includes an LCD 11, which is a transmissive liquid crystal display, a housing 12, a prism 13, an LED 14, and a lens 15. The LCD 11 displays an image to be displayed to the user, and modulates the irradiation light by the displayed video. The housing 12 accommodates and holds the LCD 11, the LED 14, and the lens 15. The LED 14 is a light source for illuminating the LCD 11, and the lens 15 is an illumination optical system for uniformly guiding light emitted from the LED 14 to the entire surface of the LCD 11.

  The display of the image on the LCD 11 and the light emission of the LED 14 are controlled by the control unit 70 based on the light emission timing of the LED 14 and processed image information including each pixel information on the LCD 11. For example, the image information captured by the image capturing unit 50 is subjected to image processing by the image processing unit 60 and then sent to the control unit 70 as processed image information, so that power and video are supplied to the display unit 10.

  The prism 13 has a flat plate shape and is made of transparent glass or resin. The prism 13 guides the light from the LCD 11 to the user's eye E and displays a virtual image of the image displayed on the LCD 11. The upper end portion of the prism 13 has a wedge shape whose edge is thicker than the inner side, and the housing 12 is attached to the prism 13 so as to sandwich the wedge-shaped upper end portion.

  The prism 20L has a flat plate shape and is composed of a single member. The prism 20R is also flat, but is not a single member but is composed of a prism 13 and a prism 21. The prism 20L and the prism 21 are made of the same material as the prism 13, and there is no difference in refractive index between these three. The prism 13 and the prism 21 constituting the prism 20R have complementary shapes, and are joined so that there is no gap and the surface is continuous. Except for the prism 13 having a wedge-shaped upper end, the prisms 20L and 20R are symmetrical as in general glasses. A user wearing the video display device 1 in front of his / her face observes the outside through the prisms 20L and 20R.

  The lower end portion of the prism 13 is formed so that the entire surface (surface far from the eye E) approaches the rear surface (surface close to the eye E) toward the edge, and has a wedge shape. The entire surface of the wedge-shaped portion, that is, the joint surface with the prism 21 is a flat surface, and the hologram element 22 is formed on this flat surface. The hologram element 22 is positioned immediately in front of the eye E when worn. The prism 13 and the hologram element 22 constitute the eyepiece optical system 16.

  The prism 13 guides light from the LCD 11 to the inside of the end face of the upper end, and guides it to the hologram element 22 while totally reflecting the light multiple times on the front and rear faces. The hologram element 22 diffracts the guided light to make it enter the eye E while making it a light beam close to parallel light. Thereby, the user can recognize the virtual image of the image displayed on the LCD 11. The hologram element 22 hardly acts on the light from the outside world, and the virtual image is observed while overlapping the central portion of the outside world image.

  The hologram element 22 is manufactured by a two-beam interference method in which two light beams interfere with each other with RGB three-color lasers and the interference fringes are recorded on the hologram light-sensitive material so as to increase the diffraction efficiency of each color of the LED 14 that is incident light. Is done. The hologram sensitive material may be silver salt or heavy chromium gelatin, but a photopolymer that can be used in a dry process is most preferable. Further, the film thickness of the hologram light-sensitive material having a transmitted light amount of 30% or more is desirably 5 μm to 100 μm, and more preferably 15 μm to 80 μm. When the film thickness is less than 5 μm, a sufficient image virtual image cannot be obtained, and when the film thickness exceeds 100 μm, the amount of transmitted light is rapidly attenuated.

  In the video display device 1, since the light from the LCD 11 is guided to the hologram element 22 while being reflected inside the prism 13, the prism 20R can be enlarged. Although the lower end of the prism 13 is wedge-shaped, it is joined to the prism 21 made of the same material, so that light from the outside that passes through the lower end of the prism 13 is not refracted. Therefore, the video display device 1 can display a high-quality image without the central portion of the image in the outside world being distorted or discontinuous.

  The LCD 11 has a rectangular shape that is long in the left-right direction, and can display one to several lines of character strings in which dozens of characters are arranged in the horizontal direction. Therefore, the user can obtain a lot of information from the video at a time. In this embodiment, video is displayed on the right eye, but of course, video may be displayed on the left eye.

  Further, as shown in FIG. 5, a configuration in which a pair of display units 10 are provided and an image is displayed on both the left and right eyes may be employed. For example, the prisms 20L and 20R may be provided with power so that the user's visual acuity can be corrected. In this case, the configuration of the left and right display units 10 is the same as that of the display unit 10 described above except that the prism 13 has a curvature.

  And in the structure which can correct a user's visual acuity, the power of prism 20L, 20R is set according to a user's visual acuity. By giving negative power to the prisms 20L and 20R, myopia can be corrected, and by providing positive power, hyperopia can be corrected. The joining surface with the prism 21 at the lower end of the prism 13 is a flat surface, and the hologram element 22 can be easily formed.

  With the above-described configuration, the video display device 1 displays a virtual image of the video in the display area A of the lens as shown in FIGS. By wearing the video display device 1, the user can simultaneously view an image of the outside world and an image drawn on the display unit 10 in the display area A in front of the eyes.

Image information that is mounted in front of the user's eyes and imaged so that it can be displayed as an image is displayed, and the image of the image information that has been subjected to image processing is displayed in the display area A of the healthy subject's field of view by the display unit 10. By doing so, it is possible to make the user as close as possible to the normal recognition. Moreover, since the user can see the image of the outside world and the image drawn in the display area A at the same time on the display unit 10, it is possible to display guidance information by image processing, which will be described later, superimposed on the actual landscape. It is possible to provide easy-to-understand guidance to the user.
When the user is a visually handicapped person or the like, the user's eyes can be confirmed from the side to be treated while wearing the video display device 1. In addition, even if it is viewed from a person who faces in general life, it is possible to talk with the eyes of the user, and since it does not have a special shape like goggles, it feels strange in general life It is possible to use without.

  This display area A can be arranged as shown in FIGS. The display area A shown in FIG. 7 has a rectangular shape and a longer vertical direction than the horizontal direction by attaching the display unit 10 to the outer side 20R1 of the prism 20R in the vertical direction. In this way, the display area A is easy to see because the display area A is in the vertical position by setting the display ratio to be vertically long by setting the vertical direction longer than the horizontal direction.

  Further, the display area A shown in FIG. 8 is set longer in the horizontal direction than in the vertical direction by attaching the display unit 10 to the upper portion 20R2 of the prism 20R. In this case, both sides of the display area A are masked. Thus, the display area A1 can be set, and the vertical direction can be set longer than the horizontal direction. The display area A is not limited to a rectangular shape, and may be, for example, an elliptical shape. Also in this elliptical display area A, the vertical direction is set longer than the horizontal direction at the ratio of the circumscribed rectangle.

  In addition, the display unit 10 can be attached to the outer portion 20R1 of the prism 20R shown in FIG. 7 and the upper portion 20R2 of the prism 20R shown in FIG. 8, and can be freely attached according to the use situation of the user. The position can be changed. If the prism 20R has a square shape with the display unit 10 incorporated therein, the shape of the display area A can be changed to a portrait or landscape orientation by rotating the prism 20R only by 90 degrees. .

  The transmittance of the display area A is within 40% compared to the transmittance of the periphery A2 of the display area A. Since the display area A functions as a normal glass ball when the image is not displayed, it does not affect daily life such as walking. In addition, for example, a person who faces a user such as a doctor can observe the user's eye movement by allowing the display area A to pass therethrough, and a more accurate diagnosis is possible.

Next, when an image of the outside world captured by the imaging unit 50 is enlarged or color-corrected according to the degree of the obstacle and displayed on the display unit 10 for a user of the video display device 1 such as a visually impaired person, communication is performed. A guidance information display process controlled by the control unit 70 based on the guidance / dangerous spot information received by the unit 80 will be described with reference to a ladder chart shown in FIG.
Note that the processing indicated by the dotted line in the figure is periodically performed by interrupting at a frequency cycle that is an integral multiple of the operating frequency of the control unit 70.
The guidance information display process described here is a configuration in which guidance information and a video imaged by the imaging unit 50 and corrected for the user are displayed on an external video image on the display unit 10. It may be configured to display only the guidance information on the video, and is not particularly limited.

  First, the control unit 70 requests the storage unit 40 for data necessary for display processing of guidance information when receiving guidance / dangerous spot information from the communication unit 80. The data necessary for the guide information display processing stored in the storage unit 40 includes setting information including size / position information of a window for displaying the guide information, information on an image symbol for displaying a warning, and the like.

  Here, the guidance / dangerous spot information received by the communication unit 80 will be specifically described with reference to FIG. FIG. 9 is a diagram showing the inside of a building composed of a first floor portion (1F) and a second floor portion (2F). 1F has a structure including an entrance IN1 on the north side, an elevator EL that connects 1F and 2F to the south front of the point P1 that enters the entrance IN1, and a staircase that connects 1F and 2F on the east side of the point P1. 2F has a structure including a doorway IN2 on the north side, an elevator EL on the south side in front of the point P5 that has entered the doorway IN2, and a staircase that connects 1F and 2F on the east side of the point P5. The staircase is a U-shaped staircase with a landing (point P3) on the way.

  The points P1 to P5 are provided with communication devices M1 to M5 that transmit the guidance / dangerous point information at each point so that the information can be transmitted to and received from the video display device 1 in a predetermined range. The notification of the guidance / dangerous point information here may be a range that covers each point, for example, several meters, but it is configured to use a gate-like antenna or the like when passing through each point or the entrance / exit of the range including each point. There may be, and it does not specifically limit.

  Guidance / dangerous point information (guidance information) is information on the floor of each point, guidance information indicating the position of the structure from that point, connection to another floor, etc. Consists of information about a certain staircase and dangerous part information such as obstacles. For example, the communication device M1 is 1F and the position information on the entrance / exit IN1, the elevator EL, and the stairs from the point P1 is transmitted as guidance / dangerous point information, and the communication device M2 is information on the stairs from 1F to 2F. , And the communication device M3 transmits information regarding the structure of the landing at the point P3 and the stairs from the point P3 to 1F or 2F. Similarly, the communication device M5 transmits 2F and the position / connection information of the structure from P5, and the communication device M4 transmits staircase information as information on the dangerous location. Information on the stairs in particular includes the direction of the stairs, the direction of the stairs, the number of steps, the start position of the stairs, the end position of the stairs, the height of each stairs, the position of the landing, the start position of the stairs to the landing And the number of steps between the landing and the end of the stairs.

  Note that the guidance / danger information is not limited to the configuration including the guidance information indicating the configuration of the landing point P3 as in the communication device M3 and the information related to the dangerous location such as the stairs, and is guided as in the communication devices M1 and M5. It may be a case of only information or a case of only dangerous part information like the communication devices M2 and M4.

  Next, the control unit 70 generates guidance information generated by the guidance / dangerous spot information received by the communication unit 80, the positioning information by the positioning unit 90, and the display setting of the guidance information stored in the storage unit 40. Image data processing instruction information including a display instruction and an instruction to correct an external image captured by the imaging unit 50 and image information captured by the imaging unit 50 are transmitted to the image processing unit 60, and the image processing unit The processed image information processed at 60 is displayed on the display unit 10.

  Here, with respect to the guidance information display instruction generated by the control unit 70, the guidance information display example at points P <b> 1 to P <b> 4 processed by the image processing unit 60 according to the display instruction and displayed in the display area A of the display unit 10. This will be described with reference to FIGS.

FIG. 10 is a diagram illustrating a display example of guidance information at the point P1. The display area A includes an information display D1 for displaying information indicating the position and connection of the structure from the point P1, based on the guidance / dangerous point information received by the communication unit 80, an information display D2 for displaying floor information, and positioning. A traveling direction display D3 for displaying positioning information by the unit 90 and a warning display D4 are displayed.
The display on the information display D1 is performed so as to indicate the direction of the structure relative to the user based on the received position information of the structure from the point P1 and the positioning information by the positioning unit 90, as shown in the figure. It is preferred that

The warning display D4 is displayed so as to prompt a warning when new guidance / dangerous part information is received and displayed, and may be displayed for several seconds without always displaying it. .
In addition, the layout / display positions of the information displays D1 to D4 are set based on the guide information display setting, but are not limited to the layout shown in the figure. You may change the size of.

  As shown in FIG. 10, the video display device 1 displays the guidance information from the communication device on the display area A according to the direction in which the video display device 1 is facing, thereby accurately locating the structure from the point P1. Therefore, the user can walk with peace of mind. Further, since the warning is displayed, the user does not miss the guidance information when the guidance information is updated.

FIG. 11 is a diagram illustrating a display example of guidance information at the point P2. In the display area A, an information display D2 for displaying dangerous point information such as the number of steps and steps, a traveling direction display D3 for displaying positioning information by the positioning unit 90, and a warning display D4 are displayed.
Similarly, FIG. 12 is a diagram illustrating a display example of guidance information at the point P4.

  The dangerous point information illustrated here relates to the stairs, but may indicate the level crossing or pedestrian crossing and its crossing distance, the distance between the edge of the platform and the white line, and the stop position of the train. It is not limited.

  As shown in FIGS. 11 and 12, the danger area information such as the steps and the number of steps is displayed in the display area A, so that the user of the video display device 1 can feel at ease even when the user is visually impaired. I can walk.

  FIG. 13 is a diagram illustrating a display example of guidance information at the point P3. In the display area A, information display D1 for displaying the configuration of the point P3 for the user based on the guidance / dangerous spot information and the positioning information of the positioning unit 90, an information display D2 for displaying the dangerous spot information, and positioning information are displayed. A traveling direction display D3 and a warning display D4 are displayed.

  Since the guidance / dangerous spot information is displayed in the display area A as shown in FIG. 13, the structure of the landing of the staircase that is a dangerous spot such as the point P3 can also be guided. Users can walk more safely.

<Modification 1>
Here, as a first modification, an image of the outside world acquired by the imaging unit 50 in conjunction with the guidance / dangerous spot information received by the communication unit 80 and the positioning information of the positioning unit 90 according to the control instruction of the control unit 70 is used. A configuration in which image processing such as sharpening and contour extraction is performed and displayed on the display unit 10 will be described with reference to FIGS.

  As shown in the ladder chart of FIG. 6, the control unit 70 displays the direction of the dangerous location related to the staircase and the obstacle from the reception point and the image measured by the positioning unit 90 based on the guidance / dangerous location information received by the communication unit 80. When the direction in which the video display device 1 is facing is the direction of the dangerous part by comparing with the direction in which the display device 1 is facing, an image for performing contour extraction processing on the image information captured by the imaging unit 50 The data processing instruction information is transmitted to the image processing unit 60, and the image subjected to the contour extraction process is displayed on the display unit 10.

  For example, when the user H wearing the video display device 1 at the point P1 in FIG. 9 faces the staircase direction which is a dangerous place (see FIG. 14A), as shown in FIG. In the display area A, an image in which the contour of the captured image is emphasized is displayed. Note that image processing such as contour emphasis here is an image related to the risk location, such as thickening the horizontal contour if the dangerous location is a staircase, or emphasizing the signal color if it is a signal, etc. It may be a color conversion process other than the process.

  In addition to the configuration acquired by the imaging unit 50, the acquired external image is transmitted by the communication device (communication devices M <b> 1 to M <b> 50) for each structure corresponding to the direction and guidance information at each point. The configuration may be such that the image is received and acquired by the unit 80 and is not limited to the video acquired by the imaging unit 50 in particular.

  As described above, the video display device 1 is acquired by the imaging unit 50 when the direction in which the user faces is based on the guidance / dangerous spot information and the positioning information received at the current position. In this configuration, image processing such as contour extraction of the image is performed and displayed in the display area A. For this reason, the user of the video display device 1 can accurately recognize the dangerous spot and can walk with peace of mind.

  It should be noted that the present invention can be freely modified and improved without departing from the spirit of the invention. For example, in the present invention, the communication device is managed by the server S. However, the communication device may be a single device including a CPU, a storage device, a communication device, a data input device, and the like.

  Further, in the present embodiment, the wireless transmission guide information is received by the communication unit 80 as the receiving means and the information of the guidance / dangerous place is displayed. However, the information is posted as a posting means in the vicinity of the place where the guidance is performed. The configuration may be such that a two-dimensional code such as a QR code (registered trademark) including guidance / dangerous part information is photographed and received by the imaging unit 50 as an acquisition means, and is not particularly limited.

  In addition to the QR code described above, the information system posted here is a two-dimensional code such as PDF417, Data Matrix, Maxi Code, a one-dimensional barcode such as JAN code, UPC code, CDDE39, or a color barcode. It may be any type.

It is the figure which showed typically the functional structure of the video display apparatus 1 which is this invention. 1 is a diagram illustrating an appearance of a video display device 1. FIG. 1 is an external view of a video display device 1 in which an image processing unit 60, a control unit 70, a communication unit 80, and a positioning unit 90 are integrated into a device unit 101. FIG. 1 is a cross-sectional view including a display unit 10 of a video display device 1. It is a figure which shows the external appearance of the video display apparatus 1 provided with the display part 10 on either side. 3 is a ladder chart showing the operation of the video display device 1. It is a figure which shows the display area of the video display apparatus 1 which has arrange | positioned the display part 10 to the vertical direction. It is a figure which shows the display area of the video display apparatus 1 which has arrange | positioned the display part 10 to the horizontal direction. It is a figure which shows the structure of the building which has arranged communication apparatus M1-M5 to the points P1-P5. It is a figure which shows the example of a display of the guidance information displayed on the display area A in the point P1. It is a figure which shows the example of a display of the guidance information displayed on the display area A in the point P2. It is a figure which shows the example of a display of the guidance information displayed on the display area A in the point P4. It is a figure which shows the example of a display of the guidance information displayed on the display area A in the point P3. It is a figure which shows the example of a display of the image | video displayed on the display area A when a user faces the dangerous part direction in the point P1, (a) is a figure which shows the example of a display of guidance information, (b) It is a figure which shows the example of a display of the image by which the outline emphasis process was carried out.

Explanation of symbols

100 Information providing system 1 Video display device A, A1 Display area A2 Surrounding D1 Information display D2 Information display D3 Travel direction display D4 Warning display E Eye EL Elevator H User IN1, IN2 Entrance / exit N Wireless communication M1, M2, M3, M4, M5 communication devices P1, P2, P3, P4, P5 point S server T stairs 10 display unit 11 LCD
12 Housing 13, 20, 20L, 20R, 21 Prism 14 LED
DESCRIPTION OF SYMBOLS 15 Lens 16 Eyepiece optical system 20R1 Outer part 20R2 Upper part 22 Hologram element 31 Nose pad 32L, 32R Temple 40 Storage part 50 Imaging part 60 Image processing part 70 Control part 80 Communication part 90 Positioning part 101 Device unit 102 Cable

Claims (12)

Head-mounted display type image display device having display means having eye permeability optical system for guiding an image picked up by an image pickup means for picking up an image of the outside world in front of the user's eyes to light. Because
Receiving means for receiving wireless transmission guidance information relating to a guidance target location;
Self-positioning positioning means for positioning the position of the video display device;
Storage means for storing display settings of the guidance information;
Based on the guidance information received by the receiving means, the presence position of the video display device measured by the self-positioning means, and the display settings stored in the storage means, image processing instruction information is obtained. Processing means to generate;
Image processing means for generating a processed image including display contents related to the guidance information based on the image processing instruction information and the captured image,
The video display device, wherein the display means displays the processed image generated by the image processing means. Head-mounted display type image display device having display means having eye permeability optical system for guiding an image picked up by an image pickup means for picking up an image of the outside world in front of the user's eyes to light. Because
Guidance information acquisition means for acquiring guidance information of posted guidance target locations;
Self-positioning positioning means for positioning the position of the video display device;
Storage means for storing display settings of the guidance information;
Based on the guidance information received by the receiving means, the presence position of the video display device measured by the self-positioning means, and the display settings stored in the storage means, image processing instruction information is obtained. Processing means to generate;
Image processing means for generating a processed image including display contents related to the guidance information based on the image processing instruction information and the captured image,
The video display device, wherein the display means displays the processed image generated by the image processing means.   The video display apparatus according to claim 1, wherein the image processing of the captured image by the image processing unit emphasizes an outline of the captured image. The self-positioning means measures the position of the video display device and the direction with respect to geomagnetism,
Based on the orientation with respect to the geomagnetism measured by the self-positioning means, further comprising an azimuth calculating means for calculating the direction the user is facing,
The image processing means relates to the guidance information and the direction to which the user is directed based on the direction that the user faces, the image processing instruction information, and the captured image that are calculated by the orientation calculation means. The image display apparatus according to claim 1, wherein a processed image including display content is generated.   The video display device according to claim 1, wherein the guidance information on the guidance target location is information on a dangerous location.   The video display device according to claim 1, wherein the guidance information on the guidance target portion is information on a staircase.   The guidance information of the guidance target location includes the ascending / descending direction of the stairs, the extending direction of the stairs, the number of stairs, the start position of the stairs, the end position of the stairs, the height of each stairs, the position of the landing, the start position of the stairs The video display device according to claim 1, comprising any one of a number of steps from the landing to the landing and a number of steps from the landing to the end position of the stairs. A lens comprising the display means;
A nose pad attached near the center of the lens in the left-right direction and in contact with the nose;
8. A spectacle-type mounting means that includes a mounting portion that is attached near both left and right ends of the lens and includes a pair of temples that contact the ear, the temporal region, or the back of the head. The video display device according to any one of the above.   The video display device according to claim 1, wherein the display unit is a reflective or diffractive hologram display.   The image display device according to claim 1, wherein a transmittance of light passing through the display unit is 30% or more.   A transmission device that is installed in the vicinity of the guidance target location and wirelessly transmits guidance information about the guidance target location, and the video display device according to any one of claims 1 and 3 to 10. A characteristic information provision system.   It is installed in the vicinity of the said guidance object location, The posting means which posts the guidance information regarding the said guidance object location, The image display apparatus as described in any one of the said Claims 2-10 was provided. Information provision system.

Images