JP2016005125A - Head-mount type device and head-mount type information display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a heat-mount type device and a head-mount type information display system that are easy for a user to use, and provide the user with an experience of augmented reality as well as virtual reality.SOLUTION: A video display system 1, which is an example of a head-mount type information display system to which the present invention is applied, includes a head-mount type device 2 and a tablet terminal 3. The head-mount type device 2 is a device in which a user can attach to their head with the use of a main body 4, and has a shape to cover the front part of the eyes and an upper part of the face of the user. The head-mount type device 2 has a terminal attachment part 5 into which the tablet terminal 3 can be inserted in a slot in form.

Description

  The present invention relates to a head mounted apparatus and a head mounted information display system. Specifically, the present invention relates to a head-mounted device and a head-mounted information display system that are easy for a user to use and can experience not only virtual reality but also augmented reality.

  As a display device mounted on the head, a head mounted display (hereinafter referred to as “HMD”) has become widespread. The HMD is a device that recognizes video information without being controlled by posture, movement, or space by projecting video at a close range of the user's eyeball.

  The HMD is used as a personal theater, for example, by a function as an AV device that provides a combination of sound and video. In addition, a virtual reality space (hereinafter referred to as “VR”) that artificially creates a sense of reality using computer graphics or the like, that is, a game that forms a virtual reality and enhances a sense of reality. provide.

  The HMD generally includes a display unit that is disposed in front of the user's eyes and displays an image for the user to recognize, and a support member that positions the image display unit in front of the user's eyes.

  There are two types of HMD display systems: a non-transmission type that blocks external video and enhances the immersive feeling unique to the HMD, and a transmission type that can recognize external video via a video camera or a half mirror. .

  In addition, as the shape of the HMD, there are a spectacle type in which a display unit is mounted on the upper part or the front part of spectacles, and a hat type in which a display unit is provided in a heel part of a main body mounted on the head. The hat-type HMD increases the light shielding property between the position of the user's eyes and the display unit, thereby presenting a higher immersion and presence in the video and virtual reality.

  The non-transmissive HMD described above is also referred to as an immersive HMD. However, when the immersive HMD is used, unnecessary objects do not enter the field of view, so that it is possible to penetrate deeply into the video world. In addition, it is possible to display a natural stereoscopic image with no afterimage using the binocular parallax.

  One of the major features of HMD is that 3D video can be displayed using left and right parallax. In addition, there is an HMD that can create a spread and a depth by performing parallax adjustment on a 2D image.

  Furthermore, the HMD moves in conjunction with the movement of the user's head. For this reason, if the movement of the user's head is tracked and the result is reflected in the video of the virtual space presented by the HMD, the user can be presented with a higher sense of immersion and presence in the virtual space. It is considered possible.

  On the other hand, since the HMD is used by being mounted on the head, the mounting position may be shifted when the head is moved. Under these circumstances, there is an HMD that has attempted to cope with the mounting position shift of the HMD. For example, an HMD described in Patent Document 1 has been proposed.

  Here, Patent Document 1 describes an HMD 100 as shown in FIG. The HMD 100 includes a display unit 101 and a mounting unit 102. The mounting unit 102 includes a main body 103 and a support mechanism 104. The support mechanism 104 is provided with an elastic member and a spring that generate a biasing force with respect to the display unit 101 when the user wears the support mechanism 104.

  The urging force of the support mechanism 104 acts as a tension with respect to the display unit 101, maintains the mounting position, and reduces the burden on the user. The HMD 100 is connected to a dedicated processor unit having an image processing unit and a conversion unit for outputting an image to the HMD.

JP 2014-68184 A

  However, the conventional HMD including the HMD described in Patent Document 1 is a dedicated machine that needs to be connected to a dedicated device, a PC, a game machine main body, or the like. That is, it must be used together with the main body of the connection destination, and there is a problem that the place of use is limited and the portability is lacking.

  Further, as a use of HMD, VR is often used in a virtual space, but it is applied to augmented reality (hereinafter referred to as “AR”), which is a fusion with real-world video. Currently, augmented reality has not been fully introduced.

  In order to increase the product value of HMD, it is considered that application of HMD to AR is highly important. However, due to the lack of portability described above, the use position of HMD is limited and application to AR is difficult. It has become a thing.

  Further, it is considered that there are still many points that can be improved in the existing HMD in terms of reducing the burden on the user when using the HMD and improving the feeling of immersion in the video.

  The present invention has been made in view of the above points, and provides a head-mounted device and a head-mounted information display system that are easy for a user to use and can experience not only virtual reality but also augmented reality. For the purpose.

  In order to achieve the above object, a head-mounted device according to the present invention includes a main body mounted on a user's head, a lens unit provided in the main body and positioned in front of the user's eyes, and the lens of the main body. A terminal mounting unit that is provided in the vicinity of the unit and can be attached to a portable terminal having a display; and an external video input / output unit that can capture an external video and output the captured external video to the portable terminal. .

  Here, the user can mount the head mounted device by the main body mounted on the user's head. In addition, information regarding the movement of the user's head can be reflected in the apparatus.

  Moreover, a portable terminal can be arrange | positioned to a head mounted apparatus by the terminal mounting part which can attach the portable terminal which has a display. In addition, a portable terminal here means portable terminals, such as a tablet terminal and a smart phone, which have a display. That is, a portable head-mounted device that does not use a dedicated machine such as a PC or a game machine body can be realized.

  In addition, a three-dimensional image can be provided to the user by a lens unit provided in the main body and positioned in front of the user's eyes and a terminal mounting unit to which a portable terminal having a display can be attached. That is, by adjusting the enlargement ratio and arrangement position of the lens unit and allowing the user to visually recognize the display of the portable terminal through the lens unit, a stereoscopic effect can be generated in the video.

  In addition, an external video input / output unit that can capture an external video and output the captured external video to a portable terminal allows the user to experience augmented reality using the external video. That is, it is possible to display information on the captured external video in the real environment on the portable terminal by modifying the information on the portable terminal.

  Reflection elephant information input / output unit that measures the depth distance to the object located in the captured external image and uses it as the reflected elephant information of the object, and can output the reflected elephant information and the captured external image to the portable terminal When it is provided, it becomes possible to make a user recognize an object on a portable terminal. For example, based on the depth distance information via the infrared depth sensor, the user can recognize the shape of a person, a car, or the like located in the external image of the real environment. In addition, the reflected image information can be reflected in the video information displayed as augmented reality.

  In addition, when the portable terminal has a vibration gyro sensor capable of detecting angular velocity information from vibrations received by the portable terminal and can display the angular velocity information and the video displayed on the display in conjunction with each other, It is possible to display the information on the movement of the head by reflecting it on the video displayed on the portable terminal. That is, for example, video information displayed on the portable terminal can be changed in conjunction with the movement of the user's head, and a virtual reality closer to reality can be provided to the user.

  Further, when the center of gravity in the state where the portable terminal is attached to the terminal mounting portion is located at the approximate center of the main body, the burden on the user when the device is mounted can be reduced. That is, it is possible to make it difficult for the load to be biased to the left and right during mounting.

  In addition, when the terminal mounting part clamps and fixes at least both ends of the portable terminal, and the size that can be clamped is variable within a predetermined range, it is possible to securely hold the portable terminals of a plurality of sizes. It becomes possible. In addition, the predetermined range here means the range of the length of the vertical direction or horizontal direction according to the standard of portable terminals, such as a tablet terminal or a smart phone.

  In addition, when the lens unit is configured such that the lens constituting the lens unit can be replaced or the arrangement position of the lens unit can be adjusted to the front, back, left, and right, the user can more easily see the screen. That is, for example, the enlargement ratio and focusing can be easily performed, and the burden on the user's eyes during use can be reduced.

  In addition, a sound collecting unit that can collect external sound and output it as sound information to the portable terminal and a position corresponding to the user's ear of the main body are connected to the portable terminal and transmitted from the portable terminal. When the headphone unit that converts the sound information into sound waves is provided, the user can experience augmented reality using the sound of the external environment. That is, for example, based on the collected sound information of the real environment, the video information displayed on the portable terminal can be modified and displayed on the portable terminal.

  In addition, when a light-shielding portion that is provided from the terminal mounting portion to the vicinity of the lens portion and shields light from the outside is provided, it is possible to further enhance the feeling of immersion when the device is mounted.

  In order to achieve the above object, a head-mounted information display system according to the present invention includes a portable terminal having a display, a main body mounted on the user's head, and provided in the main body, in front of the user's eyes. A lens part located in the vicinity of the lens part of the main body, a terminal mounting part to which the portable terminal can be attached, an external video can be captured, and the captured external video is output to the portable terminal And a head-mounted device having a possible external video input / output unit.

  Here, the portable terminal can be arranged in the head-mounted device by a portable terminal having a display and a terminal mounting portion to which the portable terminal can be attached. That is, a portable head-mounted information display system that does not use a dedicated machine such as a PC or a game machine main body can be realized.

  In addition, an external video input / output unit capable of capturing an external video and outputting the captured external video to a portable terminal makes it possible for the user to experience an extended image using the external video. That is, it is possible to display information on the captured external video in the real environment on the portable terminal by modifying the information on the portable terminal.

  Reflection elephant information input / output unit that measures the depth distance to the object located in the captured external image and uses it as the reflected elephant information of the object, and can output the reflected elephant information and the captured external image to the portable terminal When it is provided, it becomes possible to make a user recognize an object on a portable terminal. For example, based on the depth distance information via the infrared depth sensor, the user can recognize the shape of a person, a car, or the like located in the external image of the real environment. In addition, the reflected image information can be reflected in the video information displayed as augmented reality.

The head-mounted device according to the present invention is easy for a user to use and can experience not only virtual reality but also augmented reality.
In addition, the head-mounted information display system according to the present invention is easy for the user to use and can experience not only virtual reality but also augmented reality.

It is the schematic which shows the whole elephant and mounting state of a head mounted type information display system. It is a schematic side view which shows the whole elephant and mounting state of a head mounted type information display system. It is the schematic which shows a part of main body of a head mounted apparatus. It is the schematic which shows the periphery structure of the terminal mounting part and eyepiece part of a head mounted apparatus. It is a schematic side view which shows the periphery structure of the terminal mounting part and eyepiece part of a head mounted apparatus. It is the schematic (a) of the structure using an opening-and-closing type arm as an attachment structure as a terminal mounting part, and the schematic (b) of the structure using a spring-like arm. It is the schematic (a) and (b) which shows the usage example of AR which combines a dinosaur with the real scenery. It is the schematic (a) and (b) which shows the usage example of AR which combines the clothes and the fashion model of a store. It is the schematic which shows the structure of the conventional head mounted display.

Hereinafter, an example of a head-mounted apparatus and a head-mounted information display system to which the present invention is applied will be described with reference to the drawings for understanding of the present invention. The following contents are merely examples of the embodiment of the present invention, and the contents of the present invention are not limited to these.
FIG. 1 is a schematic diagram showing an overall image and a mounting state of a head-mounted information display system. FIG. 2 is a schematic side view showing an overall image and a mounting state of the head mounted information display system. FIG. 3 is a schematic view showing a part of the main body of the head-mounted apparatus.

  As shown in FIG. 1, a video display system 1 that is an example of a head-mounted information display system to which the present invention is applied includes a head-mounted device 2 and a tablet terminal 3.

  The head-mounted device 2 is a device that can be mounted on the head by the user via the main body 4 and has a shape that covers the front of the user and the upper part of the face. The head mounted device 2 also has a terminal mounting portion 5 into which the tablet terminal 3 can be inserted in a slot-in format.

  By attaching the tablet terminal 3 to the terminal mounting unit 5, the user can visually recognize video information displayed on the display of the tablet terminal 3. That is, the display of the tablet terminal 3 is installed in the terminal mounting part 5 in the direction in which the display is located on the user side.

  The tablet terminal 3 is a known portable terminal having a PC function, and includes a display as a display device, a computer main body, a touch panel as an input device, a speaker, and the like.

  The tablet terminal 3 is capable of online communication in an environment where the Internet can be used. The tablet terminal 3 includes a vibration gyro sensor (not shown) that can detect an angular velocity from vibrations received by the tablet terminal 3.

  The vibration gyro sensor can detect the movement of the tablet terminal 3, that is, the information on the movement of the head of the user wearing the head mounted device 2, and can reflect the detected information in the application software of the tablet terminal 3.

  As shown in FIG. 1, an RGB stereo camera 6 is provided in front of the main body 4 of the head mounted device 2. The RGB stereo camera 6 is a camera that captures an image of the real world ahead of the user as an external image.

  The RGB stereo camera 6 is connected to the tablet terminal 3 by wire or wirelessly, and outputs the captured external video to the terminal side. Further, a depth camera 7 is provided in front of the main body 4.

  The depth camera 7 detects the distance information to the object located in the captured external image and the shape information of the object via the built-in infrared depth sensor. The depth camera 7 is also connected to the tablet terminal 3 by wire or wireless, and outputs distance information and shape information regarding the detected object to the terminal side. The distance information and the shape information can be recognized as object information.

  Further, a stereo microphone 8 and a stereo headphone 9 are provided in a region corresponding to the position of the user's ear on the main body 4 of the head mounted device 2. The stereo microphone 8 and the stereo headphones 9 are connected to the tablet terminal 3 by wire or wireless.

  The stereo microphone 8 picks up the sound of the external environment and outputs it to the tablet terminal 3 as sound information. Further, the stereo headphone 9 allows the user to view the sound generated from the tablet terminal 3.

  Here, the main body 4 of the head-mounted device 2 does not necessarily have a shape that covers the front of the user's eyes and the upper part of the face. The main body 4 can be mounted on the user's head and the user can use the tablet terminal 3. It is sufficient if the shape is such that the eyes can be shielded to such an extent that the display can be visually recognized.

  Further, the terminal mounting portion 5 does not necessarily have a structure in which the tablet terminal 3 can be inserted in the slot-in format, and it is sufficient if the tablet terminal 3 can be attached. For example, a structure in which the tablet terminal 3 is housed in a structure having an openable / closable lid may be employed. However, it is preferable that the terminal mounting portion 5 has a structure in which the tablet terminal 3 can be inserted in a slot-in manner from the viewpoint that the terminal can be easily attached and detached.

  Moreover, the kind of tablet terminal 3 is not specifically limited. A smart phone terminal can be attached to the head mounted device 2 to which the present invention is applied. In that case, while designing the position and magnitude | size of the terminal mounting part 5 for smart phone terminals, the lens part mentioned later can be adjusted and it can be made to respond | correspond as a structure combined with the image displayed on the display of a smart phone terminal. .

  Moreover, it is sufficient for the tablet terminal 3 to have a built-in sensor capable of detecting the angular velocity from the vibration received by the tablet terminal 3, and the type of sensor is not limited. Note that a vibration gyro sensor is generally used as the angular velocity detection mechanism used in the tablet terminal 3.

  The head-mounted device 2 only needs to have a configuration capable of capturing an external video and outputting information of the external video to the tablet terminal 3, and the RGB stereo camera 6 is an example.

  Further, the depth camera 7 does not necessarily have to be provided in the main body 4 of the head mounted device 2. However, it is possible to recognize an object in the external real space and reflect it in the video information displayed as AR so that the user can provide an advanced simulated experience. A depth camera 7 is preferably provided.

  Further, the stereo microphone 8 is not necessarily provided in the main body 4 of the head mounted device 2. However, it is preferable that the stereo microphone 8 is provided in the main body 4 of the head-mounted device 2 because external audio can be captured and reflected in video information displayed as AR, and AR can be expanded based on the audio information. .

  FIG. 2 is a side view of the head mounted device 2 as described above. The head-mounted device 2 is attached to the user's head via the main body 4 and the support band 14 attached to the main body 4.

  The support band 14 is located from the front to the back of the user's head, and supports the main body 4 on which the tablet terminal 3 is arranged and increases in weight. Thereby, the burden concerning a user's head front is reduced, and a feeling of wearing is raised.

  FIG. 3 shows the positions of the RGB stereo camera 6 and the depth camera 7 provided in the main body 4. FIG. 3 shows the head-mounted device 2 in a state where the tablet terminal 3 is not attached, and an RGB stereo camera 6 and a depth camera 7 are provided in a region further outside the terminal mounting portion 5.

  In addition, the RGB stereo camera 6 and the depth camera 7 are provided in the vicinity of the terminal mounting portion 5 so that the tablet terminal 3 and each camera can be easily connected by wire.

  Here, the support band 14 does not necessarily have to be attached to the main body 4, and a structure that can be mounted on the user's head only by the main body 4 may be adopted. However, it is preferable that the support band 14 is attached to the main body 4 from the viewpoint that the weight applied to the front of the user's head can be reduced and that stable mounting is possible.

The peripheral structure of the terminal mounting part and the eyepiece part of the head mounted device will be described.
FIG. 4 is a schematic diagram showing the peripheral structure of the terminal mounting part and the eyepiece part of the head-mounted device. FIG. 5 is a schematic side view showing the peripheral structure of the terminal mounting part and the eyepiece part of the head mounted device. FIG. 6 is a schematic diagram (a) of a structure using an open / close arm as a mounting structure as a terminal mounting portion, and a schematic diagram (b) of a structure using a spring-like arm.

  As shown in FIG. 4, an eyepiece unit 10 is provided at a position corresponding to the user's eye of the main body 4 of the head mounted device 2. The eyepiece unit 10 is a member that is in contact with the user's eye and its surroundings. The eyepiece 10 is made of a flexible silicon material, and an organic cotton 13 is disposed on the portion that contacts the user's skin. FIG. 5 shows a cross-sectional structure of the structure shown in FIG. 4 as viewed from the side.

  Further, a lens unit 11 is provided between the terminal mounting unit 5 and the eyepiece unit 10 of the main body 4. The lens unit 11 includes a plurality of lens bodies 12 and is a part that enlarges an image displayed on the display of the tablet terminal 3 and allows a user to view a stereoscopic image.

  The plurality of lens bodies 12 constituting the lens unit 11 are configured to be detachable from the lens unit, and can be exchanged with another lens body. Accordingly, the enlargement ratio can be easily changed according to how the user views the video.

  Further, from the eyepiece 10 to the terminal mounting portion 5, the upper and lower portions are covered with a light-shielding cover (not shown) so as to be shielded from light. In addition, when the main body 4 is mounted, not only the user's eyes but also the shape from the cheek to the nose of the face is covered, so that light is not easily inserted into the inner side of the main body.

  Further, the main body 4 is configured such that the center of gravity when the tablet terminal 3 is mounted is positioned at the approximate center 20 of the main body 4. Thereby, it is hard to put weight on right and left at the time of mounting | wearing, a user's burden can be reduced, and a usability | use_condition can be improved.

  The terminal mounting portion 5 of the head mounted device 2 has a structure in which both ends of the tablet terminal 3 are sandwiched and supported. Details of the support structure of the tablet terminal 3 by the terminal mounting portion 5 are shown in FIG.

  At both end portions of the end mounting portion 5, there are provided mounting portions 21 composed of the arm 15, the pressing plate 16, and the open / close button 17 shown in FIG. That is, when the tablet terminal 3 is attached sideways, the attachment portions 21 are arranged one by one at both ends of the terminal.

  The two arms 15 are slidable inward and outward by an open / close button 17 and sandwich the tablet terminal 3 therebetween. The open / close range of the arm 15 is slid within a range applicable to the standard size of existing tablet terminals.

  As described above, the terminal mounting portion 5 has a structure that supports the terminal in accordance with the size of the tablet terminal 3 and can be firmly fixed. As the structure of the terminal mounting portion 5, the following can also be adopted.

  For example, a structure of a mounting portion composed of a spring-like arm 18 and a pressing plate 19 as shown in FIG. The tablet terminal 3 is arranged between the two spring-like arms 18, and the tablet terminal 3 is fixed from both sides by the urging force of the spring part bent inward.

  By arranging two sets of spring-like arms 18 at both ends of the tablet terminal 3, the tablet terminal 3 can be firmly fixed. In addition, the elasticity of the spring-like arm 18 is compatible with various existing tablet terminal size standards.

  Further, as the structure of the terminal mounting part, a structure (not shown) in which band-like gathers formed of silicon or the like are arranged at both ends of the terminal mounting part 5 can be adopted. By arranging the tablet terminal 3 between the gathers and pinching it, the terminal can be pinched.

  Moreover, the structure which provides the mounting surface (not shown) which has the unevenness | corrugation made from urethane in the both ends of the terminal mounting part 5 can also be employ | adopted. By making the distance between the two mounting surfaces facing each other smaller than the width of the tablet terminal 3, the urethane unevenness and the side of the tablet terminal 3 come into contact with each other, and the terminal is supported while the unevenness is recessed. By adopting such a belt-like gather or mounting surface, a structure for supporting the tablet terminal 3 more softly can be realized.

  Here, the eyepiece 10 is not necessarily formed of a silicon material, and the organic cotton 13 does not have to be provided in a portion that contacts the user's skin. However, it is preferable that the eyepiece 10 is made of a silicon material, and the organic cotton 13 is provided in a portion that comes into contact with the user's skin, from the viewpoint that the user's feeling during wearing can be improved.

  Further, the lens unit 11 does not necessarily need to be composed of a plurality of lens bodies 12. However, it is preferable that the lens unit 11 is composed of a plurality of lens bodies 12 because it is easy to adjust the enlargement ratio and it is easy to adjust in accordance with how the user looks.

  In addition, the adjustment of the lens of the head-mounted apparatus 2 is performed by making it possible to replace the plurality of lens bodies 12 constituting the lens unit 11, but the lens adjustment method is not limited to this. For example, a dial system that adjusts the appearance by adjusting the lens arrangement position with a dial so that the lens can be moved back and forth and left and right can be adopted.

  Further, the center of gravity when the tablet terminal 3 is mounted is not necessarily configured to be positioned at the approximate center 20 of the main body 4. However, it is preferable that the center of gravity when the tablet terminal 3 is mounted is located at the approximate center 20 of the main body 4 from the viewpoint of reducing the burden on the user when wearing it and making it difficult for the apparatus to shift.

  Further, as a structure for reducing the burden on the user when wearing, a head-mounted apparatus in which a support structure for supporting the main body at the forehead of the user is provided on the top of the structure having the terminal mounting portion 5 and the eyepiece 10 Can also be adopted. With the support structure at the forehead part, the weight of the tablet terminal applied to the terminal mounting part can be supported by the eyepiece 10 and the support structure, and the burden on the user when worn can be reduced.

  Moreover, the terminal mounting part 5 does not necessarily have a structure in which the range for holding the terminal can be changed according to the size of the tablet terminal 3, and it is sufficient if the tablet terminal 5 is attached. However, since it becomes possible to support tablet terminals 3 having various sizes, the versatility is improved, and it is possible to change the holding range and fix them sufficiently. Thus, it is preferable that the range in which the terminal is sandwiched can be changed.

  Moreover, the structure which attaches the tablet terminal 3 of the terminal mounting part 5 is not specifically limited. Various structures such as a structure using an arm and an opening / closing button, a structure using a spring-like arm, a band-like gather formed of silicon or the like, and a urethane mounting surface having unevenness as described above can be adopted.

  Examples of use of the video display system 1 and the head mounted device 2 described above will be described for understanding of the present invention. In addition, the following description is only an example of embodiment of this invention and the content of this invention is not limited to the content as described in the following.

  As described above, in the video display system 1 to which the present invention is applied, the information of the external video captured from the RGB camera 6 and the depth camera 7 is output to the tablet terminal 3, and the video information is processed by the function of the software on the terminal. And can be visually recognized by the user. This processing is, for example, a combination of an external video and CG. In the following, an application for allowing the user to recognize the AR will be described. Note that the video displayed on the tablet terminal 3 in AR can be displayed according to the application by expanding the application software of the tablet terminal 3.

(AR usage example)
For example, the video display system 1 can be used for a simulated experience for education. As shown in FIG. 7A, the actual original landscape 22 is captured as video information by the RGB camera 6, and as shown in FIG. 7B, the extinct dinosaur 23 is captured in real size video information. Combine as. The user can visually recognize a real dinosaur image in a real scene, and can learn a living creature and enjoy a powerful image.

  Further, when the AR function is used, the movement of the user's head is reflected on the tablet terminal 3 via the vibration gyro sensor, and can be linked to the movement. That is, the display image follows the landscape in the direction in which the user moves his / her line of sight, and the image can be displayed according to the user's viewpoint.

  Also, in the example described above, similarly, it can be used for studying history by combining the real scenery such as ruins and castle walls with video information of buildings and castles at the time. In this way, it can be used as a tool for education.

  AR can also be used for a simulated experience model for business. For example, in an apparel store, a CG image of a fashion model wearing clothes sold in the store is synthesized with the image landscape 24 in the store shown in FIG. 8A, and as shown in FIG. The model 25 walking in the store is displayed on the video. The user can visually recognize the atmosphere in which clothes are worn more realistically, and can lead to sales and PR of the store.

  Also, for business use, it is used for near-future experience models, such as overlaying near-future scenery with original scenery, for example, displaying urban scenery at the time of the Tokyo Olympics in 2020 and giving it a simulated experience. be able to. Further, when the RGB camera 6 takes in a travel poster at a store, for example, a Hawaii poster, the surrounding landscape changes to the Hawaiian world, and a travel experience can be simulated.

  Furthermore, AR can naturally be expected to be used for entertainment purposes. For example, a character synthesized with CG appears in the original landscape, or a person existing in the original landscape is recognized by the depth camera 7 and transformed into a character, so that it appears in the real world landscape. Thus, it is possible to realize a game in which the CG character is touched. In addition, it is also possible to use a concert scene that is actually held in a distant land by reproducing it in the video information of the local concert hall and experiencing it in real time.

  As described above, by using the depth camera 7, it is possible to recognize an object in the real world and reflect the object information in the video information. In response to the recognition of the object, the tablet terminal 3 can be provided with functions such as, for example, sounding an alarm, producing an image, and playing music.

  More specifically, it is possible to recognize a human face in the real world and allow the user to visually recognize an image converted into a character face. It is also possible to recognize humans and transform only people in the city into characters of corporate images or characters in movies, which can be used for corporate promotions and movie promotions. Furthermore, it is possible to change the display of human clothes in the real world to that of the Edo period and use it for studying history.

  Further, the depth camera 7 recognizes obstacles and cars in front of the real world, and when there is a danger of collision from distance information with the object, an alarm sound can be emitted from the tablet terminal 3. The user can detect the danger by listening to the alarm sound through the stereo headphones 9. Moreover, it can also be set as the structure which alert | reports danger with the alarm sound also to the people around a user. That is, it can be used as a safety measure function when the video display system 1 is used.

  Further, since the video display system 1 also has a function as a VR, the following usage examples can be considered. In addition, the video displayed on the tablet terminal 3 by VR can display the video according to the application by expanding the application software.

(Example of using VR)
For example, the video display system 1 can be used for a simulated experience for education. For example, it is possible to display images inside the human body, visually recognize various internal organs with powerful images, and understand the mechanism of the human body.

  In addition, you can display scenes and people's images from various eras such as Jomon, Yayoi, Asuka, Heian, Kamakura, etc., and see the situation at that time with three-dimensional images to learn pseudo-experience of history. . Furthermore, you can land on planets such as Mars and Venus and learn pseudo-experiences including the scenery of the stars.

  When the VR function is used, the movement of the user's head can be reflected on the tablet terminal 3 and linked in the same manner as in the AR mode. In other words, the display image on the VR follows the landscape in the direction in which the user moves his / her line of sight, and the display portion on the VR image can be changed.

  VR can also be used for a simulated experience model for business. For example, the video information of the interior of the building to be built is artificially created, and the user can walk around the building and grasp the atmosphere inside. More specifically, for example, the user can experience the inside of a condominium or house scheduled to be completed without creating a model room.

  Furthermore, VR can be used for entertainment purposes as in the past. For example, when a user enters the game world, he / she can enjoy the game as the main character of the game.

  In the video display system 1, a usage application using sound can also be adopted. For example, it is conceivable to pick up the user's voice with the stereo microphone 8 and operate the tablet terminal 3 with a voice command. It is also possible to pick up external sound with the stereo microphone 8 and make it a caption on the tablet terminal 3 so that the user can visually recognize it.

  Similarly to the known HMD, it is also possible to display a video such as a movie on the tablet terminal 3 and enjoy a video with a stereoscopic effect on the video display system 1.

  As described above, the video display system and the head mounted device to which the present invention is applied can be used simply by attaching an existing tablet terminal. That is, a portable video display system can be realized.

  In addition, a dedicated machine for providing video information and processing image information is not required, and is highly versatile.

  Furthermore, by capturing external images of the real world, it is possible to provide a user with a simulated experience using AR as well as VR. Moreover, since it has portability, various places and scenery can be utilized for AR.

  In addition, the tablet terminal can be made to follow the movement of the user's head, and a more integrated video display in accordance with the user's viewpoint is possible. Also, by performing object recognition, it is possible to further enhance the AR video display and simulated experience.

  In addition, the head-mounted device has a structure that can enhance the feeling of use and immersion of the user by adjusting the lens part and improving the light shielding property. In addition, the burden on the user at the time of wearing is reduced.

As described above, the head mounted device according to the present invention is easy for the user to use and can experience not only virtual reality but also augmented reality.
In addition, the head-mounted information display system according to the present invention is easy for the user to use and can experience not only virtual reality but also augmented reality.

DESCRIPTION OF SYMBOLS 1 Video display system 2 Head mounted apparatus 3 Tablet terminal 4 Main body 5 Terminal mounting part 6 RGB stereo camera 7 Depth camera 8 Stereo microphone 9 Stereo headphones 10 Eyepiece part 11 Lens part 12 Lens body 13 Organic cotton 14 Support band 15 Arm 16 Presser plate 17 Open / close button 18 Spring-shaped arm 19 Presser plate 20 Approximate center of main body 21 Mounting portion 22 Original real scene 23 Dinosaur 24 In-store video scene 25 Model

Claims (10)

A body to be worn on the user's head;
A lens unit provided in the main body and positioned in front of the user's eyes;
A terminal mounting portion provided in the vicinity of the lens portion of the main body and capable of attaching a portable terminal having a display;
An external video input / output unit capable of capturing an external video and outputting the captured external video to the portable terminal. Reflected elephant information input / output unit capable of measuring the depth distance to an object located in the captured external image and using it as reflected elephant information and outputting the reflected elephant information and the captured external image to the portable terminal The head-mounted apparatus according to claim 1. The portable terminal has a vibration gyro sensor capable of detecting angular velocity information from vibrations received by the portable terminal, and can display the angular velocity information and an image displayed on the display in conjunction with each other. Item 3. The head mounted device according to Item 2. The head-mounted apparatus according to claim 1, wherein the center of gravity in a state where the portable terminal is attached to the terminal mounting portion is positioned at a substantially center of the main body. The said terminal mounting part clamps and fixes at least both ends of the said portable terminal, The magnitude | size which can be clamped is variable within the predetermined range. The claim 1, Claim 3, Claim 4 or Claim 4 Head mounted device. The lens unit is configured such that a lens constituting the lens unit can be exchanged or the arrangement position of the lens unit can be adjusted in the front-rear and left-right directions. 5. The head-mounted apparatus according to 5. A sound collection unit capable of collecting external sound and outputting it as sound information to the portable terminal;
The headphone part which is provided in the position corresponding to the user's ear of the main part, is connected with the portable terminal, and converts the sound information transmitted from the portable terminal into a sound wave. The head-mounted apparatus according to claim 3, 4, 5, or 6. A light-shielding part that is provided from the terminal mounting part to the vicinity of the lens part and shields light from the outside. The claim 1, claim 2, claim 3, claim 4, claim 6, or claim 6. 8. The head-mounted apparatus according to 7. A portable terminal having a display;
A main body mounted on the user's head, a lens unit provided in the main body and positioned in front of the user's eyes, and a terminal mounting unit provided in the vicinity of the lens unit of the main body and capable of attaching the portable terminal A head-mounted information display system including an external video input / output unit capable of capturing an external video and outputting the captured external video to the portable terminal. Reflected elephant information input / output unit capable of measuring the depth distance to an object located in the captured external image and using it as reflected elephant information and outputting the reflected elephant information and the captured external image to the portable terminal The head-mounted information display system according to claim 9.

Images