JP2015149654A - Head mount display, viewing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a head mount display in which character information is displayed in synchronism with an image, without interfering with the viewing of a user.SOLUTION: A head mount display having a transmission type display section has a receiving section for receiving character information from a display device, a camera section for acquiring the mapping that is viewed by a user through the display section, a display area detector for detecting the position of the display device, viewed by the user through the display section, as a first area based on the image data thus acquired, a character area determining section for determining a second area, that is the position of the display for displaying the received character information, depending on the first area thus detected, and a display control section for displaying the character information in the second area thus determined, for the display section.

Description

  The present invention relates to a head mounted display having a transmissive display unit.

  2. Description of the Related Art Conventionally, a head mounted display that is mounted on a user's head and displays an image on a display unit arranged in front of the eyes is known. Head mounted displays include a transmissive type and a non-transmissive type. In the transmissive head-mounted display, the user can visually recognize the outside world through the display unit. That is, an image displayed on the display unit and an image of the outside world are simultaneously input to the user's eye wearing the head mounted display, and the user can visually recognize a pseudo composite image.

  In addition, a head mounted display that can provide character information and the like to a user wearing the head mounted display by displaying character information on a display unit is disclosed (for example, see Patent Document 1).

JP 2006-119653 A

  In a transmissive head-mounted display, when character information is displayed on the display unit, the character information may not be arranged at an appropriate position with respect to an image of the outside world viewed through the display unit. For example, when a user is viewing an image displayed in the outside world with a head-mounted display attached, the character information displayed in synchronization with the image is not displayed at an appropriate position with respect to the image. Information hinders viewing by the user.

  The present invention has been made in view of the above problems. A head-mounted display that displays character information that is displayed in synchronization with an image without interfering with the user's viewing, and a viewing that partially includes the head-mounted display. The purpose is to provide a system.

Application example 1
In order to solve the above problems, according to one embodiment of the present invention, a head-mounted display having a transmissive display unit, which is visually recognized by a user through a receiving unit that receives character information from a display device and the display unit A camera unit that acquires a mapping as image data, a display region detection unit that detects a position of the display device in the acquired image data as a first region, and the received the first region according to the detected first region A character region determination unit that determines a second region that is a position of the display unit that displays character information, and a display control unit that causes the display unit to display the received character information in the determined second region And having.

In the invention configured as described above, the position of the display device included in the image data acquired by the camera unit is detected as the first region. Next, in accordance with the detected first area, a second area that is the position of the display unit that displays the received character information is determined. Then, the received character information is displayed at the position of the display unit corresponding to the determined second area.
Therefore, since the second area for displaying the character information is determined according to the first area where the user visually recognizes the display device, the character information displayed in synchronization with the image is displayed without disturbing the user's viewing. Can be made.

Application example 2
In one aspect of the present invention, an operation unit that receives an adjustment of a position or a size of character information displayed on the display unit from a user is provided, and the display control unit performs the display according to the received adjustment. The position or size of the character information displayed on the part is changed.
In the invention configured as described above, the user can manually adjust the viewing position of the automatically set character information, so that the use of the character information can be made easier to use.

Application example 3
In one aspect of the present invention, the character area determination unit determines the second area inside the first area.
In the invention configured as described above, since the character information is displayed integrally with the display device, the character information can be displayed without causing the user who uses the character information to feel uncomfortable.

Application example 4
In one aspect of the present invention, the character area determination unit determines the position of the second area according to the size of the first area.
In the invention configured as described above, the position where the character information is displayed can be changed according to the size of the display device visually recognized by the user. Therefore, the visibility of character information can be improved.

Application example 5
In one aspect of the present invention, the character area determination unit determines the position of the second area outside the first area if the size of the first area is small.
In the invention configured as described above, even when the size of the display device visually recognized by the user is small, the character information is displayed outside the display device, so that the visibility of the character information can be improved.

Application Example 6
In one aspect of the present invention, if the size of the character information is large, the position of the second area is determined outside the first area.
In the invention configured as described above, when the size of the character information is large, the character information is displayed outside the display device, so that the user's viewing of the display device is not hindered and the visibility of the character information is improved. Can do.

Application example 7
In one aspect of the present invention, the display control unit causes the display unit to stereoscopically display the character information.
In the invention configured as described above, the present invention can be applied to a head mounted display that allows a user to stereoscopically view.

Application Example 8
The present invention can also be understood as a viewing system that includes a head-mounted display having the features of the present invention as a component.

The external view of a viewing-and-listening system. The block block diagram of HMD10. FIG. 3 is a functional block diagram illustrating functions of a controller 31. FIG. 2 is a block configuration diagram showing a configuration of the display device 1. The figure explaining the pairing process performed between HMD10 and the display apparatus 1. FIG. The figure explaining the image visually recognized by the user wearing HMD10. The flowchart which shows the process performed when the controller 31 displays character information. The figure explaining the process performed when the controller 31 displays character information. The figure which shows the image for right eyes and the image for left eyes produced | generated from the character information. 7 is a flowchart for explaining processing executed by a controller 31 when a user operates an operation unit 25. The figure explaining the icon displayed on HMD10 when a user operates the operation part 25. FIG. The flowchart which shows the process which the controller 31 performs. The figure explaining the image visually recognized by the user wearing HMD10.

Hereinafter, embodiments of the present invention will be described in the following order.
1. First embodiment:
(1) Configuration of viewing system (2) Pairing method (3) Display method of character information Second embodiment:
3. Third embodiment:
4). Other embodiments:

1. First embodiment:
(1) Configuration of Viewing System FIG. 1 is an external view of a viewing system.
The viewing system 100 includes a head mounted display (hereinafter also referred to as HMD) 10 and a display device 1. The HMD 10 and the display device 1 are connected through the network NE, and the character information WD can be transmitted from the display device 1 to the HMD 10. Here, the network NE is a wireless local area network (LAN) provided with a relay device (not shown) or near field communication.

  The HMD 1 includes a frame 20 formed in accordance with the user's head, a right-eye display unit 11 and a left-eye display unit 12 supported by the frame 20 so as to be positioned on the right and left eyes of the user, and the HMD 1. And a control unit 30 for controlling the driving of the motor.

The HMD 1 is a transmissive type, and the user can visually recognize the display device 1 through the right eye display unit 11 and the left eye display unit 12 of the HMD 10. When the HMD 10 receives the character information WD from the display device 1 through the network NE, the user displays the character information WD on the display unit 11 for the right eye or the display unit 12 for the left eye, and the display device 1 and this character are displayed. The information WD can be viewed at a time.
The character information WD may be subtitle information, data attached to the content, or a special pattern that the display device 1 displays on the HMD 10.
As the transmission type HMD 10, there are an optical transmission type HMD and a video transmission type HMD. In the following description, the description will focus on the optical transmission type HMD.

FIG. 2 is a block diagram of the HMD 10.
The frame 20 of the HMD 10 includes a display unit 11 for the right eye, a display unit 12 for the left eye, an optical component 13 for the right eye, an optical component 14 for the left eye, a camera 21 for the right eye, a camera 22 for the left eye, and a right eye. An image generation unit 23, a left-eye image generation unit 24, and an operation unit 25 are incorporated. The control unit 30 of the HMD 10 includes a controller 31, a video memory 32, and a communication IF 33. Furthermore, the right-eye camera 21, the left-eye camera 22, the right-eye image generation unit 23, the left-eye image generation unit 24, the operation unit 25, the video memory 32, and the communication IF 33 are connected to the controller 31.

  The right eye image generation unit 23 generates right eye image light to be displayed on the right eye display unit 11 based on the character information WD output from the controller 31. The left eye image generation unit 24 generates left eye image light to be displayed on the left eye display unit 12 based on the character information WD output from the controller 31. The right-eye image generation unit 23 and the left-eye image generation unit 24 include, for example, an optical modulation element including R (red), G (green), and B (blue) liquid crystal elements, and a backlight.

  The right-eye image light generated by the right-eye image generation unit 23 is guided to the right-eye display unit 11 by the right-eye optical component 13. The left-eye image light generated by the left-eye image generation unit 24 is guided to the left-eye display unit 12 by the left-eye optical component 14. The right-eye optical component 13 and the left-eye optical nine article 13 are composed of a lens and a light guide plate.

The right-eye display unit 11 and the left-eye display unit 12 display the right-eye image and the left-eye image, respectively, using the right-eye image light and the left-eye image light. The reflected light from the right-eye image and the reflected light from the left-eye image are incident on the user's right eye and left eye, and cause the user to visually recognize the image (character information WD). The right-eye display unit 11 and the left-eye display unit 12 are configured by a semi-transmissive lens such as a half mirror, for example.
Therefore, the display unit of the present invention includes a right-eye display unit 11, a left-eye display unit 12, a right-eye optical component 13, a left-eye optical component 14, a right-eye image generation unit 23, and a left-eye image generation. This is realized by the unit 24.

  The right-eye camera 21 is fixed to the frame 20 so as to capture an area visually recognized by the right eye of the user wearing the HMD 10. The left-eye camera 22 is fixed to the frame 20 so as to capture an area that is visually recognized by the left eye of the user wearing the HMD 10. Outputs from the right-eye camera 21 and the left-eye camera 22 are output to the controller 31. Hereinafter, image data captured by the right-eye camera 21 will be referred to as a right-eye peripheral image, and image data captured by the left-eye camera 22 will be referred to as a left-eye peripheral image.

  The operation unit 25 includes operation buttons and receives an operation from the user. The operation unit 25 is connected to the controller 31 and can output an operation performed by the user to the controller 31.

  The communication IF 33 performs communication using the display device 1 and the network NE. Then, the character information WD transmitted from the display device 1 is acquired by the HMD 10 by communication using the network NE by the communication IF 33. Therefore, the communication IF 33 implements the receiving unit of the present invention.

  The video memory 32 functions as a work area by the controller 31. The right eye peripheral image captured by the right eye camera 21 and the left eye peripheral image captured by the left eye camera 22 are recorded in the video memory 32.

  The controller 31 outputs to the right-eye image generation unit 23 and the left-eye image generation unit 24 in response to inputs from the right-eye camera 21 and the left-eye camera 22 and input from the operation unit 25. The eye image and the left eye image are controlled. The controller 31 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory) not shown. Then, when the CPU executes the program recorded in the ROM, the controller 31 functionally includes the parts (the display area detection unit 34, the character area determination unit 35, and the display control unit 36) illustrated in FIG.

FIG. 3 is a functional block diagram for explaining the functions of the controller 31.
The display area detection unit 34 is a display device that is visually recognized by a user wearing the HMD 10 based on image data (right eye peripheral image, left eye peripheral image) acquired through the right eye camera 21 and the left eye camera 22. The position of 1 is detected as the first region. For example, the display area detection unit 34 detects the coordinates of the area of the display device 1 included in the right eye peripheral image and the left eye peripheral image input to the video memory.

  The coordinates of the first area detected by the display area detection unit 34 are output to the character area determination unit 35. The character region determination unit 35 is a second position that is the position of the right-eye display unit 11 and the left-eye display unit 12 that displays the character information WD acquired through the communication IF 33 based on the input coordinates of the first region. Determine the coordinates of the region.

  The display control unit 36 then outputs the right-eye image output to the right-eye image generation unit 23 and the left-eye image generation unit 24 based on the coordinates of the second region determined by the character region determination unit 35. An image for the left eye is generated. Therefore, the right-eye image generation unit 23 and the left-eye image generation unit 24 write characters to the right-eye display unit 11 and the left-eye display unit 12 based on the generated right-eye image and left-eye image. Information WD is displayed. In addition, when the user is operating the operation unit 25, the display control unit 36 considers the operation input for correction.

Next, the display device 1 will be described.
FIG. 4 is a block configuration diagram showing the configuration of the display device 1.
The display device 1 includes a CPU 3, a ROM 4, a RAM 5, a tuner 6, a communication IF 7, and a display panel 8. Each part of the display device 1 is connected to each other through a bus 9. Each part is housed inside the housing 2.
For example, the display device 1 is a television receiver including a liquid crystal display panel 8.

  The communication IF 7 performs communication according to a predetermined protocol with the HMD 10. The ROM 4 also stores an OS 41 and an application 42 for the CPU 3 to transmit character information WD to the HMD 10 using the communication IF 6.

  When the CPU 3 receives the content through the tuner 6 or the communication IF 7, the CPU 3 acquires character information WD from the content. Then, the acquired character information WD is transmitted to the HMD 10 through the communication IF 7.

(2) Pairing Method FIG. 5 is a diagram for explaining a pairing process performed between the HMD 10 and the display device 1. FIGS. 5A to 5C show screens displayed on the display device 1 during the pairing process. This pairing process is started before the character information WD is transmitted from the display device 1 to the HMD 10 and is implemented by the user operating the display device 1. By this pairing process, the type of character information WD transmitted from the display device 1 is set.

  In step S1, the display device 1 broadcasts a communication request for establishing communication. At this time, an image indicating that pairing is in progress is displayed on the display panel 8 of the display device 1 (FIG. 5A).

  Next, in step S2, the display device 1 displays a confirmation image as to whether or not to register the HMD 10 that has responded to the communication request as a device to be used (FIG. 5B). When the user registers the HMD 10 displayed on the confirmation screen (HMD 10a in FIG. 5B), the display device 1 establishes communication with the HMD 10. At this time, the security setting etc. which connect a network are performed between the display apparatus 1 and HMD10.

In step S <b> 3, the display device 1 accepts selection of character information WD to be transmitted to the HMD 10 that has established communication. In FIG. 5C, the display device 1 registers two HMDs (10a, 10b) as used devices. And a user sets the kind of subtitle (character information WD) transmitted to HMD10a on the surface.
Thereafter, when the pairing is completed, the display device 1 transmits the character information WD to the HMD (10a, 10b).

(3) Display Method of Character Information Next, a method in which the HMD 10 displays the character information WD will be described.
FIG. 6 is a diagram for explaining an image visually recognized by a user wearing the HMD 10. FIG. 7 is a flowchart showing processing executed when the controller 31 displays the character information WD. And FIG. 8 is a figure explaining the process performed when the controller 31 displays the character information WD.

  FIG. 6A shows an image visually recognized by the user wearing the HMD 10 before the character information WD is displayed. FIG. 6B shows an image visually recognized by the user wearing the HMD 10 after the character information WD is displayed. It is assumed that the user wearing the HMD 10 is viewing the image shown in FIG. 6A in which a front image is formed through the right-eye display unit 11 and the left-eye display unit 12. In this image, the device 1 is located in the center in the figure.

In step S <b> 11, the controller (display region detection unit 34) 31 acquires a right eye detection image based on the right eye peripheral image from the right eye camera 21. The controller (display area detection unit 34) 31 acquires a left-eye detection image based on the left-eye peripheral image from the left-eye camera 22. The right eye detection image and the left eye detection image are obtained by converting the number of pixels of the right eye peripheral image and the left eye peripheral image according to the number of pixels of the video memory 32 by the controller 31.
FIG. 8A shows the detection image for the right eye and the detection image for the left eye acquired in step S11. In the detection image for the right eye and the detection image for the left eye, there is a first area AR1 that is a pixel area corresponding to the display device 1 corresponding to a position that can be seen by the user's right eye or left eye.

In step S <b> 12, the controller (display area detection unit 34) 31 detects the coordinates of the first area corresponding to the display device 1 from the acquired right eye detection image and left eye detection image.
As an example of a method in which the display area detection unit 34 detects the coordinates of the first area AR1, a known edge sampling process is used. For example, the display area detection unit 34 binarizes the detection image for the right eye, and detects pixels constituting the boundary between the pixels constituting the first area AR1 and the surrounding pixels as contour pixels Eg (x, y) ( FIG. 8B). In FIG. 8B, the pixels constituting the first area AR1 are indicated by hatching to distinguish them from the peripheral pixels. Then, the area surrounded by the contour pixel Eg (x, y) is detected as the coordinates of the first area AR1.
In addition, although description is abbreviate | omitted, the coordinate of 1st area | region AR1 is detected with the same method also about the detection image for left eyes.

  In step S13, the controller (character region determination unit 35) 31 displays character information WD of the detection image for the right eye and the detection image for the left eye based on the coordinates of the first region acquired in step S12. The coordinates of the second area are determined. In FIG. 8C, the first area AR1 in the detection image for the right eye determined in step S12 is designated by a dotted line. In the first embodiment, the character area determination unit 35 determines the position of the second area AR2 in the first area AR1. That is, when the user visually recognizes the character information WD, the coordinates of the second area AR2 are determined so that the character information WD is visually recognized by being superimposed on the display device 1 positioned in front.

Here, the position of the second area AR2 in the first area AR1 is preferably a position where the character information WD does not interfere with the image displayed on the display panel 8 when the user visually recognizes the display device 1. Therefore, in FIG. 8C, the second area AR <b> 2 is located in the lower part of the first area AR <b> 1 corresponding to the display panel 8 in the display device 1. In addition to this, the character region determination unit 35 may determine a region in which no image is displayed in the first region AR1 by using a well-known edge sampling process, and determine the second region AR2.
In addition, although description is abbreviate | omitted, the coordinate of 2nd area | region AR2 is detected with the same method also about the detection image for left eyes.

  In step S <b> 14, the controller (display control unit 36) 31 generates a right eye image and a left eye image from the character information WD acquired through the communication IF 33. For example, the display control unit 36 duplicates the character information WD, and the right-eye image for driving the right-eye image generation unit 23 and the left-eye image for driving the left-eye image generation unit 24. Is generated.

FIG. 9 is a diagram illustrating a right-eye image and a left-eye image generated from the character information WD. FIG. 9A shows a right eye image and a left eye image before correction. FIG. 9B shows the corrected right-eye image and left-eye image.
As shown in FIG. 9A, the image for the right eye and the image for the left eye do not have information and the low-gradation character pixels Gw constituting the character string “Good morning” corresponding to the character information WD. It consists of a background pixel Ge. The number of pixels of the right-eye image and the left-eye image is the same as the number of pixels in the video memory 32. That is, the number is the same as the number of pixels of the liquid crystal elements constituting the right-eye image generation unit 23 or the left-eye image generation unit 24.

  In step S15, the controller (display control unit 36) 31 corrects the position of the character string included in the right-eye image and the left-eye image so as to be the coordinates of the second area AR2 determined in step S13. The image is output to the right eye image generation unit 23 and the left eye image generation unit 24. Therefore, in FIG. 9B, the coordinates of the character pixel Gw included in the right-eye image and the left-eye image are changed to a lower position than in FIG. 9A.

  Thereafter, the right-eye image generation unit 23 is driven by the right-eye image output from the controller 31 to display the character information WD on the right-eye display unit 11. Similarly, the left-eye image generation unit 24 is driven by the left-eye image output from the controller 31 to display the character information WD on the left-eye display unit 12. Therefore, the user wearing the HMD 10 visually recognizes the image shown in FIG. 6B in which the front image (display device 1) is synthesized through the display unit 11 for the right eye and the display unit 12 for the left eye. In this image, the character string “Good morning” is located on the display panel 8 of the apparatus 1.

  Hereinafter, if the input of the character information WD from the display device 1 continues (step S16: NO), the controller 31 returns to step S11 and repeats the process. On the other hand, if the input of the character information WD from the display device 1 is completed (step S16: YES), the controller 31 ends the process.

As described above, in the first embodiment, since the second area AR2 for displaying the character information WD is determined according to the first area AR1 for the user to visually recognize the display device 1, the user's viewing is hindered. Therefore, it is possible to display the character information WD displayed in synchronization with the image.
In addition, since the character information WD is displayed together with the display device 1, the character information can be viewed without making the user feel uncomfortable.

2. Second embodiment:
The user may adjust the position of the character information WD visually recognized by the HMD 10 by operating the operation unit 25.
FIG. 10 is a flowchart for explaining processing executed by the controller 31 when the user operates the operation unit 25. FIG. 11 is a diagram illustrating icons displayed on the HMD 10 when the user operates the operation unit 25.
The flowchart shown in FIG. 10 is a process executed after the character information WD is displayed on the HMD 10 in, for example, step S15 and subsequent steps in FIG. 7 shown in the first embodiment.

  When the user operates the operation unit 25 to input to start adjusting the position of the character information WD (step S21: YES), in step S22, the controller (display control unit 36) 31 displays an operation icon on the HMD 10. Is displayed. An icon 201 shown in FIG. 11A is an icon that visually assists the user in changing the position of the character information WD. The icon 201 is displayed when the character information WD is moved left and right or up and down.

  When the user operates the operation unit 25 while visually recognizing the direction of the icon 201 (step S23: YES), in step S24, the display control unit 36 converts the right eye image and the left eye image indicating the character information WD. The coordinates of the included character side Gw are changed according to the input from the operation unit 25. Therefore, the position of the character information WD visually recognized by the user is changed.

  When the user operates the operation unit 25 to input to end the adjustment of the position of the character information WD (step S25: YES), the controller 31 ends the display of the icon 201 in step S26. Of course, if the user operates the operation unit 25 and does not input to end the adjustment of the position of the character information WD (step S25: NO), the controller 31 continues to display the icon 201 (returns to step S23). ).

The controller 31 may change the size of the character information WD. FIG. 11B shows an icon 202 that is displayed when the user operates the operation unit 25 to adjust the size of the character information WD. While visually recognizing the icon 202, the user operates the operation unit 25 to change the size of the character information WD.
Furthermore, as will be described later, when a stereoscopic image is viewed with the HMD 10, the depth of the character information WD may be adjusted.
Then, the controller 31 may change the color of the character information WD instead of adjusting only the direction and size of the character information WD.

  As described above, in the second embodiment, since the user can manually adjust the viewing position of the automatically set character information WD, the use of the character information WD may be easier to use. it can.

3. Third embodiment:
The position where the character information WD is displayed is not limited to the inside of the area where the display device 1 is visually recognized. For example, the second area AR2 may be determined according to the size of the display device 1 visually recognized by the user or the size of the character information WD to be displayed.

  FIG. 12 is a flowchart showing processing executed by the controller 31. The flowchart shown in FIG. 12 is the process executed in step S13 of FIG. FIG. 13 is a diagram illustrating an image visually recognized by the user wearing the HMD 10.

  In step S131, the controller (character area determination unit 35) 31 acquires the size of the first area AR1 included in the detection image for the right eye and the detection image for the left eye. The size of the first area AR1 is acquired based on the number of pixels G (x, y) constituting the first area AR1. For example, it is acquired by the display area detection unit 34.

  In step S132, the controller 31 acquires the size of the character information WD. For example, the controller 31 determines the size of the character information WD according to the information amount of the character information WD and the number of characters included in the character information WD.

  In step S133, the size of the first area AR1 acquired in step S131 is compared with the threshold value S1. The threshold value S1 indicates the size of a preset area. If the size of the first area AR1 is equal to or smaller than the threshold value S1 (step S133: NO), the controller 31 proceeds to step S136.

  In step S136, the controller 31 determines the position (coordinates) of the second area AR2 outside the first area AR1. In this case, since the size of the display device 1 visually recognized by the user is small, the controller 31 prevents the character information WD from being superimposed on the position where the display device 1 is visually recognized. For example, as shown in FIG. 13A, the character information WD is located on the right side in the drawing of the display device 1 in the image visually recognized by the user through the HMD 10.

  Further, even if the size of the first area AR1 is equal to or larger than the threshold value S1 (step S133: YES), if the size of the character information WD is equal to or larger than the threshold value S2 (step S134: NO), the controller 31 proceeds to step S136. . That is, in this case, since the character information WD is composed of a large number of characters, the controller 31 prevents the character information WD from being superimposed on the position where the display device 1 is visually recognized. For example, as shown in FIG. 13B, the character information WD is located on the right side of the display device 1 in the drawing in the image visually recognized by the user through the HMD 10.

  If the size of the first area AR1 is equal to or larger than the threshold value S1 (step S133: YES) and the size of the character information WD is equal to or smaller than the threshold value S2 (step S134: YES), the controller 31 proceeds to step S135. In other words, in this case, the controller 31 displays the character information WD so as to overlap the position where the display device 1 is visually recognized. Therefore, for example, as shown in FIG. 13C, the character information WD is located inside the display device 1 (display panel 8) in the image visually recognized by the user through the HMD 10.

  As described above, in the third embodiment, the position where the character information WD is displayed is changed according to the size of the display device 1 visually recognized by the user wearing the HMD 10 and the size of the character information WD. The character information WD can be visually recognized without obstructing the viewing of the display device by the user.

4). Other embodiments:
The HMD 10 may be for viewing a stereoscopic image. When the HMD 10 includes two camera units (the right-eye camera 21 and the left-eye camera 22), a right-eye peripheral image and a left-eye peripheral image with parallax can be acquired. Therefore, the character information WD may be stereoscopically viewed based on the parallax between the right eye peripheral image and the left eye peripheral image.

  The HMD 10 includes only two image generation units (the right-eye image generation unit 23 and the left-eye image generation unit 24). For example, the HMD 10 may include only one image generation unit and display the generated image light on both the right-eye display unit 11 and the left-eye display unit 12. In this case, in the present invention, the controller 31 performs the processing of the present invention only with the right peripheral image, the right eye detection image, and the right eye image, for example. Alternatively, the HMD 10 may include only one image generation unit and either the right-eye display unit 11 or the left-eye display unit 12.

  Furthermore, realizing the display area detection unit 34, the character area determination unit 35, and the display control unit 36 included in the controller 31 is merely an example. For example, the display area detection unit 34, the character area determination unit 35, and the display control unit 36 may be realized by hardware included in the controller 31.

Needless to say, the present invention is not limited to the above embodiments. It goes without saying for those skilled in the art,
・ Applying mutually interchangeable members and configurations disclosed in the above embodiments by appropriately changing the combination thereof.− Although not disclosed in the above embodiments, it is a publicly known technique and the above embodiments. The members and configurations that can be mutually replaced with the members and configurations disclosed in the above are appropriately replaced, and the combination is changed and applied. It is an embodiment of the present invention that a person skilled in the art can appropriately replace the members and configurations that can be assumed as substitutes for the members and configurations disclosed in the above-described embodiments, and change the combinations and apply them. It is disclosed as.

  DESCRIPTION OF SYMBOLS 1 ... Display apparatus, 2 ... Housing, 3 ... CPU, 4 ... ROM, 5 ... RAM, 6 ... Tuner, 7 ... Communication IF, 8 ... Display panel, 9 ... Bus, 10 ... Head mounted display (HMD), 11 ... Display unit for right eye, 12 ... Display unit for left eye, 13 ... Optical component for right eye, 14 ... Optical component for left eye, 20 ... Frame, 21 ... Camera for right eye, 22 ... Camera for left eye, 23 ... Right eye image generation unit, 24 ... Left eye image generation unit, 25 ... Operation unit, 30 ... Control unit, 31 ... Controller, 32 ... Video memory, 33 ... Communication IF, 34 ... Display area detection unit, 35 ... Character Area determination unit, 36 ... display control unit, 41 ... OS, 42 ... application, 100 ... viewing system

Claims (8)

A head mounted display having a transmissive display unit,
A receiving unit for receiving character information from the display device;
A camera unit that obtains, as image data, a map visually recognized by the user through the display unit;
A display area detector for detecting the position of the display device in the acquired image data as a first area;
A character region determination unit that determines a second region that is a position of the display unit that displays the received character information according to the detected first region;
A display control unit that causes the display unit to display the received character information in the determined second area. An operation unit that accepts an adjustment of the position or size of the character information displayed on the display unit from the user;
The head mounted display according to claim 1, wherein the display control unit changes the position or size of the character information displayed on the display unit according to the received adjustment.   The head-mounted display according to claim 1, wherein the character area determination unit determines a position of the second area inside the first area.   The head-mounted display according to claim 1, wherein the character area determination unit determines a position of the second area according to a size of the first area.   5. The head mounted display according to claim 4, wherein if the size of the first area is small, the character area determination unit determines the position of the second area outside the first area.   5. The head mounted display according to claim 4, wherein if the size of the character information is large, the character area determination unit determines the position of the second area outside the first area.   The head mounted display according to claim 1, wherein the display control unit causes the display unit to stereoscopically display the character information. A viewing system composed of a head-mounted display having a transmissive display unit and a display device that outputs character information to the head-mounted display,
The head mounted display is
A receiving unit for receiving character information from the display device;
A camera unit that obtains, as image data, a map visually recognized by the user through the display unit;
A display area detector for detecting the position of the display device in the acquired image data as a first area;
A character region determination unit that determines a second region that is a position of the display unit that displays the received character information according to the detected first region;
A viewing system, comprising: a display control unit that causes the display unit to display the received character information in the determined second region.

Images