JP2017016542A - Wearable display device, display control method, and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a wearable display device which displays specific information selected from multiple pieces of information, without input operation.SOLUTION: A wearable display device includes an imaging apparatus, a display unit, a determination unit, a selection unit, and a display control unit. On a display surface of the display unit, an image captured by an imaging apparatus is displayed. When multiple display information associated with a plurality of recognition objects included in an image is superimposed on the image, the determination unit determines overlap of the display information. When the determination unit determines overlap, the selection unit selects a recognition object closest to the center of the image. When the determination unit determines overlap, the display control unit displays an image formed by preferentially superimposing display information associated with the recognition object selected by the selection unit, on the display surface.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a wearable display device, a display control method, and a display control program.

  In recent years, a head-mounted display has been used as one of wearable devices. The head mounted display is a device worn on the user's head, and displays information on a display surface located in front of the user's eyes.

  In addition, a technique is used in which a marker included in an image captured by a camera is recognized, and information associated with the recognized marker is displayed superimposed on the image. This technology is also referred to as augmented reality (AR).

  As a related technique, there has been proposed a technique for presenting information about an object in a manner of presentation according to the distance between the viewpoint of the real world video and the object (see, for example, Patent Document 1).

International Publication No. 2010/073616

  In the augmented reality technology, when a plurality of markers are included in an image captured by a camera, a plurality of information associated with each marker may be displayed on the screen in an overlapping manner. In this case, some or all of the overlapping information is not displayed.

  A similar problem occurs when augmented reality technology is applied to a wearable display device such as a head-mounted display. In the case of a wearable display device that displays information on a display surface positioned in front of the user's eyes, it is difficult for the user to perform an input operation on the display surface positioned in front of the eyes. Therefore, when a plurality of augmented reality information is displayed on the display surface of the wearable display device, it is difficult to select specific information from the plurality of information.

  In one aspect, an object of the present invention is to provide a wearable display device that selects and displays specific information from a plurality of information without an input operation.

  In one aspect, the wearable display device includes an imaging device, a display, a determination unit, a selection unit, and a display control unit. An image photographed by the photographing apparatus is displayed on the display surface of the display. A determination part determines whether display information overlaps, when a plurality of display information matched with each of a plurality of recognition objects contained in an image is superimposed on an image. When it is determined that the determination unit overlaps, the selection unit selects a recognition object closest to the center of the image. When it is determined that the determination unit overlaps, the display control unit displays an image on which the display information associated with the recognition target selected by the selection unit is preferentially superimposed on the display surface.

  According to one aspect, it is possible to provide a wearable display device that selects and displays specific information from a plurality of information without an input operation.

It is a figure which shows an example of the external appearance of the head mounted display of embodiment. It is a figure which shows an example of the functional block of the head mounted display of embodiment. It is a figure which shows an example of communication with a head mounted display and a content server. It is a figure (example 1) which shows an example of the image of embodiment. It is a figure (the 2) which shows an example of the image of embodiment. It is a figure (the 3) which shows an example of the image of embodiment. It is a figure (the 4) which shows an example of the image of embodiment. It is a figure (the 5) which shows an example of the image of embodiment. It is FIG. (6) which shows an example of the image of embodiment. It is a flowchart which shows an example of the flow of the process of embodiment. It is a flowchart which shows an example of an overlap determination process. It is a figure which shows an example of content relevant information. It is a figure which shows an example of the relationship between a marker and a content area. It is a figure which shows an example with the case where two contents do not overlap in the X direction. It is a figure which shows an example with the case where two content does not overlap in the Y direction. It is a flowchart which shows an example of the overlap determination process which made two content object. It is a figure (the 1) which shows an example of the image of a 1st modification. It is FIG. (2) which shows an example of the image of a 1st modification. It is FIG. (3) which shows an example of the image of a 1st modification. It is FIG. (4) which shows an example of the image of a 1st modification. It is a flowchart which shows an example of the flow of a process of a 1st modification. It is a figure (the 1) which shows an example of the image of a 2nd modification. It is a flowchart which shows an example of the flow of a process of a 1st modification. It is FIG. (2) which shows an example of the image of a 2nd modification. It is a figure which shows an example of the hardware constitutions of a head mounted display.

  In augmented reality technology, when a plurality of markers are included in an image captured by the imaging device, a plurality of display information associated with each marker is displayed in an overlapping manner, and a part or all of the overlapping display information is displayed. It may disappear.

  Of the overlapping display information, when the user (user) wants to display specific display information, the user may select specific display information. For example, when augmented reality technology is applied to a tablet terminal, a smartphone, or the like, the user can easily perform an input operation to select specific display information.

  For example, in the case of a tablet terminal, the user touches specific display information among the overlapping display information displayed on the screen of the tablet terminal using a touch pen or the like. By performing this input operation, specific display information that the user wants to display is easily selected from the overlapped display information. In this case, specific display information selected by the user is displayed on the screen of the tablet terminal.

  On the other hand, in the case of a wearable display device in which the display surface is positioned in front of the user's eyes, such as a head-mounted display, unlike the tablet terminal, the user performs some input operation (for example, input using a touch pen or the like) Operation) is difficult.

  Therefore, when it is determined that the wearable display device of the following embodiment includes a plurality of markers in an image captured by the image capturing device and a plurality of display information associated with the markers is displayed, Select the marker closest to the center of the image. Then, an image in which display information associated with the selected marker is preferentially superimposed is displayed on the display surface.

  Thereby, even if it is a case where a plurality of markers are included in the image photographed by the photographing apparatus and a plurality of display information associated with the markers are displayed, even if no input operation is performed, A specific marker is automatically selected.

  Therefore, even if the display device is a head-mounted display that is difficult for the user to perform an input operation for selecting display information using a touch pen or the like, specific display information is automatically selected without an input operation. Then, specific display information is displayed on the display surface.

  Hereinafter, with reference to the drawings, a wearable display device according to an embodiment will be described. The wearable display device according to the embodiment is a display device that is worn on any part of the user's body. Further, the wearable display device displays display information on a display surface located in front of the user's eyes.

  The wearable display device is provided with a photographing device. The wearable display device according to the embodiment superimposes display information on an image captured by a photographing device, and displays an image on which the display information is superimposed on a display surface.

  In the embodiment, the display information superimposed on the image is augmented reality information. Thereby, the wearable display device presents the user with an image in which predetermined augmented reality information is superimposed on the image captured by the image capturing device.

  It is assumed that the display surface of the wearable display device of the embodiment does not have a function of accepting an input operation. Hereinafter, it is assumed that the wearable display device of the embodiment is a head-mounted display that is worn on a user's head.

  However, the wearable display device is not limited to a head mounted display worn on the user's head. The wearable display device may be worn on any part of the user's body.

<Example of appearance of head mounted display>
FIG. 1 shows an example of a head mounted display 1 of the embodiment. The head mounted display 1 includes a camera 2, a display control device 3, and a display unit 4. The appearance of the head mounted display 1 is not limited to the example of FIG.

  The camera 2 is a photographing device provided in the head mounted display 1. The display control device 3 is a computer that performs a predetermined process on the image captured by the camera 2 and performs control to display the image on the display surface 4 </ b> A of the display unit 4. In the example of FIG. 1, the display control device 3 is built in the head mounted display 1.

  The display surface 4A of the head mounted display 1 is located in front of the user's eyes and presents various display information to the user. For example, the head mounted display 1 may have an adjustment mechanism that adjusts the position of the display unit 4.

  In the embodiment, when the user wears the head mounted display 1 on the head and the display surface 4A is positioned in front of one eye of the user, the viewing direction of the camera 2 and the viewing direction of the user coincide with each other. Shall.

  Thereby, the image displayed on the display surface 4A is an image obtained by photographing the same direction as the visual field direction of the user. However, the viewing direction of the camera 2 and the viewing direction of the user may be different. In this case, the direction in which the user visually recognizes with one eye is different from the viewing direction of the camera 2.

  The display surface 4A is located in front of one eye of the user and displays an image captured by the camera 2. Therefore, when the visual field direction of the camera 2 and the visual field direction of the user are different, an image in a direction different from the visual field direction of the user's one eye is displayed on the display surface 4A. For this reason, it is preferable that the visual field direction of a user and the visual field direction of the camera 2 correspond.

  Since the display surface 4A is located in front of one eye of the user, it is difficult for the user to perform an input operation on the display surface 4A. Further, it is assumed that the display surface 4A of the embodiment does not have an input function like a touch panel display.

  Although FIG. 1 shows an example of a one-eye type head mounted display 1, the head mounted display 1 may be a binocular type. The display surface 4A may be transmissive or non-transmissive.

<Example of functional block of head mounted display>
FIG. 2 shows an example of functional blocks of the head mounted display 1. The head mounted display 1 includes a camera 2, a display control device 3, and a display unit 4. An image captured by the camera 2 is displayed on the display surface 4 </ b> A of the display unit 4.

  The display control device 3 according to the embodiment, when an image captured by the camera 2 includes a marker (also referred to as an AR marker) for displaying augmented reality information, a marker (for example, a graphic such as a barcode) ) Is superposed on the image. A marker is an example of a recognition object.

  Augmented reality information is information that is superimposed on an image captured by the camera 2. The augmented reality information may be arbitrary information such as character information, a pattern, and a pattern. Hereinafter, augmented reality information is referred to as content. Content is an example of display information superimposed on an image.

  The display control device 3 recognizes the marker in the image captured by the camera 2. When a plurality of markers are included in the recognized image, the display control device 3 determines whether any content overlaps with other content when the contents respectively associated with the plurality of markers are superimposed on the image. judge.

  If the display control device 3 determines that the content overlaps, the display control device 3 selects the marker closest to the center of the image, and performs control so that the content associated with the selected marker is displayed on the display surface 4A.

  If the display control device 3 determines that the content overlaps, the display control device 3 selects the marker closest to the center of the image and preferentially superimposes the content associated with the selected marker on the image. In the embodiment, the display control device 3 preferentially superimposes the content on the image by superimposing only the content associated with the selected marker on the image. And the display control apparatus 3 performs control which displays the image on which only the selected content was superimposed on the display surface 4A.

  The display control device 3 includes an image input unit 11, a marker recognition unit 12, a calculation unit 13, a determination unit 14, a selection unit 15, a storage unit 16, a communication unit 17, and a display control unit 18. An image (image data) captured by the camera 2 is input to the image input unit 11.

  In the embodiment, an image captured by the camera 2 at a predetermined frame rate is input to the image input unit 11. In this case, the display control device 3 performs control to display a moving image on the display surface 4A. A still image may be displayed on the display surface 4A.

  The marker recognition unit 12 recognizes a marker included in the image when the image input to the image input unit 11 includes a marker. The marker recognizing unit 12 recognizes a marker included in the image, for example, by performing image processing on the input image. An image may include a plurality of markers. In this case, the marker recognition unit 12 recognizes a plurality of markers included in the image.

  The calculation unit 13 performs various calculations. For example, the calculation unit 13 calculates the distance between the marker included in the image and the center of the image. When the image includes a plurality of markers, the calculation unit 13 calculates the distance between each of the plurality of markers and the center of the image.

  In the embodiment, it is assumed that the position in the image is expressed in the XY coordinate system, and the calculation unit 13 calculates the distance between the coordinates of the center of the image and the coordinates of the marker.

  When the image includes a plurality of markers, when the content associated with each of the plurality of markers is superimposed on the image, the determination unit 14 determines which one of the plurality of contents overlaps with the other content. Determine whether or not.

  The content is superimposed on a relative position based on the position of the marker in the image. Hereinafter, an area assigned to content superimposed on an image is referred to as a content area. The determination unit 14 determines whether content overlaps based on whether the content areas overlap.

  When the determination unit 14 determines that the contents overlap, the selection unit 15 selects the marker closest to the center of the angle of view of the camera 2 (the center of the image). The selection unit 15 outputs information on the selected marker to the display control unit 18.

  The memory | storage part 16 memorize | stores the content relevant information regarding a marker and a content. The content related information stores a correspondence relationship between a marker ID for identifying a marker and a content ID for identifying the content. ID is an abbreviation for Identification.

  In addition, the storage unit 16 stores a correspondence relationship between the content ID and the size of the content area. In addition, the storage unit 16 stores a correspondence relationship between content IDs and content details (hereinafter referred to as content data).

  The communication unit 17 communicates with a device external to the head mounted display 1. For example, the communication unit 17 may acquire (download) various types of information from an external server by communicating with the external server.

  The display control unit 18 performs display control of an image displayed on the display surface 4 </ b> A of the display unit 4. For example, when the image captured by the camera 2 does not include a marker, the display control unit 18 performs control to display an image that does not include content on the display surface 4 </ b> A of the display unit 4.

  When there is one marker included in the image captured by the camera 2, the display control unit 18 superimposes the content associated with the marker on the image captured by the camera 2. Then, the display control unit 18 performs control to display the image with the content superimposed on the display surface 4 </ b> A of the display unit 4.

  When the image captured by the camera 2 includes a plurality of markers, the display control unit 18 superimposes the content on the image by a different method according to the determination result of the determination unit 14.

  When the determination unit 14 determines that none of the contents overlaps with other contents, the display control unit 18 superimposes each content on the image. The display control unit 18 performs control to display an image on which each content is superimposed on the display surface 4 </ b> A of the display unit 4.

  When the determination unit 14 determines that any one of the contents overlaps with another content, the display control unit 18 superimposes the content associated with the marker selected by the selection unit 15 on the image. That is, the display control unit 18 superimposes only the content associated with the marker closest to the center of the image on the image. In this case, only the content associated with the marker closest to the center of the image is displayed on the display surface 4A.

<Example of content acquisition>
FIG. 3 shows an example in which the head mounted display 1 acquires content from the content server 20. The storage unit 16 stores the content related information described above. The communication unit 17 communicates with the content server 20 and acquires (downloads) content-related information from the content server 20.

  For example, it is assumed that the user wearing the head mounted display 1 is engaged in work at the work site. In this case, the content server 20 may be installed for each work site. In addition, the content server 20 stores content related information of all markers present at the work site.

  The communication unit 17 of the head mounted display 1 downloads content related information from the content server 20 in advance. Thereby, the memory | storage part 16 memorize | stores the content relevant information matched with the marker which exists in a work site.

  FIG. 3 shows an example in which the communication unit 17 communicates with the content server 20 and the storage unit 16 stores the content related information. However, an example in which the head mounted display 1 stores the content related information is shown in FIG. It is not limited.

  For example, a semiconductor memory that stores content-related information may be connected to the head mounted display 1. In this case, the display control device 3 may acquire the content related information from the semiconductor memory connected to the head mounted display 1.

<Examples of various images>
Next, examples of various images will be described. FIG. 4 shows an example of an image 30 input from the camera 2 to the image input unit 11. This image 30 shows a state in which no content is superimposed. The origin 40 indicates a point where the X coordinate and the Y coordinate are zero when the position in the image is represented by the XY coordinate. In the embodiment, the origin 40 is set at the corner of the image 30.

  In the example of FIG. 4, the angle of view of the camera 2 includes six pipes D1 to D6. The pipes D1 to D6 may be collectively referred to as a pipe D. The number of pipes D is not limited to six.

  Valves B1 to B6 are attached to the pipes D1 to D6. The valves B1 to B6 may be collectively referred to as a valve B. Markers M1 to M6 are attached in the vicinity of the valves B1 to B6. The markers M1 to M6 may be collectively referred to as a marker M. In the embodiment, the valve B and the marker M are provided for each pipe D.

  FIG. 5 shows an example of an image 30 when all the contents C1 to C6 associated with the markers M1 to M6 are superimposed. The contents C1 to C6 may be collectively referred to as contents C.

  FIG. 5 shows an example in which the content C is a balloon including character information. The content C is not limited to an example of a balloon including character information. The character information indicates how to open and close the valve B of the pipe D to which the marker M is attached.

  For example, as shown in the example of FIG. 5, when the contents C1 to C6 are superimposed on the image 30, the image 30 in which the contents C overlap each other is displayed on the display surface 4A. In this case, part or all of the information of each content C is not displayed on the display surface 4A.

  For example, when the user performs the opening / closing operation of the valve B4, it is desirable that the content C4 indicating the opening / closing procedure of the valve B4 is displayed on the display surface 4A. However, in the example shown in FIG. 5, the content C5 is displayed so as to cover part of the content C4. That is, the content C4 is not displayed to the extent that the content (how to open and close) is recognized.

  In this case, it is difficult for the user to recognize the opening / closing procedure of the valve B4 based on the content C4. Here, when an input operation is possible on the display surface 4A, an operation for selecting the content C4 is performed on the image 30 displayed on the display surface 4A, whereby the content C4 is displayed on the display surface 4A in an easy-to-read manner. Can be made.

  However, since the display surface 4A is positioned in front of the user's eyes, it is difficult for the user to perform an operation of selecting the content C4 on the display surface 4A. Further, the display surface 4A of the embodiment does not have an input function like a touch panel, unlike a tablet terminal or a smartphone.

  Therefore, when the determination unit 14 determines that the content C overlaps when a plurality of contents C are superimposed on the image, the selection unit 15 selects the marker M closest to the center of the angle of view of the camera 2 (that is, the center of the image 30). Select. FIG. 6 shows an example of the distance between the center 41 of the image 30 and each marker M. Among the markers M, the marker M closest to the center 41 is the marker M4.

  Accordingly, the selection unit 15 selects the marker M4. The display control unit 18 refers to the content related information associated with the marker M4 among the content related information stored in the storage unit 16. The display control unit 18 specifies a content region corresponding to the content C4 selected by the selection unit 15 based on the recognized content related information.

  The display control unit 18 superimposes the content data of the content C4 on the content area of the content C4 of the image 30. In the embodiment, the display control unit 18 superimposes only the content C4 associated with the marker M4 selected by the selection unit 15 on the image 30. Then, the display control unit 18 displays the image 30 on which the content C4 is superimposed on the display surface 4A.

  FIG. 7 shows an example of an image 30 on which only the content C4 is superimposed. In the embodiment, the image 30 of FIG. 7 is displayed on the display surface 4A. As described above, when the user wears the head mounted display 1 on the head and the display surface 4A is positioned in front of one eye of the user, the viewing direction of the camera 2 is the viewing direction of the user. In the same direction.

  Therefore, when the user visually recognizes the target valve B4, there is a high possibility that the marker M4 is located at the center of the angle of view of the camera 2. The display control unit 18 superimposes only the content C4 associated with the marker M4 selected by the selection unit 15 on the image 30, and displays the image 30 on which only the content C4 is superimposed on the display surface 4A.

  For this reason, the image on which the content C4 is superimposed is displayed on the display surface 4A without the user performing an operation of selecting the content C4. Thereby, the user can recognize the content C4 indicating the opening and closing procedure of the target valve B4.

  As described above, when the determination unit 14 determines that the content C overlaps, the selection unit 15 selects the marker M closest to the center 41 of the image 30, and the display control unit 18 is associated with the selected marker M. Only the content C is superimposed on the image 30.

  Then, the display control unit 18 displays the image 30 on which only the content C associated with the selected marker M is superimposed on the display surface 4A. As a result, the content C associated with the selected marker M is preferentially displayed on the display surface 4A.

  For this reason, when the user brings the center of the angle of view of the camera 2 provided in the head mounted display 1 close to the marker M associated with the desired content C, only the desired content C is superimposed on the display surface 4A. The displayed image is displayed. The desired content C is specific content intended by the user.

  FIG. 8 shows an example of an image 30 on which only the content C3 indicating the opening and closing procedure of the valve B3 of the pipe D3 is superimposed. In this case, the user brings the center of the angle of view of the camera 2 provided in the head mounted display 1 closer to the marker M3 associated with the content C3.

  For example, the user visually recognizes the pipe D3 to which the marker M3 is attached. Thereby, the center of the angle of view of the camera 2 approaches the marker M3 associated with the content C3. When the marker M closest to the center of the angle of view of the camera 2 (the center of the image 30) becomes the marker M3, the selection unit 15 selects the marker M3.

  In this case, the display control unit 18 superimposes only the content C3 associated with the marker M3 on the image 30, and displays the image 30 on which only the content C3 is superimposed on the display surface 4A. Thereby, the user can visually recognize the content C3 indicating the opening and closing procedure of the valve B3 without performing an input operation.

  The above processing is performed when the determination unit 14 determines that any content C among the plurality of contents C is overlapped when the content C is superimposed on the image 30.

  Therefore, even if a plurality of contents C are superimposed on the image 30, if the determination unit 14 determines that the contents C do not overlap, the display control unit 18 directly superimposes each content C on the image 30.

  For example, FIG. 9 shows an example in which the image 30 includes markers M1, M4, and M6. Then, in the image 30, the determination unit 14 determines that the content C1 associated with the marker M1, the content C4 associated with the marker M4, and the content C6 associated with the marker M6 do not overlap each other. .

  In this case, the display control unit 18 superimposes the contents C1, C4, and C6 on the image 30, and controls the image 30 on which the contents C are superimposed on the display surface 4A. Accordingly, as in the example of FIG. 9, each content C is displayed on the display surface 4A.

<Flowchart of Embodiment>
Next, a flowchart of the embodiment will be described. As described above, the camera 2 provided in the head mounted display 1 mounted on the user's head shoots the same direction as the user's visual field direction.

  An image 30 captured by the camera 2 is input to the image input unit 11 (step S1). In the embodiment, the image 30 is input from the camera 2 to the image input unit 11 at every predetermined frame rate. Each time the image 30 is input from the camera 2 to the image input unit 11, the following processing is performed.

  The marker recognition unit 12 determines whether or not the marker M is included in the image 30 input to the image input unit 11 (step S2). When the marker recognition unit 12 does not recognize the marker M (NO in step S2), the display control unit 18 displays the image 30 that does not include the content C on the display surface 4A (step S3). Then, the process ends.

  When the marker recognizing unit 12 recognizes the marker M (YES in step S2), the marker recognizing unit 12 determines whether or not the image 30 includes a plurality of markers M (step S4). When the marker recognizing unit 12 determines that a plurality of markers M are not included in the image 30 (NO in step S4), since step S2 is YES, the number of markers M included in the image 30 is one.

  In this case, one marker M is included in the angle of view of the camera 2. Therefore, since the number of markers M included in the image 30 is one, the number of contents C is also one. The display control unit 18 superimposes one content C associated with one recognized marker M on the image 30. The display control unit 18 displays the image 30 on which one content C is superimposed on the display surface 4A (step S5). Then, the process ends.

  When the marker recognizing unit 12 determines that a plurality of markers M are included in the image 30 (YES in step S4), the plurality of markers M are included within the angle of view of the camera 2. In this case, the image 30 includes a plurality of markers M.

  The determination unit 14 performs content overlap determination processing for determining whether any content C among the content C associated with each of the plurality of markers M overlaps with other content C (step S6). Details of the overlap determination process will be described later with reference to FIG.

  If the determination unit 14 determines that none of the content C associated with each of the plurality of markers M overlaps with the other content C (NO in step S7), the display control unit 18 C is superimposed on the image 30. Then, the display control unit 18 displays the image 30 on which the contents C are superimposed on the display surface 4A (step S8). After step S8, the process ends.

  When the determination unit 14 determines that any content C among the content C associated with each of the plurality of markers M overlaps with the other content C (YES in step S7), the calculation unit 13 Center coordinates are calculated (step S9). The center of the image 30 is the center of the angle of view of the camera 2.

  The calculator 13 calculates the distance between the center 41 of the image 30 and the marker M (step S10). Here, since step S10 is executed when YES in step S4, the image 30 includes a plurality of markers M. Therefore, the calculation unit 13 calculates the distance between the center 41 of the image 30 and the plurality of markers M, respectively.

  In the embodiment, the center 41 of the image 30 and the position of the marker M are expressed in the XY coordinate system. In this case, the calculation unit 13 calculates the distance between the center coordinates of the image 30 and the coordinates of the plurality of markers M.

  The selection unit 15 selects the marker M having the shortest distance among the distances calculated by the calculation unit 13, that is, the marker M closest to the center 41 of the image 30 (step S11). The display control unit 18 superimposes only the content C associated with the marker M selected by the selection unit 15 on the image 30 (step S12).

  Then, the display control unit 18 displays the image 30 on which only the content C is superimposed on the display surface 4A (step S13). As a result, an image 30 on which only the content C associated with the marker M closest to the center of the angle of view of the camera 2 is superimposed is displayed on the display surface 4A. That is, an image on which the content C associated with the marker M selected by the selection unit 15 is displayed is displayed on the display surface 4A.

  Next, the content overlap determination process in step S6 will be described with reference to FIG. The content overlap determination process in step S6 is performed when the image 30 includes a plurality of markers M.

  The determination unit 14, when the two contents C targeted for the two contents C among the contents C respectively associated with the plurality of markers M are superimposed on the image 30, the two superimposed contents C It is determined whether or not they overlap each other.

  When the number of contents C included in the image 30 is three or more, the determination unit 14 determines whether or not the two contents C overlap for all combinations while changing the combination of the two contents C.

  However, if the determination unit 14 determines that the two contents C overlap, the content overlap determination process is terminated at that time, and the process is based on the assumption that the contents C overlap (step S9 in FIG. 10). Subsequent processing) is started.

  In the example of FIG. 11, the determination unit 14 uses natural numbers N and n to identify all combinations of two contents C among the plurality of contents C included in the image 30. N is used to specify the content C to be compared. n is used to specify the content C for which it is determined whether or not it overlaps with the content C to be compared.

  First, the determination unit 14 sets 1 to N and 1 to n (step S21). Then, the determination unit 14 determines whether or not the Nth content C and the (N + n) th content C overlap (step S22).

  As described above, in the embodiment, the position in the image 30 is expressed in the XY coordinate system. The content C associated with the marker M closest to the origin 40 of the XY coordinate system is set as the first content C. Further, it is assumed that the number of the content C increases as the marker M moves away from the origin 40.

  First, the determination unit 14 sets 1 to N and 1 to n. Therefore, the determination unit 14 determines whether or not the content C associated with the marker M closest to the origin 40 and the content C associated with the next closest marker M overlap.

  When the determination unit 14 determines that the Nth content C and the (N + n) th content C overlap as a result of the determination in step S22 (YES in step S23), the determination unit 14 determines that the content C overlaps. (Step S24). In this case, the content overlap determination process ends.

  The marker recognition unit 12 recognizes the number of markers M included in the image 30. The number of markers M included in the image is a natural number MAX. The number of contents C is MAX. If the determination unit 14 determines in step S22 that the Nth content C and the (N + n) th content C do not overlap (NO in step S23), the determination unit 14 determines whether (N + n) has reached MAX. It is determined whether or not (step S25).

  When (N + n) has not reached MAX (NO in step S25), the determination unit 14 increments n (step S26). Then, the process returns to step S22.

  When (N + n) has reached MAX (YES in step S25), the determination unit 14 determines whether N has reached MAX (step S27). As described above, the determination unit 14 determines whether there is an overlap between the two combined contents C while changing the combination of the two contents C.

  For example, assume that the number of markers M included in the image is six. In this case, MAX is 6. In step S <b> 21, the determination unit 14 sets 1 to N. Accordingly, the determination unit 14 sequentially determines whether or not the content C associated with the marker M closest to the origin 40 and the remaining five content C overlap each other.

  As a result, if the determination in step S23 is NO and the determination in step S25 is YES, the determination unit 14 determines that there is no content C overlapping the content C associated with the marker M closest to the origin 40. To do. In this case, the determination unit 14 sequentially determines whether or not the content C associated with the marker M closest to the origin 40 and the third and subsequent content C overlap each other.

  As described above, the determination unit 14 determines whether N has reached MAX. If the determination unit 14 determines that N has not reached MAX (NO in step S27), N is incremented and 1 is set to n (step S28).

  Then, the process returns to step S22. The determination unit 14 repeatedly performs the processes in steps S22 to S26. When N reaches MAX (YES in step S27), the determination unit 14 determines that the two contents C do not overlap for all combinations of the two contents C among the plurality of contents C.

  For this reason, the determination unit 14 determines that none of the contents C included in the image 30 overlaps with the other contents C (step S29). On the other hand, when the determination in step S <b> 23 is YES, the determination unit 14 determines that any one of the contents C included in the image 30 overlaps with the other contents C.

  Next, the overlap determination process for two contents (Nth content C and (N + n) th content) in step S22 will be described. The position, size, and the like of the content C associated with the marker M may be the same or different.

  Accordingly, the determination unit 14 determines whether or not the Nth content C and the (N + n) th content C overlap each other based on the position, size, and the like of the content C superimposed on the image 30.

  FIG. 12 shows an example of content-related information stored in the storage unit 16. FIG. 12A is an example showing the correspondence between the marker ID and the content ID in a table format. This table associates the marker M with the content C. In the table in the example of FIG. 12A, the content ID, the X coordinate relative position, and the Y coordinate relative position are associated with the marker ID.

  The X coordinate relative position and the Y coordinate relative position will be described. The display control unit 18 superimposes the content C on the image 30 with a predetermined relative position based on the position of the marker M as a starting point. In the embodiment, the display control unit 18 superimposes the content C on the image 30 from the relative position of the X coordinate and the Y coordinate based on the center of the marker M, based on the table of FIG.

  The X coordinate relative position is a position indicating the start point of the content area in the X direction when the center of the marker M is used as a reference. The Y coordinate relative position is a position indicating the start point of the content area in the Y direction when the center of the marker M is used as a reference.

  FIG. 12B is an example showing the correspondence relationship between the content ID and the content size (X direction size and Y direction size) in a table format. The display control unit 18 superimposes the content C on an area defined by the X-direction size and the Y-direction size corresponding to the content ID, starting from the position specified by the X-coordinate relative position and the Y-coordinate relative position. This area is the content area described above.

  FIG. 12C is an example showing the correspondence between content IDs and content data in a table format. The display control unit 18 superimposes the content data associated with the content ID on the content area in the image 30.

  Each table in FIG. 12 may be one table. For example, the storage unit 16 may store a table in which information of items in each table in FIG. 12 is associated using the marker ID as a key.

  FIG. 13 is a diagram illustrating an example of the relationship between the marker M and the content area of the content C associated with the marker M. In the example of FIG. 13, the X coordinate at the center of the marker M is the marker X coordinate, and the Y coordinate at the center of the marker M is the marker Y coordinate. Note that the marker X coordinate and the marker Y coordinate may not be the center of the marker M.

  When the marker recognizing unit 12 recognizes the marker M included in the image 30, the display control unit 18 sets the X associated with the marker M recognized by the marker recognizing unit 12 in the table stored in the storage unit 16. Refer to the coordinate relative position and the Y coordinate relative position.

  The X coordinate relative position is the X coordinate of the start point of the content C with reference to the marker X coordinate (hereinafter referred to as the content start point X coordinate). The Y coordinate relative position is the Y coordinate of the start point of the content C with the marker Y coordinate as a reference (hereinafter referred to as the content start point Y coordinate).

  The display control unit 18 refers to the X direction size and the Y direction size of the content C among the tables stored in the storage unit 16. The content distance X coordinate in the X direction from the content start point X coordinate is set as the content end point X coordinate. In addition, a coordinate that is distant from the content start point Y coordinate in the Y direction in the Y direction is set as a content end point Y coordinate.

  Therefore, the content area is defined by the content start point X coordinate, the content start point Y coordinate, the content end point X coordinate, and the content end point Y coordinate. When superimposing the content C, the display control unit 18 superimposes the content data associated with the content ID on the content area of the image.

  In the example of FIG. 13, the marker M and the content area where the content C is superimposed are separated. Therefore, the display control unit 18 couples the marker instruction unit P that connects the content C and the marker M to the content C. Hereinafter, when the content C is superimposed on the image 30, the display control unit 18 also superimposes the marker instruction unit P on the image 30 together with the content C.

  FIG. 14A illustrates an example in which the content C4 and the content C5 overlap in the X direction. FIG. 14B illustrates an example of the case where the content C4 and the content C5 do not overlap in the X direction.

  In the case of FIG. 14A, the content start point X coordinate of the content C5 is closer to the origin 40 than the content end point X coordinate of the content C4. Accordingly, the coordinate value of the content end point X coordinate of the content C4 is larger than the coordinate value of the content start point X coordinate of the content C5.

  In this case, the content area of the content C4 and the content area of the content C5 overlap in the X direction. Therefore, the determination unit 14 determines that the content C4 and the content C5 overlap in the X direction.

  Here, in the example of FIGS. 14A and 14B, when attention is paid only to the Y direction, the content C4 and the content C5 are in a relationship in which the content areas overlap each other. In this case, in the example of FIG. 14A, the determination unit 14 determines that the content C4 and the content C5 overlap each other in the X direction and the Y direction.

  In the embodiment, when the content areas of the two contents C overlap in the two directions of the X direction and the Y direction, the determination unit 14 determines that the two contents C overlap. If the content areas of the two contents C do not overlap in either the X direction or the Y direction, the determination unit 14 determines that the two contents C do not overlap.

  Therefore, in the case of FIG. 14A, since the content areas of the content C4 and the content C5 overlap in the X direction and the Y direction, the determination unit 14 determines that the content C4 and the content C5 overlap.

  The interval between the marker M4 and the marker M5 in FIG. 14B is longer than the interval between the marker M4 and the marker M5 in FIG. In the case of FIG. 14B, the content end point X coordinate of the content C4 is closer to the origin 40 than the content start point X coordinate of the content C5.

  Therefore, the coordinate value of the content start point X coordinate of the content C5 is larger than the coordinate value of the content end point X coordinate of the content C4. In this case, the content area of the content C4 and the content area of the content C5 do not overlap in the X direction.

  The determination unit 14 determines that the content C4 and the content C5 do not overlap in the X direction. Therefore, in the example of FIG. 14B, the determination unit 14 determines that the content C4 and the content C5 do not overlap.

  FIG. 15A illustrates an example in which the content C4 and the content C5 overlap in the Y direction. FIG. 15B illustrates an example in which the content C4 and the content C5 do not overlap in the Y direction.

  Here, in the example of FIGS. 15A and 15B, when attention is paid only to the X direction, the content C4 and the content C5 have a relationship in which the content areas overlap.

  As in the case of the X direction described above, when the content areas of the two contents C overlap in the two directions of the X direction and the Y direction, the determination unit 14 determines that the two contents C overlap. If the content areas of the two contents C do not overlap in either the X direction or the Y direction, the determination unit 14 determines that the two contents C do not overlap.

  In the case of FIG. 15A, the coordinate value of the content end point Y coordinate of the content C4 is larger than the coordinate value of the content start point Y coordinate of the content C5. In this case, since the content area of the content C4 and the content area of the content C5 overlap, the determination unit 14 determines that the content C4 and the content C5 overlap in the Y direction.

  In this case, the determination unit 14 determines that the content C4 and the content C5 overlap in the X direction and the Y direction. Therefore, the determination unit 14 determines that the content C4 and the content C5 overlap.

  In the case of FIG. 15B, the coordinate value of the content start point Y coordinate of the content C5 is larger than the coordinate value of the content end point Y coordinate of the content C4. In this case, the content area of the content C4 and the content area of the content C5 do not overlap. Therefore, the determination unit 14 determines that the content C4 and the content C5 do not overlap in the Y direction.

  In this case, the determination unit 14 determines that the content C4 and the content C5 do not overlap in the Y direction. Therefore, the determination unit 14 determines that the content C4 and the content C5 do not overlap.

  FIG. 16 is a flowchart illustrating an example of content overlap determination processing in step S22 of FIG. Hereinafter, the content start point X coordinate is referred to as a start point X coordinate, the content end point X coordinate is referred to as an end point X coordinate, the content start point Y coordinate is referred to as a start point Y coordinate, and the content end point Y coordinate is referred to as an end point Y coordinate.

  The determination unit 14 compares the coordinate values of the end point X coordinate of the Nth content C and the start point X coordinate of the (N + n) th content C (step S31). The determination unit 14 performs the following processing according to the comparison result.

  When the coordinate value of the end point X coordinate of the Nth content C is less than the coordinate value of the start point X coordinate of the (N + n) th content C (NO in step S32), the Nth content C and (N + n) in the X direction The content area does not overlap with the second content C.

  In this case, the determination unit 14 determines that the Nth content C and the (N + n) th content C do not overlap (step S33).

  When the coordinate value of the end point X coordinate of the Nth content C is equal to or greater than the coordinate value of the start point X coordinate of the (N + n) th content C (YES in step S32), the Nth content C and (N + n) in the X direction. The content area overlaps with the second content C.

  In this case, the determination unit 14 compares the coordinate values of the end point Y coordinate of the Nth content C and the start point Y coordinate of the (N + n) th content C (step S34). The determination unit 14 performs the following processing according to the comparison result.

  When the coordinate value of the end point Y coordinate of the Nth content C is less than the coordinate value of the start point Y coordinate of the (N + n) th content C (NO in step S35), the Nth content C and (N + n) in the Y direction. The content area does not overlap with the second content C.

  In this case, the determination unit 14 determines that the Nth content C and the (N + n) th content C do not overlap (step S36).

  When the coordinate value of the end point Y coordinate of the Nth content C is equal to or greater than the coordinate value of the start point Y coordinate of the (N + n) th content C (YES in step S35), the Nth content C and (N + n) in the Y direction. The content area overlaps with the second content C.

  In this case, the Nth content C and the (N + n) th content C overlap in the content area both in the X direction and in the Y direction. Therefore, the determination unit 14 determines that the Nth content C and the (N + n) th content C overlap (step S37).

  The determination unit 14 determines whether or not the Nth content C and the (N + n) th content C overlap by performing the above processing.

  As described above, the determination unit 14 changes the values of N and n to determine that the content C associated with each marker M included in the image 30 overlaps the content C for all combinations. It is determined whether or not.

  When the determination unit 14 determines that none of the content C included in the image 30 overlaps with the other content C, the display control unit 18 displays the content C associated with the plurality of markers M. Is superimposed on the image 30. The display control unit 18 displays the image 30 on which the plurality of contents C are superimposed on the display surface 4A.

  When the determination unit 14 determines that any one of the content C included in the image 30 overlaps the other content C, the selection unit 15 selects the marker M closest to the center of the image 30. .

  The display control unit 18 superimposes only the content C associated with the marker M selected by the selection unit 15 on the image 30, and displays the image 30 on which only the selected content C is superimposed on the display surface 4A.

  Therefore, when a plurality of contents C are superimposed on the image 30, even if the contents C overlap, the user does not perform an input operation, and the image in which the specific content C is displayed among the plurality of contents C. 30 can be visually recognized on the display surface 4A.

<First Modification>
Next, a first modification will be described. In the first modification, the determination unit 14 determines whether or not the marker M included in a predetermined range (hereinafter referred to as a target range) overlaps from the center 41 of the image 30 instead of the entire range of the image 30.

  FIG. 17 shows an example of a target range 43 to be determined by the determination unit 14 in the image 30. The target range 43 may be an arbitrary range. In the embodiment, it is assumed that the target range 43 is set in the determination unit 14 in advance.

  In the case of the example of FIG. 17, the markers M <b> 2 to M <b> 5 are included in the target range 43. Therefore, since the markers M1 and M6 are not included in the target range 43, the content C1 and the content C6 are not subject to determination by the determination unit 14.

  The determination unit 14 determines whether the contents C2 to C5 associated with the markers M2 to M5 overlap. In the example of FIG. 18, the determination unit 14 determines that all the contents C of the contents C2 to C5 overlap.

  The method by which the determination unit 14 determines whether or not the content C overlaps is the same as in the above-described embodiment. In the first modification, the determination unit 14 determines whether the content C overlaps by focusing on the marker M included in the target range 43.

  In the above-described embodiment, the determination unit 14 determines the overlap of the content C with respect to the marker M included in the entire range of the image 30. As shown in the example of FIG. 18, the number of markers M included in the image 30 is six. Therefore, the above-mentioned MAX is 6.

  Therefore, in the above-described embodiment, the determination unit 14 determines whether the content C overlaps for all combinations of the two contents C among the six contents C until it is determined that the two target contents C overlap. .

  On the other hand, in the first modification, the determination unit 14 sets the contents C2 to C5 associated with the four markers M2 to M5 included in the target range 43 as determination targets. Therefore, the determination unit 14 narrows the determination target to the four contents C, and performs overlapping determination of the contents C until it is determined that the two target contents C overlap.

  For this reason, compared with the case of embodiment, in the 1st modification, the frequency | count of the determination process which the determination part 14 performs decreases. Since the amount of processing performed by the determination unit 14 is reduced, the time required for determining the overlap of the content C is shortened.

  When the determination unit 14 determines that the content C overlaps within the range of the target range 43, the calculation unit 13 calculates the distance between the center 41 of the image 30 and the markers M2 to M5. In the case of the example of FIG. 19, since the marker M closest to the center 41 of the image 30 is the marker M4, the selection unit 15 selects the marker M4.

  The display control unit 18 superimposes only the content C4 associated with the marker M4 selected by the selection unit 15 on the image 30. In the first modification, the display control unit 18 superimposes the center specifying graphic 44 and the target range frame 45 on the image 30.

  FIG. 20 shows an example of an image 30 on which the content C4, the center specifying figure 44, and the target range frame 45 are superimposed. The display control unit 18 displays the image 30 in the example of FIG. 18 on the display surface 4A.

  In the example of FIG. 20, the center specifying figure 44 is a cross dotted line, and the target range frame 45 is a rectangular dotted line. The center specifying figure 44 is a figure that specifies the center 41 of the image 30, and indicates that the intersection of the crosses is the center 41 of the image 30 in the example of FIG. 20. The aspect of the center specific figure 44 and the target range frame 45 is not limited to the example of FIG.

  The calculation unit 13 calculates the center 41 of the image 30. The display control unit 18 recognizes the center 41 of the image 30 and superimposes the center specifying figure 44 on the image 30. Further, a target range 43 is set in the determination unit 14. The display control unit 18 recognizes the target range 43 and superimposes the target range frame 45 indicating the target range 43 on the image 30.

  The center specific figure 44 superimposed on the image 30 serves as a clue when displaying the specific content C. When the image 30 on which the center specific figure 44 is superimposed is displayed on the display surface 4A, the user can recognize the center 41 in the image 30 displayed on the display surface 4A.

  The selection unit 15 selects the marker M that is closest to the center 41 of the image 30. The display control unit 18 performs control to superimpose the marker M selected by the selection unit 15 on the image 30 and display the image 30 on which the marker M is superimposed on the display surface 4A.

  Accordingly, since the center 41 of the image 30 serves as a reference for the selection unit 15 to select the marker M, it is preferable that the user wearing the head mounted display 1 recognizes the center 41 of the image 30. For this reason, in the first modification, the display control unit 18 superimposes the center specifying figure 44 on the image 30.

  For example, the user wearing the head mounted display 1 changes the viewing direction of the camera 2 so that the center specifying figure 44 displayed on the display surface 4A approaches the pipe D of the valve B that performs the opening / closing operation. Thereby, since the center specific figure 44 becomes a clue, the marker M associated with the target content C can be brought close to the center 41 of the image 30.

  In the first modification, the display control unit 18 performs control to superimpose the target range frame 45 on the image 30 and display the image 30 on which the target range frame 45 is superimposed on the display surface 4A. By superimposing the target range frame 45 on the image 30, it is indicated to the user that the content C associated with the marker M outside the range of the target range frame 45 is not displayed.

  FIG. 21 shows an example of a flowchart of the first modification. The flowchart of the first modification is different from the flowchart of FIG. 10 of the above-described embodiment in steps S6-1 and S9-1. The other steps of the first modification are the same as the steps in the flowchart of FIG.

  The determination unit 14 determines whether the content C overlaps by focusing on the marker M included in the target range 43 (step S6-1). The method in which the determination unit 14 determines the overlap of the content C is the same as that in the above-described embodiment. However, the content C to be determined is narrowed down to the content C associated with the marker M included in the target range 43.

  The display control unit 18 superimposes the center specifying figure 44 and the target range frame 45 on the image 30 (step S9-1). In step S <b> 12, the display control unit 18 superimposes only the content C associated with the marker M selected by the selection unit 15 on the image 30.

  In step S13, the display control unit 18 displays the image 30 on which the content C is superimposed on the display surface 4A. At this time, the center specifying figure 44 and the target range frame 45 are superimposed on the image 30.

  Therefore, on the display surface 4A, the image 30 on which the content C associated with the marker M selected by the selection unit 15, the center specifying figure 44, and the target range frame 45 are superimposed is displayed. Accordingly, the user can recognize the center of the image 30 based on the image 30 displayed on the display surface 4A.

  In the point that the center of the image 30 is displayed on the display surface 4A, the display control unit 18 may not display the target range frame 45 in step S9-1. Thereby, the image 30 on which the center specific figure 44 is superimposed is displayed on the display surface 4A.

<Second Modification>
Next, a second modification will be described. In the second modification, the display control unit 18 superimposes not only the content C associated with the marker M selected by the selection unit 15 but also one or a plurality of content C other than the content C on the image 30.

  Therefore, the image 30 displayed on the display surface 4A includes a plurality of contents C. In the second modification, the display control unit 18 superimposes each content C on the image 30 so that the content C associated with the marker M selected by the selection unit 15 is the foreground. Thereby, the content C associated with the marker M selected by the selection unit 15 is preferentially superimposed on the image 30.

  For this reason, the image 30 on which the content C associated with the selected marker M is superimposed is preferentially displayed on the display surface 4A. FIG. 22 is an example of an image 30 of the second modified example. For example, when the marker M4 is closest to the center of the image 30, the selection unit 15 selects the marker M4.

  When the display control unit 18 superimposes the contents C2 to C5 associated with the markers M2 to M5 included in the target range 43 on the image 30, the content C4 associated with the marker M4 is brought to the forefront. Each content C is superimposed on the image 30.

  Accordingly, the image 30 with the content C4 superimposed on the foreground is displayed on the display surface 4A. For this reason, the user wearing the head mounted display 1 can visually recognize the contents of the content C4 without performing an input operation on the display surface 4A.

  FIG. 23 shows an example of a flowchart of the second modification. The flowchart of the second modification is different from the flowchart of the first modification in step S12-1. Other steps of the flowchart of FIG. 23 are the same as those of the first modification.

  In the second modified example, the display control unit 18 superimposes the content C associated with each marker M included in the target range 43 on the image 30. At this time, the display control unit 18 superimposes each content C on the image 30 so that the content C associated with the marker M selected by the selection unit 15 is displayed in the foreground (step S12-1).

  Therefore, in the second modification, the display control unit 18 superimposes each content C on the image 30 so that the content C associated with the marker M selected by the selection unit 15 is displayed in the foreground. . For this reason, the display control unit 18 preferentially displays an image on which the content C associated with the marker M selected by the selection unit 15 is displayed on the display surface 4A.

  In the case of the second modification, the display control unit 18 displays not only the content C associated with the marker M selected by the selection unit 15 but also the content C associated with the marker M included in the target range 43 as the image 30. Superimpose on.

  Therefore, although the content C selected by the selection unit 15 is displayed on the foreground on the display surface 4A, other content C is also displayed. Therefore, the user can recognize the presence of other content C.

  However, in the case of the second modification, the visibility may be reduced as compared with the above-described embodiment and the first modification. Therefore, the display control unit 18 may superimpose the content C associated with the marker M selected by the selection unit 15 on the image 30 in a display mode different from that of the other content C.

  For example, in the example of FIG. 24, the display control unit 18 thickens the frame line of the content C4 associated with the marker M selected by the selection unit 15 and makes the character information bold. Further, the display control unit 18 may make the color of the content C4 associated with the marker M selected by the selection unit 15 different from the color of the other content C.

  Thereby, the content C4 and the other content C are displayed in a different manner on the display surface 4A. In this case, the visibility of the content C4 associated with the marker M selected by the selection unit 15 is improved.

  In the second modification, the display control unit 18 may superimpose the contents C1 to C6 associated with the markers M1 to M6 included in the entire range of the image 30 instead of the target range 43 on the image 30. The display control unit 18 superimposes each content C on the image 30 so that the content C selected by the selection unit 15 is in the foreground.

  However, when the display control unit 18 superimposes the content C associated with the marker M outside the target range 43 on the image 30, the number of the content C superimposed on the image 30 increases. For this reason, the part which is not displayed among the images 30 which the camera 2 image | photographed increases.

  The user is interested in the content C associated with the center of the angle of view of the camera 2, that is, the marker M in the vicinity of the center of the image 30, but the content C associated with the marker M at the end of the image 30. Is likely not interested.

  For this reason, it is preferable that the display control unit 18 does not superimpose the content C associated with the marker M outside the target range 43 on the image 30 so that the image captured by the camera 2 is displayed.

<Example of hardware configuration of head mounted display>
Next, an example of the hardware configuration of the head mounted display 1 will be described with reference to the example of FIG. In the example of FIG. 25, a processor 111, a random access memory (RAM) 112, a read only memory (ROM) 113, and an auxiliary storage device 114 are connected to the bus 100. In addition, a medium connection unit 115, a communication interface 116, and an input / output interface 117 are connected to the bus 100.

  The processor 111 is an arbitrary processing circuit. The processor 111 executes a program expanded in the RAM 112. As a program to be executed, a program for performing the processing of the embodiment may be applied. The ROM 113 is a non-volatile storage device that stores programs developed in the RAM 112.

  The auxiliary storage device 114 is a storage device that stores various information. For example, a semiconductor memory or the like may be applied to the auxiliary storage device 114. The medium connection unit 115 is provided so as to be connectable to the portable recording medium 118.

  As the portable recording medium 118, a portable memory (eg, a semiconductor memory) may be applied. A program for performing the processing of the embodiment may be recorded on the portable recording medium 118.

  The communication interface 116 is an interface that communicates with an external device of the head mounted display 1. The input / output interface 117 is an input / output interface connected to the camera 2 and the display unit 4.

  In the display control device 3, each unit other than the storage unit 16 and the communication unit 17 may be realized by the processor 111 executing a program. The storage unit 16 may be realized by the RAM 112, the auxiliary storage device 114, or the like. The communication unit 17 may be realized by the communication interface 116.

  The RAM 112, the ROM 113, the auxiliary storage device 114, and the portable recording medium 118 are all examples of a tangible storage medium that can be read by a computer. These tangible storage media are not temporary media such as signal carriers.

<Others>
The present embodiment is not limited to the above-described embodiment, and various configurations or embodiments can be taken without departing from the gist of the present embodiment.

DESCRIPTION OF SYMBOLS 1 Head mounted display 2 Camera 3 Display control apparatus 4 Display part 4A Display surface 11 Image input part 12 Marker recognition part 13 Calculation part 14 Judgment part 15 Selection part 16 Storage part 17 Communication part 18 Display control part 111 Processor

Claims (7)

A photographing device;
A display having a display surface on which an image photographed by the photographing device is displayed;
A determination unit that determines whether or not the display information overlaps when display information associated with each of the plurality of recognition objects included in the image is superimposed on the image;
When it is determined that the determination unit overlaps, a selection unit that selects a recognition object closest to the center of the image;
When it is determined that the determination unit overlaps, a display control unit that displays on the display surface an image in which display information associated with the recognition target selected by the selection unit is preferentially superimposed;
A wearable display device comprising: The display control unit performs control to display on the display surface an image in which only display information associated with the recognition object selected by the selection unit among the plurality of recognition objects is superimposed.
The wearable display device according to claim 1. The display control unit performs control such that display information associated with a recognition object selected by the selection unit is displayed in the forefront among display information associated with the plurality of recognition objects.
The wearable display device according to claim 1. The determination unit determines whether or not the display information overlaps within a predetermined range from the center of the image;
The wearable display device according to claim 1, wherein the display device is a wearable display device. The display control unit performs display for specifying the center of the image.
The wearable display device according to any one of claims 1 to 4, wherein the wearable display device is provided. Computer
When a plurality of display information associated with each of a plurality of recognition objects included in an image captured by the imaging device of the wearable display device is superimposed on the image, it is determined whether or not the display information overlaps. ,
If it is determined that the display information overlaps, select the recognition object closest to the center of the image,
Displaying an image on which display information associated with the selected recognition object is preferentially superimposed on the display surface of the wearable display device;
A display control method characterized by the above. On the computer,
When a plurality of display information associated with each of a plurality of recognition objects included in an image captured by the imaging device of the wearable display device is superimposed on the image, it is determined whether or not the display information overlaps. ,
If it is determined that the display information overlaps, select the recognition object closest to the center of the image,
Displaying an image on which display information associated with the selected recognition object is preferentially superimposed on the display surface of the wearable display device;
A display control program for executing processing.