WO2023218751A1

WO2023218751A1 - Display control device

Info

Publication number: WO2023218751A1
Application number: PCT/JP2023/009936
Authority: WO
Inventors: 怜央水田; 康夫森永; 達哉西▲崎▼; 充宏後藤; 有希中村
Original assignee: 株式会社Ｎｔｔドコモ
Priority date: 2022-05-11
Filing date: 2023-03-14
Publication date: 2023-11-16

Abstract

A mobile device that is an aspect of a display control device according to the present disclosure communicates with a transmission-type display device mounted on the head of a user, thereby controlling the display of a virtual object on the transmission-type display device. The mobile device is provided with a calculation unit and a display control unit. The calculation unit calculates, on the basis of the walking speed of the user, the degree of concentration of the user on the virtual object displayed on the transmission-type display device. The display control unit controls display of the virtual object on the transmission-type display device on the basis of the degree of concentration of the user calculated by the calculation unit.

Description

display control device

The present invention relates to a display control device that controls the display of virtual objects.

Transparent display devices are generally known that display virtual objects that represent additional information such as explanatory text regarding objects that exist in real-world view (hereinafter referred to as real objects), superimposed on real space. Transparent display devices include HMD devices (Head Mounted Display), AR (Augmented Reality) glasses, and MR (Mixed Reality) glasses, which display virtual objects overlaid in real space without blocking the user's field of view. is displayed. One way to use a transmissive display device is for a user to walk while looking at a virtual object displayed on the transmissive display device. However, in this case, the user's attention (line of sight) is directed too much toward the virtual object, which is not preferable from the viewpoint of ensuring safety. Therefore, a technique has been proposed that limits the information displayed on a transmissive display device based on the level of movement of a user wearing the transmissive display device (for example, Patent Document 1).

Japanese Patent Application Publication No. 2019-153347

In the technology disclosed in Patent Document 1, regardless of whether the user's attention is directed to the information displayed on the transmissive display device, the display information is limited based on the movement level of the user of the transmissive display device ( Specifically, this is done according to the moving speed). Therefore, the technique disclosed in Patent Document 1 has a problem in that unnecessary restrictions may be added to the display of information on the transmissive display device.

A virtual object display control device according to a preferred aspect of the present disclosure includes a calculation unit and a display control unit. The calculation unit calculates the user's concentration level with respect to the virtual object displayed on the transparent display device attached to the user's head based on the user's walking speed. The display control unit controls display of the virtual object on the transparent display device based on the degree of concentration.

According to the present disclosure, the display of the virtual object is controlled based on the user's concentration level with respect to the virtual object displayed on the display device, so that unnecessary display restrictions can be avoided and the user can avoid excessive display of the virtual object. It can prevent you from concentrating on

1 is a block diagram illustrating a configuration example of a display system 1 including a mobile device 10 according to an embodiment of a display control device of the present disclosure. 2 is a diagram showing an example of an image of real space corresponding to the field of view of the user U. FIG. FIG. 2 is a diagram illustrating an example of an image in which virtual objects are superimposed on real space. 1 is a block diagram showing a configuration example of a mobile device 10. FIG. 3 is a flowchart showing the flow of a display control method executed by the processing device 18 of the mobile device 10 according to the program PR1. 2 is a block diagram showing a configuration example of a glasses-type display device 20. FIG.

(A. Embodiment)
FIG. 1 is a block diagram illustrating a configuration example of a display system 1 including a mobile device 10 according to an embodiment of the display control device of the present disclosure. As shown in FIG. 1, the display system 1 includes a glasses-type display device 20 in addition to the mobile device 10.

The glasses-type display device 20 is an example of a transmissive display device worn on the head of the user U. The glasses-type display device 20 displays virtual objects that do not exist in real space without blocking the field of view of the user U wearing the glasses-type display device 20. The glasses-type display device 20 includes an imaging device (camera). The eyeglass-type display device 20 worn by the user U captures an image of the user U's viewing range (the viewing range of the eyeglass-type display device 20) using an imaging device.

The mobile device 10 is, for example, a smartphone. The mobile device 10 is not limited to a smartphone, and may be, for example, a tablet or a notebook personal computer. The mobile device 10 is worn on the user U's body together with the glasses-type display device 20 . The mobile device 10 is attached to the body of the user U by hanging from the neck using a strap or the like. The mobile device 10 is connected to the eyeglass-type display device 20 by wire. The mobile device 10 may be connected to the eyeglass-type display device 20 wirelessly. The mobile device 10 acquires image data representing an image captured by the glasses-type display device 20 from the glasses-type display device 20 .

Additionally, the mobile device 10 communicates with the management device 30 via the communication line NW. The mobile device 10 transmits the image data acquired from the glasses-type display device 20 to the management device 30. The management device 30 is a server device that provides a self-location recognition service and a content management service in AR.

The self-location recognition service refers to a service that specifies the position of the eyeglass-type display device 20 in the global coordinate system based on an image captured by the imaging device of the eyeglass-type display device 20. Specific methods for realizing the self-location recognition service include a method using an AR tag or a method using a distribution of feature points extracted from an image, such as SLAM (Simultaneous Localization and Mapping). The content management service refers to a service that distributes information regarding virtual objects to the glasses-type display device 20. The virtual object corresponds to a real object visible from the position of the glasses-type display device 20 in the global coordinate system.

In this embodiment, various virtual objects are prepared, and each virtual object is associated with a position in the global coordinate system and corresponds to a real object that can be seen from the position. The management device 30 stores in advance virtual object information and area information corresponding to each virtual object. The virtual object information represents an image of the corresponding virtual object. The area information indicates the position and size of the display area that displays the virtual object. The management device 30 receives image data captured by the glasses-type display device 20 from the mobile device 10 via the communication line NW, and specifies the position of the glasses-type display device 20 based on the received image data. Then, the management device 30 transmits virtual object information corresponding to the specified position and area information corresponding to the specified position to the mobile device 10. The mobile device 10 causes the glasses-type display device 20 to display an image of the virtual object according to the virtual object information and area information received from the management device 30. As a result, the virtual object appears superimposed on the real space in the eyes of the user U.

The real space in this embodiment is a cityscape of a tourist spot. The real object in this embodiment is, for example, a store in the cityscape. FIG. 2 is a diagram illustrating an example of a real space image G1 corresponding to the user's U field of view. The virtual object in this embodiment is an image that includes a character string of explanatory text regarding products etc. handled at the store. FIG. 3 is a diagram illustrating an example of an image G2 that the user U views through the glasses-type display device 20. In the image G2 shown in FIG. 3, a virtual object displayed overlapping the cityscape of a tourist spot is drawn with a dotted line.

FIG. 4 is a block diagram showing a configuration example of the mobile device 10. As shown in FIG. 4, the mobile device 10 includes an input device 11, an output device 12, a communication device 14, a communication device 15, a storage device 17, a processing device 18, and a bus 19. The components of the mobile device 10 (input device 11, output device 12, communication device 14, communication device 15, storage device 17, and processing device 18) are interconnected by a bus 19 for communicating information. The bus 19 may be configured using a single bus, or may be configured using different buses for each device.

The input device 11 includes a touch panel. The input device 11 may include a plurality of operation keys in addition to a touch panel. The input device 11 may include a plurality of operation keys without including a touch panel. The input device 11 receives operations performed by the user U. Output device 12 includes a display panel. A touch panel of the input device 11 is stacked on the display panel of the output device 12 . The output device 12 displays various information.

The communication device 14 is a hardware device for communicating with the management device 30 via the communication line NW. The communication device 14 is also called, for example, a network device, a network controller, a network card, a communication module, or the like. The communication device 14 transmits the image data given from the processing device 18 to the management device 30. Furthermore, the communication device 14 supplies virtual object information and area information received from the management device 30 to the processing device 18 . Note that the communication device 14 may communicate with the management device 30 without using the communication line NW.

The communication device 15 is a hardware device for communicating with the eyeglass-type display device 20 by wire. The communication device 15 supplies data received from the glasses-type display device 20 to the processing device 18 . Furthermore, the communication device 15 transmits image data provided from the processing device 18 to the glasses-type display device 20. Note that the communication device 15 may communicate with the glasses-type display device 20 wirelessly.

The storage device 17 is a recording medium that can be read by the processing device 18. The storage device 17 includes, for example, nonvolatile memory and volatile memory. Nonvolatile memories include, for example, ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, RAM (Random Access Memory). The storage device 17 stores in advance a program PR1 that causes the processing device 18 to execute the display control method of the present disclosure.

The processing device 18 includes one or more CPUs (Central Processing Units). One or more CPUs are an example of one or more processors. Each of the processor and CPU is an example of a computer. The processing device 18 reads the program PR1 from the storage device 17. The processing device 18 operating according to the program PR1 transmits the image data received from the glasses-type display device 20 using the communication device 15 to the management device 30 using the communication device 14. Further, the processing device 18 operating according to the program PR1 functions as a measuring section 181, a determining section 182, a calculating section 183, and a display controlling section 184 shown in FIG. That is, the measurement section 181, determination section 182, calculation section 183, and display control section 184 in FIG. 4 are software modules realized by operating the processing device 18 according to software.

The measurement unit 181 measures the walking speed of the user U wearing the glasses-type display device 20. In this embodiment, the glasses-type display device 20 transmits acceleration data to the mobile device 10. The acceleration data represents acceleration in the following three directions. The first is acceleration in the direction along the vertical axis (hereinafter referred to as the Z axis). The second is the acceleration along the axis (hereinafter referred to as the X axis) perpendicular to the vertical axis. The third is acceleration in a direction along an axis (hereinafter referred to as Y-axis) that is perpendicular to the vertical axis and perpendicular to the X-axis. The acceleration data transmitted from the glasses-type display device 20 to the mobile device 10 is received by the communication device 15. The measurement unit 181 measures the walking speed of the user U based on the acceleration data received by the communication device 15.

To explain in more detail, the measurement unit 181 first identifies the direction of gravitational acceleration (that is, the Z-axis direction) based on the acceleration data received by the communication device 15. The measurement unit 181 determines that the user U is walking when the acceleration in the Z-axis direction changes within a predetermined cycle. When it is determined that the user U is walking, the measurement unit 181 calculates the absolute value of the composite acceleration obtained by combining the acceleration in the X-axis direction and the acceleration in the Y-axis direction based on the acceleration data. The measurement unit 181 then calculates the user's walking speed by integrating the absolute value of the composite acceleration.

The determining unit 182 determines whether the walking speed measured by the measuring unit 181 is less than a first threshold (walking speed<first threshold). The first threshold in this embodiment is, for example, an average value of walking speeds measured when a plurality of sample users walk while looking at a virtual object. However, the first threshold value is not limited to the average walking speed of a plurality of sample users. The first threshold value may be an actual value of the walking speed of the user U. In this case, for example, the tutorial on the glasses-type display device 20 is used to measure the walking speed of the user U. During execution of the tutorial, the actual value of the walking speed of the user U, which is measured when the user U walks while looking at the virtual object displayed on the glasses-type display device 20, is set as the first threshold value.

The calculation unit 183 calculates the degree of concentration of the user U based on the walking speed of the user U. The user's concentration level refers to the degree of user U's attention to the virtual object displayed on the glasses-type display device 20 (that is, the degree to which the user is concentrating on the virtual object). The degree of concentration of the user U in this embodiment is, for example, a positive value, and the larger the value, the higher the degree of concentration of the user U is. The reason why the degree of concentration of the user U with respect to the virtual object can be calculated based on the walking speed of the user U is as follows.

For example, when the user U is in a hurry to move to the destination without paying attention to the virtual object displayed on the glasses-type display device 20, the user U's walking style tends to be brisk, and the walking speed is set to the first speed. Frequently exceeds the threshold. On the other hand, when the user U is walking while paying attention to the virtual object, the user walks a little slowly, and the walking speed often falls below the first threshold. Since there is a correlation between the degree of concentration of the user U with respect to the virtual object displayed on the glasses-type display device 20 and the walking speed, the degree of concentration of the user U can be calculated based on the walking speed of the user U.

In the present embodiment, if the determination result by the determining unit 182 is positive, that is, if the walking speed measured by the measuring unit 181 is less than the first threshold, the calculating unit 183 calculates the walking speed measured by the measuring unit 181 and The degree of concentration of the user U is calculated based on the difference from the first threshold. In this embodiment, the calculation unit 183 calculates the degree of concentration with a larger value as the difference between the walking speed measured by the measurement unit 181 and the first threshold value becomes larger. That is, when the difference between the walking speed measured by the measuring section 181 and the first threshold value is the first value, the first concentration degree calculated by the calculating section 183 is equal to the walking speed measured by the measuring section 181. and the first threshold value is a second value (a value smaller than the first value), which is larger than the second concentration degree calculated by the calculation unit 183. This is because, as described above, the more attention is paid to the virtual object displayed on the glasses-type display device 20, the slower the walking speed of the user who is using the glasses-type display device 20 often becomes.

The display control unit 184 controls the display of the virtual object on the glasses-type display device 20. The display control unit 184 performs different processing depending on whether the determination result by the determination unit 182 is positive or negative.

If the determination result by the determination unit 182 is negative, the display control unit 184 generates image data representing the superimposed image. A superimposed image is an image in which an image indicated by virtual object information is arranged in an area indicated by area information. The virtual object information and area information are received by the mobile device 10 from the management device 30. Then, the display control unit 184 transmits the image data to the glasses-type display device 20 and causes the glasses-type display device 20 to display the superimposed image.

If the determination result by the determination unit 182 is affirmative, the display control unit 184 controls the display of the virtual object based on the degree of concentration of the user U calculated by the calculation unit 183. More specifically, when the determination result by the determination unit 182 is affirmative, the display control unit 184 determines whether the concentration level of the user U calculated by the calculation unit 183 exceeds the second threshold (the user's concentration > second threshold). When the degree of concentration of the user U calculated by the calculation unit 183 is less than or equal to the second threshold, the display control unit 184 causes the glasses-type display device 20 to display the above-mentioned superimposed image. When the degree of concentration of the user U calculated by the calculation unit 183 is greater than the second threshold, the display control unit 184 stops generating and transmitting image data representing the superimposed image. As a result, no virtual object is displayed on the glasses-type display device 20.

Furthermore, the processing device 18 operating according to the program PR1 executes the display method shown in FIG. 5 every time it receives acceleration data from the communication device 15. As shown in FIG. 5, this display method includes each process from step SA110 to step SA150.

In step SA110, the processing device 18 functions as the measurement unit 181. In step SA110, the processing device 18 measures the walking speed of the user U wearing the glasses-type display device 20 based on the acceleration data received by the communication device 15.

In step SA120, the processing device 18 functions as the determination unit 182. In step SA120, the processing device 18 determines whether the walking speed measured in step SA110 is less than a first threshold. If the walking speed measured in step SA110 is equal to or greater than the first threshold, the determination result in step SA120 is "No" and the process in step SA130 is executed. If the walking speed measured in step SA110 is less than the first threshold, the determination result in step SA120 is "Yes" and the processes in step SA140 and step SA150 are executed.

In step SA130, the processing device 18 functions as the display control unit 184. In step SA130, the processing device 18 generates image data representing the superimposed image. Then, the processing device 18 transmits the image data to the glasses-type display device 20 and causes the glasses-type display device 20 to display the superimposed image.

In step SA140, the processing device 18 functions as the calculation unit 183. In step SA140, processing device 18 calculates the degree of concentration of user U based on the walking speed measured in step SA110. In step SA150 following step SA140, the processing device 18 functions as the display control unit 184. In step SA150, the processing device 18 controls the display of the virtual object on the glasses-type display device 20 based on the degree of concentration of the user U calculated in step SA140. To explain in more detail, in step SA150, the processing device 18 determines whether the degree of concentration of the user U calculated in step SA140 exceeds the second threshold. If the degree of concentration of the user U calculated in step SA140 is equal to or less than the second threshold, the processing device 18 causes the glasses-type display device 20 to display the superimposed image. If the degree of concentration of the user U calculated in step SA140 is greater than the second threshold, the processing device 18 stops displaying the superimposed image.

FIG. 6 is a block diagram showing a configuration example of the eyeglass-type display device 20. The glasses-type display device 20 includes a display section 2a, a communication device 2b, an imaging device 2c, an acceleration sensor 2g, a storage device 2d, a processing device 2e, and a bus 2f. The components of the mirror display device 20 (display section 2a, communication device 2b, imaging device 2c, acceleration sensor 2g, storage device 2d, and processing device 2e) are interconnected by a bus 2f for communicating information. . The bus 2f may be configured using a single bus, or may be configured using different buses for each element such as a device.

The display section 2a is of a transmissive type. Light in the field of view of the glasses-type display device 20 (display section 2a) passes through the display section 2a. The display unit 2a displays the superimposed image under the control of the mobile device 10. When the user U wears the glasses-type display device 20, the display section 2a is located in front of the user's U left and right eyes. The user U wearing the glasses-type display device 20 visually recognizes when an image of a virtual object appears in real space.

To explain in more detail, the display unit 2a includes a left eye lens, a left eye display panel, a left eye optical member, a right eye lens, a right eye display panel, and a right eye optical member. Contains parts. The display panel for the left eye and the display panel for the right eye are, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. The display panel for the left eye displays a superimposed image represented by image data provided from the mobile device 10. The left eye optical member is an optical member that guides light emitted from the left eye display panel to the left eye lens. Similarly, the display panel for the right eye displays a superimposed image represented by image data provided from the mobile device 10. The right eye optical member is an optical member that guides light emitted from the right eye display panel to the right eye lens.

Each of the left eye lens and the right eye lens has a half mirror. The half mirror included in the left eye lens guides the light representing the real space to the left eye of the user U by transmitting the light representing the real space. Further, the half mirror included in the left eye lens reflects the light guided by the left eye optical member to the user U's left eye. The half mirror included in the right eye lens guides the light representing the real space to the right eye of the user U by transmitting the light representing the real space. The half mirror included in the right eye lens reflects the light guided by the right eye optical member to the user U's right eye.

The communication device 2b is a hardware device for communicating with the mobile device 10 by wire. The communication device 2b may communicate with the mobile device 10 wirelessly.

The spectacle-type display device 20 has a spectacle-shaped frame that supports a left-eye lens and a right-eye lens, and the imaging device 2c is provided on a bridge of the frame. The imaging device 2c images the field of view of the imaging device 2c. The imaging device 2c outputs image data representing the captured image to the processing device 2e.

The acceleration sensor 2g is a three-axis acceleration sensor that detects acceleration in each of the X-axis, Y-axis, and Z-axis directions at regular intervals. The acceleration sensor 2g outputs acceleration data representing acceleration in the directions of the X, Y, and Z axes to the processing device 2e at regular intervals.

The storage device 2d is a recording medium that can be read by the processing device 2e. The storage device 2d, like the storage device 17, includes nonvolatile memory and volatile memory. The storage device 2d stores a program PR2. The processing device 2e includes one or more CPUs. The processing device 2e reads the program PR2 from the storage device 2d. The processing device 2e functions as an operation control unit 2e1 by executing the program PR2.

The operation control unit 2e1 controls the eyeglass-type display device 20. The operation control unit 2e1 transmits the image data output from the imaging device 2c to the mobile device 10 using the communication device 2b. Further, the operation control unit 2e1 transmits acceleration data output from the acceleration sensor 2g to the mobile device 10 using the communication device 2b. Further, the operation control unit 2e1 supplies image data received from the mobile device 10 via the communication device 2b to the display unit 2a. The display section 2a displays an image represented by the image data supplied from the operation control section 2e1. As described above, the image data transmitted from the mobile device 10 to the glasses-type display device 20 represents the above-mentioned superimposed image. Since the superimposed image is displayed on the display unit 2a, the user U's eyes see an image of the real space on which the virtual object is superimposed.

For example, if the walking speed of the user U wearing the glasses-type display device 20 exceeds the first threshold, the determination result in step SA120 in the display control method executed by the mobile device 10 is "No", and the process in step SA130 is is executed. As a result, image data representing the superimposed image is transmitted from the mobile device 10 to the glasses-type display device 20, and the superimposed image is displayed on the display section 2a of the glasses-type display device 20. Therefore, the user U's eyes see a real space in which virtual objects are superimposed, as in the image G2 shown in FIG.

On the other hand, when the user U's degree of concentration on the virtual object wearing the glasses-type display device 20 increases and the walking speed falls below the first threshold, the determination result in step SA120 becomes "Yes" and step SA140 and step The process of SA150 is executed. Even if the walking speed is below the first threshold, if the concentration level of the user U calculated in step SA140 is below the second threshold, the superimposed image is displayed on the display unit 2a of the glasses-type display device 20. Therefore, the user U's eyes see a real space in which virtual objects are superimposed, as in the image G2 shown in FIG. When user U's concentration level with respect to the virtual object further increases and user U's walking speed further slows down, user U's concentration level calculated in step SA140 exceeds the second threshold, and the superimposed image is no longer displayed. As a result, the virtual object does not appear in the eyes of the user U, as in the image G1 shown in FIG.

As described above, according to the present embodiment, the display of the virtual object is controlled according to the degree of concentration of the user U on the virtual object displayed on the glasses-type display device 20, thereby avoiding unnecessary display restrictions. At the same time, it is possible to prevent the user U from concentrating too much on displaying the virtual object.

(B: Transformation)
The present disclosure is not limited to the embodiments illustrated above. Specific aspects of the modification are as follows. Two or more aspects arbitrarily selected from the examples below may be combined.
(B-1: Modification 1)
The display control unit 184 in the embodiment described above limits the display of the virtual object by stopping the display of the virtual object when the degree of concentration of the user U calculated by the calculation unit 183 exceeds the second threshold. However, when the degree of concentration of the user U calculated by the calculation unit 183 exceeds the second threshold, the display control unit 184 displays, in addition to the virtual object, a message in the form of glasses to warn against excessive concentration on the virtual object. It may be displayed on the device 20. In short, the display control unit 184 only needs to be able to control the display of the virtual object on the glasses-type display device 20 based on the degree of concentration of the user U calculated by the calculation unit 183.

(B-2: Modification 2)
In the embodiment described above, the measurement unit 181 calculated the walking speed of the user U by integrating the combined acceleration obtained by combining the acceleration in the X-axis direction and the acceleration in the Y-axis direction. However, the measurement unit 181 may identify the walking speed of the user U by using a table prepared in advance. Specifically, the table has multiple records. Each of the plurality of records includes a walking speed within a certain range and a periodic swing amplitude of acceleration in the Z-axis direction obtained when the user U walks at the walking speed. The above table is stored in the storage device 17 in advance. The measurement unit 181 receives acceleration data from the glasses-type display device 20, and specifies the walking speed of the user U by reading out from the table the walking speed that corresponds to the swing amplitude of acceleration in the Z-axis direction represented by the acceleration data. do.

(B-3: Modification 3)
In the above embodiment, the glasses-type display device 20 includes a three-axis acceleration sensor, and the measurement unit 181 identifies the walking speed of the user based on the output data of the acceleration sensor. However, when a moving image is captured by the imaging device 2c, the measurement unit 181 may measure the walking speed of the user based on the moving image captured by the imaging device 2c. For example, the measurement unit 181 may identify the walking speed of the user U wearing the glasses-type display device 20 by referring to a table prepared in advance. Specifically, the table has multiple records. Each of the plurality of records includes a walking speed within a certain range and a blur width in the Z-axis direction of a moving image obtained by capturing an image while the user U is walking at the walking speed. The measurement unit 181 specifies the walking speed of the user U by reading from the table the walking speed corresponding to the shake width in the Z-axis direction of the moving image captured by the imaging device 2c. Furthermore, the measurement unit 181 may determine whether the user U is walking based on the vertical image blur width for each frame of the moving image captured by the imaging device 2c. When it is determined that the user U is walking, the walking speed may be determined based on the change in size of an object whose size is known, such as a road sign or a vehicle license plate, over each frame. When specifying the user's walking speed based on the moving image captured by the imaging device 2c, the acceleration sensor can be omitted.

(B-4: Modification 4)
A GPS (Global Positioning System, Global Positioning Satellite) receiver is provided in the glasses-type display device 20 instead of an acceleration sensor, and the measurement unit 181 can identify the user's walking speed based on the output data of the GPS receiver. good. For example, the measurement unit 181 determines whether the user U is walking based on the image blur width in the Z-axis direction for each frame of the moving image captured by the imaging device 2c. When it is determined that the user U is walking, the measurement unit 181 uses the first position information acquired by the GPS receiver at time t1 and the second position information acquired by the GPS receiver at time t2 after time t1. The moving distance of the user is calculated based on the position information, and the value obtained by dividing this moving distance by t2-t1 is set as the walking speed.

(B-5: Modification 5)
In the above embodiment, the program PR1 is stored in the storage device 17 of the mobile device 10, but the program PR1 may be manufactured or sold separately. When selling the program PR1, the method of providing the program PR1 to the purchaser is to distribute a computer-readable recording medium such as a flash ROM in which the program PR1 is written, or to distribute the recording medium via a telecommunications line. For example, it can be distributed by downloading.

(B-6: Modification 6)
The measurement unit 181, determination unit 182, calculation unit 183, and display control unit 184 in the above embodiment were software modules. However, any one, a plurality, or all of the measurement section 181, the determination section 182, the calculation section 183, and the display control section 184 may be a hardware module. Specific examples of the hardware module include DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field Programmable Gate Array), and the like.

(B-7: Modification 7)
In the embodiment described above, the mobile device 10 included the measurement section 181, the determination section 182, the calculation section 183, and the display control section 184. However, the measurement unit 181 may be provided in the glasses-type display device 20, and the data representing the walking speed may be supplied from the glasses-type display device 20 to the mobile device 10. Further, the determination unit 182 may be omitted. In short, the display control device that controls the display of the virtual object on the glasses-type display device 20 only needs to include the calculation section 183 and the display control section 184.

(C: Other)
(1) In the above-described embodiment, the storage device 17 and the storage device 2d are exemplified as ROM, RAM, etc., but the storage device 17 and the storage device 2d are flexible disks, magneto-optical disks (for example, compact disks, digital Application discs, Blu-ray (registered trademark) discs), smart cards, flash memory devices (e.g. cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppies (registered trademark) disk, magnetic strip, database, server, or other suitable storage medium.

(2) In the embodiments described above, the information, signals, etc. described may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may refer to voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may also be represented by a combination of

(3) In the embodiments described above, the input/output information may be stored in a specific location (for example, memory) or may be managed using a management table. Information etc. to be input/output may be overwritten, updated, or additionally written. The output information etc. may be deleted. The input information etc. may be transmitted to other devices.

(4) In the embodiments described above, the determination may be made based on a value represented by 1 bit (0 or 1), or may be made based on a truth value (Boolean: true or false). , may be performed by numerical comparison (for example, comparison with a predetermined value).

(5) The order of the processing procedures, sequences, flowcharts, etc. illustrated in the embodiments described above may be changed as long as there is no contradiction. For example, for the methods described in this disclosure, elements of the various steps are presented using an example order and are not limited to the particular order presented.

(6) Each function illustrated in FIG. 4 is realized by an arbitrary combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using one physically or logically coupled device, or may be realized using two or more physically or logically separated devices directly or indirectly (e.g. , wired, wireless, etc.) and may be realized using a plurality of these devices. The functional block may be realized by combining software with the one device or the plurality of devices.

(7) The programs exemplified in the embodiments described above may include instructions, instruction sets, codes, software, firmware, middleware, microcode, hardware description language, or other names. Should be broadly construed to mean a code segment, program code, program, subprogram, software module, application, software application, software package, routine, subroutine, object, executable, thread of execution, procedure, function, etc. .

Additionally, software, instructions, information, etc. may be sent and received via a transmission medium. For example, if the software uses wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and/or wireless technology (infrared, microwave, etc.) to create a website, When transmitted from a server or other remote source, these wired and/or wireless technologies are included within the definition of transmission medium.

(8) In each of the above embodiments, the terms "system" and "network" are used interchangeably.

(9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a predetermined value, or other corresponding information. It may also be expressed as

(10) In the embodiments described above, the mobile device includes a mobile station (MS). A mobile station is defined by a person skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless It may also be referred to as a terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology. Further, in the present disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

(11) In the embodiments described above, the terms "connected", "coupled", or any variations thereof refer to direct or indirect connections between two or more elements. Refers to any connection or combination and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The bonds or connections between elements may be physical, logical, or a combination thereof. For example, "connection" may be replaced with "access." As used in this disclosure, two elements may include one or more electrical wires, cables, and/or printed electrical connections, as well as in the radio frequency domain, as some non-limiting and non-inclusive examples. , electromagnetic energy having wavelengths in the microwave and optical (both visible and non-visible) ranges, and the like.

(12) In the embodiments described above, the statement "based on" does not mean "based solely on" unless specified otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

(13) The terms "determining" and "determining" used in this disclosure may encompass a wide variety of operations. "Judgment" and "decision" include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, and inquiry. (e.g., searching in a table, database, or other data structure), and regarding an ascertaining as a "judgment" or "decision." In addition, "judgment" and "decision" refer to receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and access. (accessing) (e.g., accessing data in memory) may include considering something as a "judgment" or "decision." In addition, "judgment" and "decision" refer to resolving, selecting, choosing, establishing, comparing, etc. as "judgment" and "decision". may be included. In other words, "judgment" and "decision" may include regarding some action as having been "judged" or "determined." Further, "judgment (decision)" may be read as "assuming", "expecting", "considering", etc.

(14) In the embodiments described above, when “include”, “including” and variations thereof are used, these terms are used in the same manner as the term “comprising”. , is intended to be comprehensive. Furthermore, the term "or" as used in this disclosure is not intended to be exclusive or.

(15) In the present disclosure, when articles are added by translation, such as a, an, and the in English, the present disclosure does not include that the nouns following these articles are plural. good.

(16) In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." Note that the term may also mean that "A and B are each different from C". Terms such as "separate", "coupled", etc. may also be interpreted similarly to "different".

(17) Each aspect/embodiment described in the present disclosure may be used alone, in combination, or may be switched and used in accordance with execution. In addition, notification of prescribed information (for example, notification of "X") is not limited to being done explicitly, but may also be done implicitly (for example, not notifying the prescribed information). Good too.

(D: Aspects understood from the above-mentioned form or modification)
Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be implemented as modifications and variations without departing from the spirit and scope of the present disclosure as determined by the claims. Therefore, the description of the present disclosure is for the purpose of illustrative explanation and is not intended to have any limiting meaning on the present disclosure. The following aspects can be understood from at least one of the above-described embodiments or modifications.

The display control device according to the first aspect includes a calculation section 183 and a display control section 184. The calculation unit 183 calculates the degree of concentration of the user U with respect to the virtual object displayed on the transparent display device worn on the head of the user U, based on the walking speed of the user. The display control unit 184 controls the display of the virtual object on the transparent display device based on the user concentration level calculated by the calculation unit 183. The mobile device 10 is an example of a display control device of the present disclosure. The glasses-type display device 20 is an example of a transmissive display device in the present disclosure. According to the display control device of the first aspect, the display of the virtual object is controlled based on the user's degree of concentration on the virtual object displayed on the transparent display device, so unnecessary display restrictions can be avoided while It is possible to prevent the user from concentrating too much on displaying the virtual object.

The display control device according to the second aspect (an example of the first aspect) may further include a measurement unit 181 that measures the walking speed of the user. The display control device of the second aspect can control the display of the virtual object according to the concentration degree calculated based on the walking speed measured by the measurement unit 181.

The display control device according to the third aspect (an example of the first aspect) may include a determination unit 182 that determines whether the walking speed of the user has fallen below a first threshold. The calculation unit 183 in the display control device according to the third aspect calculates the difference between the first threshold value and the walking speed of the user when the determination result by the determination unit 182 is affirmative (when the walking speed is less than the first threshold value). The user's concentration level may be calculated based on the difference. Furthermore, when the determination result of the determination unit 182 is positive, the display control unit 184 in the display control device according to the third aspect controls the display of the virtual object on the display device based on the user concentration calculated by the calculation unit 183. Limits may be based on degree. The display control device of the third aspect can limit the display of the virtual object on the display device based on the user's concentration level calculated by the calculation unit 183 when the user's walking speed is less than the first threshold.

The display control unit 184 in the display control device according to the fourth aspect (an example of the first aspect) performs virtual control on the transmissive display device when the user concentration calculated by the calculation unit 183 exceeds the second threshold. Display of objects may be restricted. The display control device of the fourth aspect can restrict the display of the virtual object on the transparent display device when the user's concentration level calculated based on the user's walking speed exceeds the second threshold.

DESCRIPTION OF SYMBOLS 1...Display system, 10...Mobile device, 20...Glasses type display device, 11...Input device, 12...Output device, 14, 15, 2b...Communication device, 17, 2d...Storage device, 18, 2e...Processing device, 181...Measurement section, 182...Judgment section, 183...Calculation section, 184...Display control section, 19, 2f...Bus, 2a...Display section, 2g...Acceleration sensor, 2e1...Operation control section, PR1, PR2...Program.

Claims

a calculation unit that calculates the user's concentration level with respect to a virtual object displayed on a transparent display device worn on the user's head based on the user's walking speed;
a display control unit that controls display of the virtual object on the transparent display device based on the concentration level of the user;
A display control device comprising:
The display control device according to claim 1, further comprising a measurement unit that measures the walking speed of the user.
further comprising a determination unit that determines whether the walking speed is below a first threshold;
The calculation unit calculates the concentration level of the user based on the difference between the walking speed and the first threshold when the walking speed is less than a first threshold;
The display control unit limits display of the virtual object on the transparent display device based on the concentration level of the user when the walking speed is less than a first threshold.
The display control device according to claim 1.
The display control unit limits display of the virtual object on the transparent display device when the concentration level of the user exceeds a second threshold.
The display control device according to claim 1.