WO2022201936A1

WO2022201936A1 - Display control device

Info

Publication number: WO2022201936A1
Application number: PCT/JP2022/005193
Authority: WO
Inventors: 怜央水田; 康夫森永; 望松本; 達哉西▲崎▼; 有希中村; 弘行藤野
Original assignee: 株式会社Ｎｔｔドコモ
Priority date: 2021-03-24
Filing date: 2022-02-09
Publication date: 2022-09-29

Abstract

The present invention is for appropriately performing display on a display in accordance with the state of a user.　This display control device is for controlling display on a transmission-type display 10 which is worn on a portion of a user's eye and on which display is performed in accordance with an operation of another user, the display control device comprising: a detection unit 12 for detecting the state of the user wearing the display 10; and a control unit 13 for controlling the operation that is from the other user and that is related to display on the display 10, in accordance with the state of the user detected by the detection unit 12.

Description

display controller

The present invention relates to a display control device that controls display on a display.

Conventionally, transmissive head-mounted displays have been used (see Patent Document 1, for example). A transmissive head-mounted display allows a user to see the real world and to refer to information displayed on the display.

JP 2018-91882 A

Conventionally, technology has been used to share the display on a display with another user's display. Even in a transmissive head-mounted display, it is conceivable to share the display with another user. In this case, the display on the head mounted display is remotely operated by another user. If the user of the head-mounted display is doing something other than looking at the display, another user's operation may interfere with the user of the head-mounted display. For example, when a user of a head-mounted display is looking at something in the real world instead of what is displayed on the display, if the displayed content is moved in front of the user's eyes by another user's operation, the user's behavior will be disturbed. become.

An embodiment of the present invention has been made in view of the above, and an object thereof is to provide a display control device capable of appropriately performing display on a display according to the state of the user.

In order to achieve the above object, a display control device according to an embodiment of the present invention provides display on a transmissive display that is worn on the eye of a user and performs display according to an operation from another user. A display control device that controls the display, which detects the state of the user wearing the display, and the control of the operation related to the display of the display from another user according to the state of the user detected by the detection unit and a control unit that performs

In the display control device according to one embodiment of the present invention, the operation related to the display by another user is controlled according to the state of the user. For example, according to the user's state, the display can be controlled so that the display by another user's operation does not interfere with the user. Therefore, according to the display control device according to the embodiment of the present invention, it is possible to appropriately perform display on the display according to the state of the user.

According to an embodiment of the present invention, an operation related to display display from another user is controlled according to the state of the user. can.

It is a figure which shows the functional structure of the display which is a display control apparatus which concerns on embodiment of this invention. FIG. 4 is a diagram showing an example of display on a display; 4 is a flow chart showing processing executed by a display that is a display control device according to an embodiment of the present invention; It is a figure which shows the hardware constitutions of the display which is a display control apparatus which concerns on embodiment of this invention.

Hereinafter, an embodiment of the display control device according to the present invention will be described in detail along with the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted.

FIG. 1 shows the functional configuration of a display 10, which is a display control device according to this embodiment. The display 10, which is a display control device, controls display on the display 10 itself. The display 10 is a transmissive display worn on the user's eye. For example, the display 10 is a glasses-type head-mounted display, that is, see-through glasses (smart glasses). Since the display 10 is of a transmissive type, the user wearing the display 10 can simultaneously see the display (image) on the display 10 and the scenery of the outside. For example, the display 10 has a display screen 100, and displays content 110 on a part of the display screen 100 as shown in FIGS. 2(a) and 2(b). The user can see the outside scenery or the like from a portion of the display screen 100 where the content 110 is not displayed. As for the portion of the display screen 100 where the content 110 is displayed, the user can see the outside scenery through the content, or cannot see the outside scenery because of the content.

The display 10 may display according to the surrounding environment such as the scenery of the outside. That is, the display 10 may display virtual content by AR (Augmented Reality), such as AR glasses.

The display 10 displays according to the operation by another user. For example, the display 10 may share the display on the display 10 itself, eg, the screen of the desktop, with another display. That is, the same display may be made on the display 10 and another display. For example, the display 10 and the above-mentioned another display (or a terminal connected to the another display, the same applies to the following) are configured to be able to communicate with each other through a communication network such as a mobile communication network, a wireless LAN, and the Internet. Display is shared by mutually transmitting and receiving information related to display. Alternatively, display sharing may occur via a device other than the display, such as a content management server that can communicate with the display.

A user of the display 10 and a user of another display can operate the shared display. For example, one display position of the content 110 can be moved as indicated by the arrow in FIG. 2(b). It should be noted that the operation on the display is not limited to moving the content 110 and may be arbitrary. In this way, when another user remotely operates display, the display 10 performs display according to the remote operation. By sharing the display, the user of the display 10 and the user of another display can communicate while referring to the same information. In the above example, two displays share the display, but three or more displays may share the display. Moreover, the display 10 may perform display according to an operation from another user other than sharing the display.

As the display 10, a conventional display having the above functions can be used. In addition, some of the above-described functions of the display 10 and functions according to the present embodiment described later may be included in an information processing device (for example, a smartphone) connected to a display device (for example, the above-described see-through glasses). good. That is, the display 10 according to the present embodiment may be realized by including the display device and the information processing device.

Next, the functions of the display 10 according to this embodiment will be explained. As shown in FIG. 1, the display 10 includes a display section 11, a detection section 12, and a control section 13. As shown in FIG. In addition, the display 10 may have functions other than those described above that conventional display devices, such as conventional see-through glasses, have.

The display unit 11 is a functional unit that displays on the display screen 100 provided in the display 10 . The display unit 11 inputs display information to be displayed on the display screen 100 and displays it on the display screen 100 . The display information may be, for example, content such as photos or characters, or may be information that can be changed in a browser or the like. The display unit 11 receives an operation related to display and executes the operation. An operation related to display is, for example, an operation of moving display information on the display screen 100 . Also, the operation related to the display may be another operation.

An operation related to display can be performed by the user wearing the display 10 or by another user. When the user who wears the display 10 performs the operation, the operation related to the display is accepted by accepting the user's input operation to the display 10 , for example. When sharing the display with another display, the display unit 11 transmits information indicating the operation to the another display.

When another user performs an operation, acceptance of the display-related operation is performed, for example, by receiving information indicating the operation transmitted from another display used by another user. The display unit 11 can identify whether the received operation is from another user. For example, the information indicating the operation is given the identifier of the user who performed the operation.

The above function of the display unit 11 may be the same as the conventional function of displaying on the display. Further, as will be described later, the execution of operations related to display by the display unit 11 is controlled by the control unit 13 .

The detection unit 12 is a functional unit that detects the state of the user wearing the display 10 . The detection unit 12 may detect the line of sight of the user as the state of the user wearing the display 10 . More specifically, the detection unit 12 may detect the focal length of the line of sight of the user. Further, the detection unit 12 may detect the direction of the user's line of sight. Alternatively, the detection unit 12 may detect the moving state of the user as the state of the user wearing the display 10 .

For example, a sensor for detecting the state of the user may be provided on the display 10 as at least part of the detection unit 12, and the user's state may be detected using the sensor. When detecting the line of sight of the user, the display 10 is provided with a camera capable of imaging the eyeball of the user. The detection unit 12 detects the user's line of sight, more specifically, the focal length and direction of the line of sight from the image of the user's eyeball obtained by imaging with the camera. For example, the detection unit 12 detects the movement of the user's eyeball from the moving image of the user's eyeball, and detects the focal length and direction of the line of sight based on the movement. The detection unit 12 detects, for example, the distance from the eyeball to the focal point as the focal length. The detection unit 12 detects, for example, the position of the line of sight on the display screen 100 (the position of the intersection of the line of sight and the display screen 100, eg, the coordinates on the display screen 100) as the direction of the line of sight. Detecting the line of sight from the image may be performed in the same manner as in the conventional method.

The detection unit 12 may detect whether or not the user is walking as the movement state of the user. In this case, the display 10 is provided with an acceleration sensor, for example. The detection unit 12 detects whether or not the user is walking from the information obtained by the acceleration sensor. Detection of whether or not the user is walking from the acceleration may be performed in the same manner as in the conventional method. Alternatively, the display 10 is provided with a positioning function of its own device using GPS (Global Positioning System) or the like, and the detection unit 12 detects the position of the display 10 based on the information indicating the position of the display 10 obtained by the positioning function. Detection may be performed while (eg, walking) or stationary. This detection may also be performed in the same manner as in the conventional method.

The detection unit 12 continuously detects the state of the user, for example, at regular intervals. The detection unit 12 outputs information indicating the detected state of the user to the control unit 13 each time of detection. Note that the detection unit 12 may detect at least one of the user states described above. Also, the detection unit 12 may detect the state of the user by a method other than the above-described method. Alternatively, the detection unit 12 may detect user states other than those described above as long as they are useful for control by the control unit 13, which will be described later.

The control unit 13 is a functional unit that controls operations related to display on the display 10 by another user according to the state of the user detected by the detection unit 12 . The control unit 13 may determine whether or not to perform control according to the focal length detected by the detection unit 12 . The control unit 13 may set an object to be controlled according to the line-of-sight direction detected by the detection unit 12 . The control unit 13 may perform control to prohibit another user from performing an operation related to the display of the display 10, or control to change the display related to the operation. The control unit 13 may store an operation from another user to be controlled, and execute the stored operation after the control ends.

The control by the control unit 13 is, for example, to prevent an operation from another user from interfering with the user wearing the display 10 . Since the display 10 is transmissive, the user wearing the display 10 can also perform actions other than looking at the display 10 . For example, the user can view a bus timetable or walk while the display 10 is displaying.

For example, as shown in FIG. 2A, a user wearing the display 10 turns his or her line of sight toward the center of the display screen 100 where no content is displayed, and sees a bus in the real world that is not displayed on the display 10. Suppose you are looking at a timetable. That is, the user wearing the display 10 is viewing the bus timetable and sharing the content with another user. At that time, as shown in FIG. 2B, when another user operates the content to move to the center of the display screen 100, that is, in front of the user who wears the display 10, the user changes the field of view. It interferes with the action of being blocked and looking at the bus timetable. Alternatively, if the content moves as described above while the user is walking, the user's field of view is blocked and the user cannot see the surroundings, which is dangerous. In this way, when the user is performing an action in the real world other than looking at the display 10, an operation from another user may interfere with the user's action. Control by the control unit 13 is for preventing an operation from another user from interfering with the action of the user. However, the control by the control unit 13 does not necessarily have to be performed for the above purposes, and may be performed for purposes other than the above. For example, the control unit 13 performs control as follows.

The control unit 13 receives information indicating the state of the user from the detection unit 12 . The control unit 13 determines whether or not to control the operation related to the display of the display 10 from another user based on the information input from the detection unit 12 based on pre-stored determination criteria. For example, if the information input from the detection unit 12 indicates the focal length, the control unit 13 makes the above determination based on whether the focal length is within a preset range. The above range is, for example, a range in which it can be determined that the user wearing the display 10 is focused on the display screen 100 of the display 10 , that is, the user is looking at the display screen 100 of the display 10 .

If the focal length is not within the above range, the display screen 100 of the display 10 is not seen, for example, assuming that the user is looking at (gazing at) an object in the real world. It is determined that the control for the operation from is performed. If the focal length is within the above range, the display screen 100 of the display 10 is viewed, and the control unit 13 determines not to control the operation from another user. This is because it is considered that, as long as the user is looking at the display screen 100 of the display 10, an operation from another user will not interfere with the user.

Alternatively, when the information input from the detection unit 12 indicates that the user is walking, the control unit 13 determines that control is to be performed for the operation from another user, and the information input from the detection unit 12 If the received information indicates that the user is not walking, the control unit 13 determines not to control the operation from another user.

The control unit 13 controls the display unit 11 when it determines that it will control an operation from another user and the display unit 11 is not being controlled at that time. The control is, for example, control that prohibits another user from performing an operation related to display on the display 10 . Specifically, the control is to move or enlarge the display information displayed on the display 10, to prohibit an operation from another user, that is, to temporarily stop the display information. Also, the control may prohibit some of the operations. For example, if the operation is to move the display information, the control may be a control to move the display information slightly without completely moving it according to the operation.

The display unit 11 receives control from the control unit 13 and performs processing according to the control. When the display unit 11 receives an operation related to the display of the display 10 while being controlled by the control unit 13, the display unit 11 identifies whether or not the operation is from another user. When identifying that the operation is from another user, the display unit 11 prohibits the operation. When identifying that the operation is not performed by another user, the display unit 11 performs the operation without prohibiting it.

The display unit 11 outputs information indicating the operation to be controlled to the control unit 13 . The control unit 13 inputs and stores (accumulates) information indicating the operation to be controlled from the display unit 11 .

Also, the control does not necessarily have to be control that prohibits the operation, and may be control that changes the display related to the operation. For example, control may be performed to hide or translucent the display information to be moved, or to display only the frame. Alternatively, the display information to be moved may be controlled to be displayed at a preset position on the display 10, for example, at a corner of the field of view. Further, control other than the above-described control may be performed as long as it meets the above-described purpose.

If the control unit 13 determines not to control the operation from another user, and if the display unit 11 is under control at that time, the control unit 13 cancels the control. The control unit 13 causes the display unit 11 to execute the operation to be controlled that is stored when the control is canceled and ended. As a result, for example, display information whose execution has been prohibited is moved. When the operation to be controlled is executed, the control unit 13 deletes the stored information indicating the operation.

In addition, the control unit 13 sets the target to be controlled from the information input from the detection unit 12 based on pre-stored criteria. For example, when the information input from the detection unit 12 indicates the direction of the line of sight, the control unit 13 sets the target to be controlled from the direction of the line of sight. The control unit 13 sets an area on the display screen 100 as an object to be controlled based on the position of the line of sight on the display screen 100, which is the direction of the line of sight. For example, an operation related to display by another user moves display information already displayed outside the set area of the display screen 100 to the set area, or displays new display information in the set area. If so, control over that operation is performed. Alternatively, if another user's operation related to display is an operation for display information already displayed in a set area, such as movement of display information already displayed in the set area, the control for the operation is performed. done.

The control unit 13 notifies the display unit 11 of the set area, and controls operations related to display from another user according to the area. When receiving control from the control unit 13, the display unit 11 identifies whether or not the operation is from another user. When the operation is identified as being performed by another user, the operation related to the display is to move the display information already displayed on the display screen 100 to the set area, or to move the display information to the set area. If the operation is to display display information, the display unit 11 prohibits the operation. Alternatively, if the operation related to display is for display information already displayed in the set area, the display unit 11 prohibits the operation. Also, the control over the operation from another user may be similar to that described above. Also in this case, the storage (accumulation) of information indicating the operation to be controlled by the control unit 13 and the execution of the operation after the end of the control may be performed. The above is the function of the display 10 according to the present embodiment.

Subsequently, the processing executed by the display 10 according to the present embodiment (operation method performed by the display 10) will be described using the flowchart of FIG. This processing is performed when the display 10 is worn by the user and the display unit 11 performs display on the display 10 . Also, the display can be shared with another display, and an operation related to the display of the display 10 can be performed by another user.

In this process, the state of the user wearing the display 10 is detected by the detection unit 12 (S01). Subsequently, the control unit 13 determines whether or not to control an operation related to display on the display 10 from another user based on the state of the user (S02). If it is determined that control is to be performed and the display unit 11 is not being controlled at that time (YES in S02), control is performed from the control unit 13 to the display unit 11 in response to another user's operation ( S03). The control is, for example, control that prohibits the operation. When the display unit 11 receives an operation from another user while the control is being performed, a process corresponding to the control is performed. For example, an operation from another user is prohibited. Further, the control unit 13 stores the operation to be controlled.

If it is determined in S02 that control is not to be performed, and if the display unit 11 is being controlled at that time (NO in S02), the control of the operation from another user from the control unit 13 to the display unit 11 is performed. It ends (S04). Further, when the operation to be controlled is stored by the control unit 13, the operation is performed by the display unit 11 after the control is finished (S05). Further, the above control may be performed by setting a target to be controlled according to the state of the user. The above processes (S01 to S05) are repeated while the display unit 11 is displaying. The above is the processing executed by the display 10 according to the present embodiment.

In this embodiment, an operation related to the display of the display 10 by another user is controlled according to the state of the user. For example, the display can be controlled according to the state of the user so that the display on the display 10 by another user's operation does not interfere with the user. Therefore, according to the present embodiment, it is possible to appropriately perform display on the display 10 according to the state of the user.

As in the present embodiment, the line of sight of the user may be detected as the state of the user wearing the display 10 . More specifically, the focal length of the line of sight of the user may be detected, and it may be determined whether or not to perform control according to the focal length. According to this configuration, for example, control can be performed when the user is not looking at the display screen 100 of the display 10, and the display on the display 10 may interfere with the user or pose a danger to the user. can be prevented.

Alternatively, the direction of the line of sight of the user may be detected, and the target to be controlled according to the direction of the line of sight may be set. According to this configuration, for example, it is possible to control only a necessary target according to the direction of the user's line of sight, and display on the display 10 can be performed more appropriately.

Further, as in the present embodiment, as the state of the user wearing the display 10, the movement state of the user, more specifically, whether or not the user is walking may be detected. According to this configuration, for example, control can be performed while the user is walking, and the display on the display 10 can prevent danger from occurring while the user is walking. The state of the user wearing the display 10 is not limited to the above, and other states may be detected and used as long as they are useful for controlling the display.

In addition, as in the present embodiment, as the control for the operation by another user, control to prohibit the operation or control to change the display related to the operation may be performed. According to this configuration, it is possible to appropriately and reliably perform display on the display in accordance with the state of the user. However, control other than the above may be performed as long as it is a control for appropriately performing display on the display.

Also, as in the present embodiment, an operation from another user who is to be controlled may be stored, and the stored operation may be executed after the control ends. According to this configuration, for example, after the control ends, the display on the display 10 can be shared with another display, and the user's convenience can be improved. However, it is not always necessary to execute the stored operation after the control ends.

As the state of the user wearing the display 10, the detection unit 12 may detect the heartbeat or sweating state of the user in addition to or instead of the above information. Specifically, the detection unit 12 may detect the user's heart rate or perspiration amount, or both. In this case, a sensor for detecting the heart rate or the amount of perspiration is attached to the user, and the display 10 acquires information indicating the heart rate or the amount of perspiration of the user from the sensor. Conventional sensors can be used as these sensors. In this case as well, the control unit 13 determines whether or not to control the operation related to the display of the display 10 from another user based on the information input from the detection unit 12 based on the determination criteria stored in advance in the same manner as described above. to judge. For example, if the sensor or perspiration amount indicated by the information input from the detection unit 12 is equal to or greater than a preset threshold value, or if it is equal to or less than a preset threshold value, the control unit 13 detects that another user is determined to control the operation of

With the configuration described above, for example, in a scene where an athlete is exercising and receives instructions from a coach on the display 10 worn by the athlete, the display method can be changed according to the athlete's heart rate or sweating amount. As a result, when making a dash just before the goal in a sprint, the instruction message from the coach can be prevented from obstructing the field of view. Alternatively, while wearing the display 10, when performing dangerous work at a high place, the remote operator's instructions are displayed only when an abnormal state is detected by the heart rate of the worker. be able to.

In the above-described embodiment, the display control device has been described as the display 10 having a display function, but it does not necessarily have to have a display function. The display control device is attached to the user's eye and is connected to a transmissive display that performs display according to an operation from another user (that is, includes a display unit 11), and controls display on the display. Any device (system) may be used as long as it includes the detection unit 12 and the control unit 13 described above.

It should be noted that the block diagrams used in the description of the above embodiments show blocks for each function. These functional blocks (components) are realized by any combination of at least one of hardware and software. Also, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or directly or indirectly using two or more devices that are physically or logically separated (e.g. , wired, wireless, etc.) and may be implemented using these multiple devices. A functional block may be implemented by combining software in the one device or the plurality of devices.

Functions include judging, determining, determining, calculating, calculating, processing, deriving, investigating, searching, checking, receiving, transmitting, outputting, accessing, resolving, selecting, choosing, establishing, comparing, assuming, expecting, assuming, Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc. can't For example, a functional block (component) responsible for transmission is called a transmitting unit or transmitter. In either case, as described above, the implementation method is not particularly limited.

For example, the display 10 in one embodiment of the present disclosure may function as a computer that performs information processing of the present disclosure. FIG. 4 is a diagram illustrating an example of a hardware configuration of display 10 according to an embodiment of the present disclosure. The display 10 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

In the following explanation, the term "apparatus" can be read as a circuit, device, unit, or the like. The hardware configuration of the display 10 may be configured to include one or more of each device shown in the drawing, or may be configured without some of the devices.

Each function of the display 10 is performed by loading predetermined software (programs) on hardware such as the processor 1001 and the memory 1002 so that the processor 1001 performs calculations, controls communication by the communication device 1004, controls the communication by the memory 1002 and It is realized by controlling at least one of data reading and writing in the storage 1003 .

The processor 1001, for example, operates an operating system and controls the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, registers, and the like. For example, each function of display 10 described above may be implemented by processor 1001 .

Also, the processor 1001 reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and executes various processes according to them. As the program, a program that causes a computer to execute at least part of the operations described in the above embodiments is used. For example, each function of display 10 may be implemented by a control program stored in memory 1002 and running on processor 1001 . Although it has been explained that the above-described various processes are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. FIG. Processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from a network via an electric communication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one of, for example, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. may be The memory 1002 may also be called a register, cache, main memory (main storage device), or the like. The memory 1002 can store executable programs (program code), software modules, etc. for performing information processing according to an embodiment of the present disclosure.

The storage 1003 is a computer-readable recording medium, for example, an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disc, a magneto-optical disc (for example, a compact disc, a digital versatile disc, a Blu-ray disk), smart card, flash memory (eg, card, stick, key drive), floppy disk, magnetic strip, and/or the like. Storage 1003 may also be called an auxiliary storage device. The storage medium included in display 10 may be, for example, a database, server, or other suitable medium including at least one of memory 1002 and storage 1003 .

The communication device 1004 is hardware (transmitting/receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also called a network device, a network controller, a network card, a communication module, or the like.

The input device 1005 is an input device (for example, keyboard, mouse, microphone, switch, button, sensor, etc.) that receives input from the outside. The output device 1006 is an output device (eg, display, speaker, LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated (for example, a touch panel).

Each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between devices.

In addition, the display 10 includes hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). A part or all of each functional block may be implemented by the hardware. For example, processor 1001 may be implemented using at least one of these pieces of hardware.

The order of the processing procedures, sequences, flowcharts, etc. of each aspect/embodiment described in the present disclosure may be changed as long as there is no contradiction. For example, the methods described in this disclosure present elements of the various steps using a sample order, and are not limited to the specific order presented.

Input/output information may be stored in a specific location (for example, memory) or managed using a management table. Input/output information and the like can be overwritten, updated, or appended. The output information and the like may be deleted. The entered information and the like may be transmitted to another device.

The determination may be made by a value represented by one bit (0 or 1), by a true/false value (Boolean: true or false), or by numerical comparison (for example, a predetermined value).

Each aspect/embodiment described in the present disclosure may be used alone, may be used in combination, or may be used by switching along with execution. In addition, the notification of predetermined information (for example, notification of “being X”) is not limited to being performed explicitly, but may be performed implicitly (for example, not notifying the predetermined information). good too.

Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be practiced with modifications and variations without departing from the spirit and scope of the present disclosure as defined by the claims. Accordingly, the description of the present disclosure is for illustrative purposes and is not meant to be limiting in any way.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language or otherwise, includes instructions, instruction sets, code, code segments, program code, programs, subprograms, and software modules. , applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like.

In addition, software, instructions, information, etc. may be transmitted and received via a transmission medium. For example, the software uses at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.) to website, Wired and/or wireless technologies are included within the definition of transmission medium when sent from a server or other remote source.

The terms "system" and "network" used in this disclosure are used interchangeably.

In addition, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values from a predetermined value, or may be expressed using other corresponding information. may be represented.

The terms "determining" and "determining" used in this disclosure may encompass a wide variety of actions. "Judgement" and "determination" are, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (eg, lookup in a table, database, or other data structure), ascertaining as "judged" or "determined", and the like. Also, "judgment" and "determination" are used for receiving (e.g., receiving information), transmitting (e.g., transmitting information), input, output, access (accessing) (for example, accessing data in memory) may include deeming that a "judgment" or "decision" has been made. In addition, "judgment" and "decision" are considered to be "judgment" and "decision" by resolving, selecting, choosing, establishing, comparing, etc. can contain. In other words, "judgment" and "decision" may include considering that some action is "judgment" and "decision". Also, "judgment (decision)" may be read as "assuming", "expecting", "considering", or the like.

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, It can include the presence of one or more intermediate elements between two elements being "connected" or "coupled." Couplings or connections between elements may be physical, logical, or a combination thereof. For example, "connection" may be read as "access". As used in this disclosure, two elements are defined using at least one of one or more wires, cables, and printed electrical connections and, as some non-limiting and non-exhaustive examples, in the radio frequency domain. , electromagnetic energy having wavelengths in the microwave and optical (both visible and invisible) regions, and the like.

The term "based on" as used in this disclosure does not mean "based only on" unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

Any reference to elements using the "first," "second," etc. designations used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, reference to a first and second element does not imply that only two elements can be employed or that the first element must precede the second element in any way.

Where "include," "including," and variations thereof are used in this disclosure, these terms are inclusive, as is the term "comprising." is intended. Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive OR.

In this disclosure, if articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are plural.

In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean that "A and B are different from C". Terms such as "separate," "coupled," etc. may also be interpreted in the same manner as "different."

10... display, 11... display unit, 12... detection unit, 13... control unit, 1001... processor, 1002... memory, 1003... storage, 1004... communication device, 1005... input device, 1006... output device, 1007... bus.

Claims

A display control device that controls display on a transmissive display that is worn on the user's eye and performs display according to an operation from another user,
a detection unit that detects the state of a user wearing the display;
a control unit that controls an operation related to display of the display from another user according to the state of the user detected by the detection unit;
A display controller comprising:
The display control device according to claim 1, wherein the detection unit detects the line of sight of the user as the state of the user wearing the display.
The detection unit detects the focal length of the line of sight of the user as the state of the user wearing the display,
3. The display control device according to claim 2, wherein said control unit determines whether to perform said control according to the focal length detected by said detection unit.
The detection unit detects, as a state of a user wearing the display, a direction of a line of sight of the user,
The display control device according to claim 2 or 3, wherein the control unit sets the target to be controlled according to the line-of-sight direction detected by the detection unit.
The display control device according to any one of claims 1 to 4, wherein the detection unit detects a moving state of the user as the state of the user wearing the display.
The display control device according to any one of claims 1 to 5, wherein the control unit performs control to prohibit an operation related to display of the display from another user, or control to change the display related to the operation. .
The display control device according to any one of claims 1 to 6, wherein the control unit stores an operation performed by another user to be controlled, and executes the stored operation after the control ends.
The display control device according to any one of claims 1 to 7, wherein the detection unit detects a state related to heartbeat or sweating of the user as the state of the user wearing the display.