WO2023026700A1

WO2023026700A1 - Display control apparatus

Info

Publication number: WO2023026700A1
Application number: PCT/JP2022/026986
Authority: WO
Inventors: 智仁山▲崎▼; けい石黒
Original assignee: 株式会社Ｎｔｔドコモ
Priority date: 2021-08-26
Filing date: 2022-07-07
Publication date: 2023-03-02
Also published as: JPWO2023026700A1

Abstract

The present invention easily and appropriately moves display information in a display using a virtual space.　A display 10, which is a display control apparatus, is an apparatus for controlling display in the display 10 for displaying display information, which is disposed in a virtual space, in accordance with a line of sight in the virtual space. The display 10 comprises: an opportunity detection unit 12 for detecting an opportunity for moving the display information in the virtual space; a setting unit 13 for setting the position and direction in the virtual space used for moving the display information in the virtual space; a conversion unit 14 for converting a coordinate system of the virtual space on the basis of the set position and direction in the virtual space when the opportunity has been detected; and a movement unit 15 for moving, in the converted coordinate system, the display information included in a region corresponding to the set position and direction in the virtual space and for restoring and converting the coordinate system of the virtual space to the original coordinate system.

Description

display controller

The present invention relates to a display control device that controls display on a display.

Conventionally, in displays such as head-mounted displays, display information arranged in a virtual space is displayed according to the line of sight in the virtual space. When the display information moves in the virtual space, the display changes according to the movement. Japanese Patent Laid-Open No. 2002-200001 discloses that display information in a virtual space is designated and moved by a line of sight in the virtual space.

Japanese Patent Application Laid-Open No. 2018-10702

However, with the method of designating display information to be individually moved according to the line of sight, as shown in Patent Document 1, it may be difficult to easily and appropriately move the display information. For example, in the above method, it is difficult or impossible to specify and move display information that is hidden behind other display information and is not displayed. A similar problem also arises in a method of designating display information to be individually moved by a user's operation, instead of designation by line of sight.

An embodiment of the present invention has been made in view of the above, and an object thereof is to provide a display control device capable of easily and appropriately moving display information in a display using a virtual space.

A display control device according to an embodiment of the present invention is a display control device that controls display on a display that displays display information arranged in a virtual space according to the line of sight in the virtual space, and that displays the display information in the virtual space. a trigger detection unit that detects a trigger for movement; a setting unit that sets the position and direction in the virtual space used to move the display information in the virtual space; a transformation unit that transforms the coordinate system of the virtual space based on the set position and direction in the virtual space; a moving unit that moves the display information included in the corresponding area to restore and transform the coordinate system of the virtual space to the original coordinate system.

In the display control device according to one embodiment of the present invention, the display information included in the area corresponding to the position and direction in the virtual space used for moving the display information is moved. Therefore, it is possible to easily move display information that could not be easily moved by the conventional method. Also, the coordinate system of the virtual space is transformed when the display information is moved. Therefore, the display information can be moved after being converted into a coordinate system that facilitates movement of the display information. As described above, according to the display control device according to the embodiment of the present invention, it is possible to easily and appropriately move the display information in the display using the virtual space.

According to one embodiment of the present invention, it is possible to easily and appropriately move display information in a display using virtual space.

It is a figure which shows the functional structure of the display which is a display control apparatus which concerns on embodiment of this invention. FIG. 4 is a diagram schematically showing examples of display information arranged in a virtual space and areas used for movement; FIG. 10 is a diagram schematically showing another example of display information arranged in a virtual space and areas used for movement; FIG. 4 is a diagram schematically showing an example of movement of display information in virtual space; 4 is a flow chart showing processing executed by a display that is a display control device according to an embodiment of the present invention; It is a figure which shows the hardware constitutions of the display which is a display control apparatus which concerns on embodiment of this invention.

Hereinafter, an embodiment of the display control device according to the present invention will be described in detail along with the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and overlapping descriptions are omitted.

FIG. 1 shows the functional configuration of a display 10, which is a display control device according to this embodiment. The display 10, which is a display device, controls display on the display 10 itself. The display 10 displays display information arranged in a virtual space (for example, a virtual three-dimensional space) according to the line of sight in the virtual space. The display information is, for example, contents such as characters, images, and moving images. The display information may be anything other than the above as long as it can be arranged in the virtual space and displayed according to the line of sight in the virtual space.

For example, the display 10 is a display that displays virtual content (display information) by XR such as AR (Augmented Reality), MR (Mixed Reality) or VR (Virtual Reality). The display 10 may be a transmissive display worn over the user's eye. For example, the display 10 may be a glasses-type head-mounted display, that is, see-through glasses (smart glasses, XR glasses). In the following description, the display 10 is assumed to be worn on the user's eye, ie, on the user's head. However, the display 10 need not be worn by the user.

The display 10 displays the display information of the area visible in the direction of the line of sight in the virtual space from the reference position of the line of sight (the starting point of the line of sight) in the virtual space. The line of sight in the virtual space includes the reference position of the line of sight in the virtual space and the direction of the line of sight in the virtual space. The display 10 can display by moving the line of sight in the virtual space. By moving the line of sight in the virtual space, the display information seen in the virtual space changes, and the display on the display 10 also changes.

The line of sight of the display 10 in the virtual space may be based on the position or orientation of the display 10 in the real space. Therefore, the display 10 may be provided with a sensor that detects the movement (ie, positional variation) and orientation (ie, attitude) of the display 10 itself. For example, an acceleration sensor that detects acceleration and a gyro sensor that detects angular velocity may be provided. The display 10 may detect the movement and orientation of the display 10 itself using these sensors, and move the line of sight in the virtual space according to the detected movement and orientation. That is, the line of sight may be moved according to the direction of the head (face) of the user wearing the display 10 . However, the movement of the line of sight in the virtual space may be performed according to the detection of the position or orientation by sensors other than those described above.

Also, the movement of the line of sight in the virtual space may be performed by the user's operation on the display 10 instead of by the sensor as described above. The display on the display 10 using the line of sight in the virtual space, including the movement of the line of sight in the virtual space, may be performed in the same manner as the conventional display by AR, MR, VR, or the like. The holding and processing of information regarding the virtual space may be performed in the display 10 or may be performed in a cloud or the like connected to the display 10 .

　The movement of the line of sight in the virtual space is performed according to a preset method. For example, movement of the line of sight in the virtual space is performed with a predetermined degree of freedom. The preset degree of freedom is, for example, 6 DoF (Degree of Freedom).

In 6DoF, the reference position of the line of sight in the virtual space can be moved in the three axial directions of the virtual space's X, Y, and Z axes. In 6DoF, the direction of the line of sight in the virtual space can be rotated around three axes of the X, Y, and Z axes of the virtual space. Therefore, when the user wearing the display 10 moves his/her head, it is possible to see display information according to the movement. However, the line of sight in the virtual space may be moved by a degree of freedom other than the above and by a method other than the above.

On the display 10, an operation related to display, for example, a user's operation on display information may be performed. The display 10 receives a user's operation and reflects the operation on the display. For example, operations such as generation, movement, enlargement and reduction of display information in the virtual space, and character input for display information may be performed. The operation may be performed using, for example, an information processing device such as a smart phone carried by the user wearing the display 10 . In that case, the display 10 and the smartphone are connected in advance so that information can be transmitted and received.

Also, the operation may be performed by a dedicated controller attached to the head-mounted display. Also, the operation may be performed by a user's gesture. The part of the user that makes the gesture is, for example, the hand. That is, an operation using a hand tracking gesture may be performed. However, an operation may be performed by a gesture using a part other than the hand. When an operation is performed by a user's gesture, a camera is provided so as to capture an image of the part where the gesture is performed, and the gesture is determined based on the moving image captured by the camera. Also, the operation may be performed in any manner other than the above. The above display and operation on the display 10 may be performed in the same manner as in the conventional method.

Display information commonly arranged in a common virtual space may be used for the display on the display 10 and the display on another display. That is, the virtual space and display information may be shared among multiple displays. The multiple displays with which the virtual space and display information are shared are preset. The line of sight of the virtual space in the display on the display 10 and in the display on the other display may be independent for each display. If the lines of sight on the displays are different, for example, different displays according to the respective lines of sight are performed on each display.

The virtual space may correspond to the real space. Accordingly, for example, by directing the display 10 to a specific position in the physical space, it is possible to display the display information arranged at the position in the virtual space corresponding to the specific position. As described above, the virtual space and display information are shared among the multiple displays, and the virtual space is associated with the real space, enabling asynchronous communication among the users of the multiple displays. For example, after a user arranges display information generated by himself/herself in a virtual space, another user directs the display to a position in the real space corresponding to the arrangement position of the display information so that the display information can be transferred to the other user. can be displayed on the display.

The above display information is, for example, a message (words, text) to another user or a three-dimensional video. Further, the display information may be a display of a soap bubble floating in the virtual space, and when the soap bubble is broken by a user's operation or the like, the message and content such as the three-dimensional video may be referred to. In other words, the content may be displayed in space in a state where the content is placed in a soap bubble.

As the display 10, a conventional display having the above functions can be used. Moreover, the display 10 may have a communication function. The communication function of the display 10 may be used to share the virtual space and display information described above and to realize the functions according to the present embodiment. In addition, some of the above-described functions of the display 10 and functions according to the present embodiment described later are an information processing device (such as a smartphone or a PC (personal computer)) connected to a display device (such as the above-described see-through glasses). may have. That is, the display 10 according to the present embodiment may be realized by including the display device and the information processing device.

Next, the functions of the display 10 according to this embodiment will be explained. As shown in FIG. 1 , the display 10 includes a display section 11 , a trigger detection section 12 , a setting section 13 , a conversion section 14 and a movement section 15 . In addition, the display 10 may have functions other than those described above that conventional display devices, such as conventional see-through glasses, have.

The functions of the display 10 described below are for moving the display information arranged in the virtual space. For example, when the display information is away from the reference position of the line of sight in the virtual space, the display information is displayed in a small size. When the display information is moved so as to approach the reference position of the line of sight, the display information is displayed in a large size so that the user can see it clearly.

As described above, in the conventional method of specifying (selecting) display information to be individually moved according to the line of sight, it is not possible to specify and move display information that is hidden behind other display information and is not displayed. It can be difficult. In addition, when a plurality of pieces of display information being displayed, that is, a plurality of pieces of display information included in the range of the user's field of vision are collectively brought closer to the reference position of the line of sight in the virtual space, the above-described conventional method is easy and appropriate. movement is difficult. A similar problem arises in a method of specifying display information to be individually moved by a user's operation instead of specifying by line of sight.

It is also conceivable to use a hand tracking gesture, a dedicated controller, or the like to designate display information that moves when the user touches the display information with his or her hand. However, this method limits the display information that can be specified within reach. For example, the user himself/herself needs to move when trying to move the displayed information in the distance. A method of designating display information to be moved by a pointer beam is also conceivable. However, this method requires a delicate operation, especially when specifying distant display information. Moreover, in each of the above methods, it may be difficult or impossible to collectively move a plurality of pieces of display information. The function according to the present embodiment solves the above problem and allows the displayed information to be moved easily and appropriately. For example, the function according to the present embodiment enables the user to operate display information that is out of reach with the user wearing the display 10 without any burden on the user.

It should be noted that the movement of display information related to display on the display 10 may be performed by functions other than the functions according to the present embodiment, in addition to the functions according to the present embodiment. For example, display information may be moved in any of the ways described above.

The display unit 11 is a functional unit that displays on the display 10. The display unit 11 receives and displays display information to be displayed on the display 10 . For example, the display unit 11 may input display information stored in the display 10, or receive and input display information from the outside. As described above, the display unit 11 displays the display information arranged in the virtual space according to the line of sight in the virtual space. Moreover, as described above, the display unit 11 may share the virtual space and display information with other displays. The sharing of the virtual space and the display information is performed, for example, by transmitting/receiving the information indicating the position of the display information and the virtual space where the display information is arranged to/from another display. Also, sharing of virtual space and display information may be performed via a server with which each display can communicate, instead of direct exchange between displays. Also, the virtual space and the display information may be shared between the displays by a method other than the above.

The above function of the display unit 11 may be the same as the conventional function. Further, the display by the display unit 11 is controlled by the moving unit 15 as will be described later.

The opportunity detection unit 12 is a functional unit that detects an opportunity (trigger) for moving display information in the virtual space. For example, the trigger detection unit 12 stores in advance the user's operation that serves as the trigger. It is assumed that the trigger detection unit 12 has detected the above-described trigger when the user's operation is received and the received user's operation is stored in advance. The user's operation that triggers the above is, for example, pressing a button, gesturing, or inputting a specific command by voice. Note that the trigger may be a user's operation other than the above, or may be other than the user's operation. When the trigger detection unit 12 detects the trigger, the trigger detection unit 12 notifies the setting unit 13 to that effect.

The setting unit 13 is a functional unit that sets the position and direction in the virtual space used to move the display information in the virtual space. The setting unit 13 may set the position and direction of the line of sight in the virtual space to the position and direction in the virtual space used for moving the display information in the virtual space.

The position and direction that are set are the criteria for determining the displayed information to move. For example, the reference position and direction of the line of sight in the virtual space are used in advance as the position and direction used for movement. The setting unit 13 receives notification of the detection of the trigger from the trigger detection unit 12 . At the timing of receiving the notification, the setting unit 13 acquires information indicating the reference position and direction of the line of sight in the virtual space held by the display unit 11, and moves the reference position and direction of the line of sight according to the movement of the display information. Set as the position and direction in the virtual space used for The information indicating the reference position of the line of sight in the virtual space is, for example, coordinates in the coordinate system (absolute coordinate system) of the virtual space. The information indicating the direction of the line of sight in the virtual space is, for example, a vector in the coordinate system of the virtual space. The coordinate system of the virtual space is, for example, an orthogonal coordinate system (X, Y, Z).

The setting unit 13 outputs information indicating the set position and direction in the virtual space used for movement to the conversion unit 14 . Note that the position and direction in the virtual space used for moving the display information need not be the position and direction of the line of sight in the virtual space, and may be other positions and directions. Further, the position and direction in the virtual space used to move the display information need not be set according to the previously stored setting criteria as described above. may

The conversion unit 14 is a functional unit that converts the coordinate system of the virtual space based on the position and direction in the virtual space set by the setting unit 13 when the trigger detection unit 12 detects the trigger. The conversion unit 14 receives information from the setting unit 13 indicating the position and direction in the virtual space used for movement. For example, the conversion unit 14 converts the coordinate axes of the virtual space so that the position indicated by the input information is the origin, and the direction indicated by the information is the preset direction extending from the origin. As described above, when the reference position and direction of the line of sight in the virtual space are the position and direction used for movement, the reference position of the line of sight is converted into a coordinate system having the origin. That is, the transformation unit 14 transforms the coordinate system (X, Y, Z) of the virtual space corresponding to the real space into the coordinate system (X', Y', Z') of the user's viewpoint (temporary coordinate system). The coordinate system after conversion may be an orthogonal coordinate system as described above, or may be another coordinate system (for example, a spherical coordinate system).

The transformation of the coordinate system itself should be performed by the conventional method. The conversion unit 14 also calculates the position (coordinates) of the display information in the coordinate system (X', Y', Z') after conversion. The conversion unit 14 outputs information indicating the coordinate system (X′, Y′, Z′) after conversion to the moving unit 15 .

The moving unit 15 moves the display information included in the area corresponding to the position and direction in the virtual space set by the setting unit 13 in the coordinate system transformed by the transforming unit 14, thereby moving the coordinate system of the virtual space. This is a functional unit that restores and transforms to the original coordinate system. The moving unit 15 may move the display information included in the fan-shaped or belt-shaped area according to the position and direction in the virtual space set by the setting unit 13 . The moving unit 15 may move each piece of display information to be moved at a speed corresponding to the position of the display information in the above area. The moving unit 15 may reduce or enlarge the display information according to the movement of the display information. The moving unit 15 performs, for example, the following processing.

The moving unit 15 receives information indicating the coordinate system (X', Y', Z') after conversion from the converting unit 14. The moving unit 15 sets a region (range) used for moving the display information in the converted coordinate system. For example, as shown in FIG. 2A, the moving unit 15 sets a fan-shaped area 200 in the coordinate system after conversion. More specifically, the region 200 is a conical or pyramidal region. When viewed from a direction perpendicular to the direction in which the region 200 extends (for example, from above), the region 200 extends in a fan shape as shown in FIG. 2(a). The fan shape may extend infinitely or may have a fixed size.

The movement unit 15 sets the area 200 according to the position and direction in the virtual space set by the setting unit 13 . Specifically, the moving unit 15 sets the region 200 with the origin of the coordinate system after conversion corresponding to the position set by the setting unit 13 (that is, the reference position of the line of sight in the virtual space) as the vertex. Further, the moving unit 15 shifts the direction of the coordinate system after conversion corresponding to the direction set by the setting unit 13 (that is, the direction of the line of sight in the virtual space) to the direction of the center of the angle extending from the origin of the region 200. The area 200 is set as above. That is, the moving unit 15 sets an area 200 corresponding to the range displayed on the display 10, that is, an area 200 corresponding to the field of view of the user, in the converted coordinate system. Note that the set area 200 does not have to match the range displayed on the display 10 . If the area 200 to be set matches the area displayed on the display 10 and the display 10 displays a rectangular shape, the area 200 to be set will expand in a pyramidal shape accordingly.

The moving unit 15 determines the display information 100 included in the set area 200 . The display information 100 included in the area 200 may include the entire display information 100 , or may include the center axis preset for each display information 100 . The moving unit 15 sets the display information 100 included in the set area 200 as the display information 100 to be moved. As shown in FIG. 2B, the moving unit 15 moves the display information 100 to be moved in a preset direction. As shown in FIG. 2B, the preset direction is, for example, the direction toward the origin, which is the vertex of the area 200 (that is, the reference position of the line of sight in the virtual space). That is, in the display on the display 10, the display information 100 is moved closer to the user (attracted to the user).

Since the display information 100 is moved toward the origin, it is performed by multiplying the coordinate value of the coordinate system after the display information 100 is converted by t (t is a positive value less than 1). When the display information 100 is moved, the moving unit 15 restores and transforms the coordinate system of the virtual space to the original coordinate system. The restoration transformation itself of the coordinate system may be performed by a conventional method. The display unit 11 reflects the moved display information 100 on the display on the display 10 . Therefore, the user can see the display information 100 that is moved and displayed.

Further, the moving unit 15 may move the display information 100 at a preset constant speed. For example, a plurality of values of t are prepared, and the moving unit 15 sequentially calculates the coordinates after conversion, so that the display information 100 gradually moves in the display on the display 10 (when the user gets closer to the user). ). Alternatively, the user's operation to stop the movement may be received, and the movement may continue until the user's operation is received.

Note that the moving direction of the display information 100 may be a direction away from the origin, that is, a direction away from the user, instead of the direction toward the origin. Also, the moving direction of the display information 100 may be a direction other than the above. Further, the type of the trigger detected by the trigger detector 12 may be associated in advance with the moving direction of the display information 100, and the display information 100 may be moved in the direction corresponding to the detected trigger type. Moreover, the movement of the display information 100 in the coordinate system after conversion may be performed by a method other than the above.

Further, the moving unit 15 may move each piece of display information 100 to be moved at a speed corresponding to the position of the display information 100 in the area 200 described above. For example, the moving unit 15 sets a partial area corresponding to an angle extending from the origin of the area 200 as shown in FIG. 2(a). Specifically, the moving unit 15 sets a central partial area 210 extending from the origin of the area 200 and having an angle Θ, and a partial area 220 having an angle Θ′ excluding the central angle Θ. The above angle Θ is, for example, 1 to 2°, which is the central vision angle of a human being. The above angle Θ′ is, for example, 4 to 20°, which is the range of the effective visual field of humans.

The moving unit 15 moves the display information 100 included in the partial area 210 at a speed v, and moves the display information 100 included in the partial area 220 at a speed sv. Note that v and s are preset values, and 0<s<1. That is, the display information 100 included in the inner partial area 210 is moved quickly, and the display information 100 included in the outer partial area 210 is moved slowly. As a result, the display information 100 moves fast in the portion near the center of the display screen of the display 10, and the display information 100 moves slowly in the outer portion. By moving the display information 100 in this way, the movement of the display information 100 can be adapted to the user's visual sense.

The moving directions of the area 200 and the display information 100 are not limited to those described above. For example, as shown in FIG. 3 , the moving unit 15 may set a band-shaped area 200 according to the position and direction in the virtual space set by the setting unit 13 and use it to move the display information 100 . Specifically, the moving unit 15 sets a band-shaped region 200 that includes the origin of the coordinate system after conversion corresponding to the position set by the setting unit 13 at its end and extends in the direction set by the setting unit 13. do. Further, the moving unit 15 moves the display information 100 included in the set area 200 in parallel with the direction set by the setting unit 13 . Alternatively, the entire coordinate system after conversion may be used as the region 200 described above.

The movement of display information will be explained again using FIG. In FIG. 4, the display information 100 is arranged in the virtual space, and the line of sight in the virtual space is directed from left to right, that is, toward the display information 100 to be arranged. When the line of sight in the virtual space moves by 6 DoF, as shown in FIG. 4A, the display information 100 behind is sometimes hidden by other display information 100 and cannot be seen or is difficult to see. In this case, since the distance is long, the appearance of the display information 100 in the back does not change much if the line of sight in the virtual space is slightly tilted.

When the display information is moved by the functions of the present embodiment described above, each piece of display information 100 approaches the reference position of the line of sight in the virtual space, as shown in FIG. 4(b). In this case, the movement of the display information 100 changes the distance u in the depth direction (direction of line of sight in the virtual space) as tu as described above, and does not change the height v of the display information 100 . However, the display information 100 may be moved so as to change the height v. As shown in FIG. 4(b), as a result of the movement of the display information, when the display information 100 approaches the reference position of the line of sight in the virtual space, if the line of sight in the virtual space is slightly moved, the display information 100 behind can also be confirmed. can do. That is, the display information 100 on the back can also be displayed on the display 10 so that the user can appropriately recognize it.

Similarly to the above, the two pieces of display information 100 overlapping in the line-of-sight direction, indicated by double-headed arrows in FIG. 100 can be confirmed, and an operation such as selecting the display information 100 can be performed.

Also, the moving unit 15 may reduce or enlarge the display information 100 according to the movement of the display information 100 . For example, the moving unit 15 stores the reduction ratio or enlargement ratio of the display information 100 according to the movement direction and movement amount, and moves the display information 100 according to the movement of the display information 100 based on the stored information. Shrink or expand. Further, when the display information 100 is reduced, an arbitrary minimum size may be set in advance, and the display information 100 may be reduced to that size. Moreover, when enlarging the display information 100, an arbitrary maximum size may be set in advance, and the display information may be enlarged to that size. The reduction or enlargement of the display information 100 is performed, for example, so that the movement of the display information 100 does not make the display information 100 difficult to see. The above is the function of the display 10 according to the present embodiment.

Subsequently, the processing executed by the display 10 according to the present embodiment (operation method performed by the display 10) will be described using the flowchart of FIG. This process is performed when the display section 11 displays on the display 10 .

In this process, the trigger detection unit 12 detects the trigger for moving the display information in the virtual space (S01). Subsequently, the setting unit 13 sets the position and direction in the virtual space used for moving the display information in the virtual space (S02). Subsequently, the transformation unit 14 transforms the coordinate system of the virtual space based on the position and direction in the virtual space set by the setting unit 13 (S03). Subsequently, the display information 100 included in the area corresponding to the position and direction in the virtual space set by the setting unit 13 is moved by the moving unit 15 in the converted coordinate system (S04). Subsequently, the moving unit 15 restores and transforms the coordinate system of the virtual space to the original coordinate system (S05). The movement of the display information 100 by the above processing is reflected in the display by the display section 11 on the display 10 . The above is the processing executed by the display 10 according to the present embodiment.

In this embodiment, the display information 100 included in the area 200 is moved according to the position and direction in the virtual space used for moving the display information 100 . Therefore, it is possible to easily move the display information 100, which could not be easily moved by the conventional method, for example, by specifying the display information by the line of sight and the user's operation. Also, the coordinate system of the virtual space is transformed when the display information 100 is moved. Therefore, it is possible to move the display information 100 after converting the display information into a coordinate system that is easy to move. For example, the display information 100 can be easily moved by multiplying the coordinate values by t as described above. As described above, according to the present embodiment, it is possible to easily and appropriately move the display information in the display using the virtual space. As a result, for example, by making the display information 100 appear near the user as described above, it is possible to improve visibility and ease of selection.

Further, as in the above-described embodiment, the setting unit 13 may set the position and direction of the line of sight in the virtual space to the position and direction in the virtual space used for moving the display information 100 in the virtual space. . According to this configuration, it is possible to appropriately move the display information 100 according to the position and direction of the line of sight in the virtual space. However, the position and direction in the virtual space used to move the display information 100 in the virtual space may be any position and direction other than the position and direction of the line of sight in the virtual space.

Further, as in the above-described embodiment, the moving unit 15 may move the display information 100 included in the fan-shaped or strip-shaped area 200 according to the position and direction in the virtual space set by the setting unit 13. good. According to this configuration, the display information 100 to be moved can be made appropriate. However, as described above, the region 200 is not limited to the above shape and may have any shape.

Further, as in the above-described embodiment, the moving unit 15 may move each piece of display information 100 to be moved at a speed corresponding to the position of the display information 100 in the area 200 . According to this configuration, as described above, for example, the display information 100 can be moved according to the user's visual sense.

Also, as in the above-described embodiment, the moving unit 15 may reduce or enlarge the display information 100 according to the movement of the display information 100 . According to this configuration, for example, it is possible to prevent the display information 100 from becoming difficult to see due to the movement of the display information 100 . However, the display information 100 may not be reduced or enlarged.

In the above-described embodiment, the display control device has been described as the display 10 having a display function, but it does not necessarily have to have a display function. The display control device is a device (system) that is connected to a display that displays display information arranged in the virtual space according to the line of sight of the virtual space (that is, includes the display unit 11) and that controls display on the display. , the trigger detection unit 12, the setting unit 13, the conversion unit 14, and the movement unit 15 described above. For example, some or all of the functional units 12 to 15 described above may be provided in a device such as a server capable of transmitting and receiving information to and from the display. In this case, each functional unit 12 to 15 provided in a device such as a server may transmit and receive input/output information to/from the display.

It should be noted that the block diagrams used in the description of the above embodiments show blocks for each function. These functional blocks (components) are realized by any combination of at least one of hardware and software. Also, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or directly or indirectly using two or more devices that are physically or logically separated (e.g. , wired, wireless, etc.) and may be implemented using these multiple devices. A functional block may be implemented by combining software in the one device or the plurality of devices.

Functions include judging, determining, determining, calculating, calculating, processing, deriving, investigating, searching, checking, receiving, transmitting, outputting, accessing, resolving, selecting, choosing, establishing, comparing, assuming, expecting, assuming, Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc. can't For example, a functional block (component) responsible for transmission is called a transmitting unit or transmitter. In either case, as described above, the implementation method is not particularly limited.

For example, the display 10 in one embodiment of the present disclosure may function as a computer that performs information processing of the present disclosure. FIG. 6 is a diagram illustrating an example of a hardware configuration of display 10 according to an embodiment of the present disclosure. The display 10 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

In the following explanation, the term "apparatus" can be read as a circuit, device, unit, or the like. The hardware configuration of the display 10 may be configured to include one or more of each device shown in the drawing, or may be configured without some of the devices.

Each function of the display 10 is performed by loading predetermined software (programs) on hardware such as the processor 1001 and the memory 1002 so that the processor 1001 performs calculations, controls communication by the communication device 1004, controls the communication by the memory 1002 and It is realized by controlling at least one of data reading and writing in the storage 1003 .

The processor 1001, for example, operates an operating system and controls the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, registers, and the like. For example, each function of display 10 described above may be implemented by processor 1001 .

Also, the processor 1001 reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and executes various processes according to them. As the program, a program that causes a computer to execute at least part of the operations described in the above embodiments is used. For example, each function of display 10 may be implemented by a control program stored in memory 1002 and running on processor 1001 . Although it has been explained that the above-described various processes are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. FIG. Processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from a network via an electric communication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one of, for example, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. may be The memory 1002 may also be called a register, cache, main memory (main storage device), or the like. The memory 1002 can store executable programs (program code), software modules, etc. for performing information processing according to an embodiment of the present disclosure.

The storage 1003 is a computer-readable recording medium, for example, an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disc, a magneto-optical disc (for example, a compact disc, a digital versatile disc, a Blu-ray disk), smart card, flash memory (eg, card, stick, key drive), floppy disk, magnetic strip, and/or the like. Storage 1003 may also be called an auxiliary storage device. The storage medium included in display 10 may be, for example, a database, server, or other suitable medium including at least one of memory 1002 and storage 1003 .

The communication device 1004 is hardware (transmitting/receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also called a network device, a network controller, a network card, a communication module, or the like.

The input device 1005 is an input device (for example, keyboard, mouse, microphone, switch, button, sensor, etc.) that receives input from the outside. The output device 1006 is an output device (eg, display, speaker, LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated (for example, a touch panel).

Each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between devices.

In addition, the display 10 includes hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). A part or all of each functional block may be implemented by the hardware. For example, processor 1001 may be implemented using at least one of these pieces of hardware.

The order of the processing procedures, sequences, flowcharts, etc. of each aspect/embodiment described in the present disclosure may be changed as long as there is no contradiction. For example, the methods described in this disclosure present elements of the various steps using a sample order, and are not limited to the specific order presented.

Input/output information may be stored in a specific location (for example, memory) or managed using a management table. Input/output information and the like can be overwritten, updated, or appended. The output information and the like may be deleted. The entered information and the like may be transmitted to another device.

The determination may be made by a value represented by one bit (0 or 1), by a true/false value (Boolean: true or false), or by numerical comparison (for example, a predetermined value).

Each aspect/embodiment described in the present disclosure may be used alone, may be used in combination, or may be used by switching along with execution. In addition, the notification of predetermined information (for example, notification of “being X”) is not limited to being performed explicitly, but may be performed implicitly (for example, not notifying the predetermined information). good too.

Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described in the present disclosure. The present disclosure can be practiced with modifications and variations without departing from the spirit and scope of the present disclosure as defined by the claims. Accordingly, the description of the present disclosure is for illustrative purposes and is not meant to be limiting in any way.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language or otherwise, includes instructions, instruction sets, code, code segments, program code, programs, subprograms, and software modules. , applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like.

In addition, software, instructions, information, etc. may be transmitted and received via a transmission medium. For example, the software uses at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.) to website, Wired and/or wireless technologies are included within the definition of transmission medium when sent from a server or other remote source.

The terms "system" and "network" used in this disclosure are used interchangeably.

In addition, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values from a predetermined value, or may be expressed using other corresponding information. may be represented.

The terms "determining" and "determining" used in this disclosure may encompass a wide variety of actions. "Judgement" and "determination" are, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (eg, lookup in a table, database, or other data structure), ascertaining as "judged" or "determined", and the like. Also, "judgment" and "determination" are used for receiving (e.g., receiving information), transmitting (e.g., transmitting information), input, output, access (accessing) (for example, accessing data in memory) may include deeming that a "judgment" or "decision" has been made. In addition, "judgment" and "decision" are considered to be "judgment" and "decision" by resolving, selecting, choosing, establishing, comparing, etc. can contain. In other words, "judgment" and "decision" may include considering that some action is "judgment" and "decision". Also, "judgment (decision)" may be read as "assuming", "expecting", "considering", or the like.

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, It can include the presence of one or more intermediate elements between two elements being "connected" or "coupled." Couplings or connections between elements may be physical, logical, or a combination thereof. For example, "connection" may be read as "access". As used in this disclosure, two elements are defined using at least one of one or more wires, cables, and printed electrical connections and, as some non-limiting and non-exhaustive examples, in the radio frequency domain. , electromagnetic energy having wavelengths in the microwave and optical (both visible and invisible) regions, and the like.

The term "based on" as used in this disclosure does not mean "based only on" unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

Any reference to elements using the "first," "second," etc. designations used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, reference to a first and second element does not imply that only two elements can be employed or that the first element must precede the second element in any way.

Where "include," "including," and variations thereof are used in this disclosure, these terms are inclusive, as is the term "comprising." is intended. Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive OR.

In this disclosure, if articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are plural.

In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean that "A and B are different from C". Terms such as "separate," "coupled," etc. may also be interpreted in the same manner as "different."

DESCRIPTION OF SYMBOLS 10... Display 11... Display part 12... Trigger detection part 13... Setting part 14... Conversion part 15... Movement part 1001... Processor 1002... Memory 1003... Storage 1004... Communication apparatus 1005... Input Device, 1006... Output device, 1007... Bus.

Claims

A display control device for controlling display on a display that displays display information arranged in a virtual space according to a line of sight in the virtual space,
a trigger detection unit for detecting a trigger for moving display information in a virtual space;
a setting unit for setting the position and direction in the virtual space used for moving display information in the virtual space;
a conversion unit that converts a coordinate system of a virtual space based on the position and direction in the virtual space set by the setting unit when the trigger is detected by the trigger detection unit;
In the coordinate system transformed by the transforming unit, the display information included in the area corresponding to the position and direction in the virtual space set by the setting unit is moved, and the coordinate system of the virtual space is returned to the original coordinate system. a moving part that restores and transforms;
A display controller comprising:
The display control device according to claim 1, wherein the setting unit sets the position and direction of the line of sight in the virtual space to the position and direction in the virtual space used for moving display information in the virtual space.
The display control device according to claim 1 or 2, wherein the moving unit moves display information included in a fan-shaped or band-shaped area according to the position and direction in the virtual space set by the setting unit.
The display control device according to any one of claims 1 to 3, wherein the moving unit moves each piece of display information to be moved at a speed corresponding to the position of the piece of display information in the area.
The display control device according to any one of claims 1 to 4, wherein the moving unit reduces or enlarges the display information according to the movement of the display information.