WO2023026628A1 - 表示制御装置 - Google Patents

表示制御装置 Download PDF

Info

Publication number
WO2023026628A1
WO2023026628A1 PCT/JP2022/022834 JP2022022834W WO2023026628A1 WO 2023026628 A1 WO2023026628 A1 WO 2023026628A1 JP 2022022834 W JP2022022834 W JP 2022022834W WO 2023026628 A1 WO2023026628 A1 WO 2023026628A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
sight
information
line
virtual space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/022834
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
有希 中村
康夫 森永
充宏 後藤
達哉 西▲崎▼
怜央 水田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Docomo Inc
Original Assignee
NTT Docomo Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NTT Docomo Inc filed Critical NTT Docomo Inc
Priority to JP2023543701A priority Critical patent/JP7603827B2/ja
Priority to US18/291,756 priority patent/US12307008B2/en
Publication of WO2023026628A1 publication Critical patent/WO2023026628A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics

Definitions

  • the present invention relates to a display control device that controls display on a display.
  • Sharing of the display with another user can also be performed in the above display mode using the omnidirectional image.
  • information arranged in a virtual space may be displayed according to the line of sight in the virtual space, and the virtual space may be shared among the head-mounted displays to display common information.
  • the line of sight in the virtual space is made independent of each other for each head mounted display, the user of each head mounted display can refer to different displays according to the line of sight in the virtual space.
  • An embodiment of the present invention has been made in view of the above, and aims to provide a display control device capable of appropriately displaying information in a virtual space common to a plurality of displays. aim.
  • a display control device transfers display information commonly arranged in a virtual space shared with other displays in the real space of each display.
  • a display control device that performs control related to display on a display that displays according to the line of sight for each display of a virtual space based on the position or orientation of the virtual space on the other display according to the display on the other display.
  • a position-of-interest information acquisition unit that acquires position-of-interest information indicating a position of interest; Prepare.
  • the display control device can display display information arranged in a common virtual space with other displays in a virtual space based on the position or orientation of each display in the real space.
  • a display control device that performs control related to display on a display that is displayed according to the line of sight for each display in the space, and attention position information that indicates the attention position in the virtual space on the display according to the display on the display by a predetermined trigger.
  • a transmission unit configured to transmit the attention position information generated by the attention position information generation unit to another display.
  • the line of sight in the virtual space displayed on one display is moved based on the attention position in the virtual space on the other display according to the display on the other display. Therefore, display corresponding to the attention position in the virtual space is performed on any display, and for example, the same display information can be referred to by users of the respective displays.
  • the display control device according to the embodiment of the present invention, it is possible to appropriately perform display when displaying common virtual space information among a plurality of displays.
  • the display control device it is possible to appropriately perform display when displaying common virtual space information among a plurality of displays.
  • FIG. 3 is a diagram showing functional configurations of a moving-side display and a reference-side display, which are the display control device according to the embodiment of the present invention
  • FIG. FIG. 2 is a diagram showing an example of a virtual space related to display on a display and display information arranged in the virtual space
  • FIG. 10 is a diagram for explaining movement of the line of sight in virtual space
  • FIG. 11 is a diagram showing an example of display after movement of the line of sight in the virtual space
  • FIG. 4 is a diagram showing an example of information used for designating display information
  • FIG. 4 is a sequence diagram showing processing executed by the moving-side display and the reference-side display, which are the display control device according to the embodiment of the present invention.
  • 4 is a diagram showing the hardware configuration of a moving-side display and a reference-side display, which are display control devices according to an embodiment of the present invention;
  • FIG. 4 is a sequence diagram showing processing executed by the moving-side display and the reference-side display, which are the display control device according to the embodiment of the present invention.
  • FIG. 1 shows displays 10 and 20, each of which is a display control device according to this embodiment.
  • the display 10 is also referred to as the moving-side display 10 and the display 20 is also referred to as the reference-side display 20, depending on the functions according to this embodiment, which will be described later.
  • the displays 10 and 20, which are display devices, perform control related to display on the displays 10 and 20 themselves.
  • the displays 10 and 20 share display information arranged in a common virtual space with the other displays 10 and 20 (displays 10 and 20 other than themselves) in the line of sight of each of the displays 10 and 20 in the virtual space. display accordingly.
  • the line of sight for each of the displays 10 and 20 in the virtual space is based on the positions or orientations of the displays 10 and 20 in the real space.
  • the displays 10 and 20 display display information (assets) arranged in a virtual three-dimensional space according to the line of sight in the virtual space.
  • Display information is information displayed on the displays 10 and 20 .
  • the display information is, for example, contents such as characters, images, and moving images.
  • the display information may change the displayed contents of the scheduler, browser, SNS (social networking service), specific applications, and the like.
  • the specific contents of the display information may be, for example, recipes, memos, maps, news articles, source codes, blueprints, and various materials.
  • the display information may be communication such as a chat between the users of the displays 10 and 20 .
  • the display information may be a 3DCG (three-dimensional computer graphics) model.
  • the display information may be displayed using a cloud service.
  • the display information may be anything other than the above as long as it can be arranged in the virtual space and displayed according to the line of sight in the virtual space.
  • the displays 10 and 20 are, for example, displays that display virtual content (display information) using AR (Augmented Reality) or the like.
  • the displays 10 and 20 are transmissive displays worn on the user's eyes.
  • the displays 10 and 20 may be glasses-type head-mounted displays, that is, see-through glasses (smart glasses, AR glasses).
  • the displays 10 and 20 are used by different users. Also, the displays 10 and 20 need not be worn by the user.
  • the displays 10 and 20 display the display information of the area visible in the direction of the line of sight in the virtual space from the reference position of the line of sight in the virtual space.
  • the line of sight in the virtual space includes the reference position of the line of sight in the virtual space and the direction of the line of sight in the virtual space.
  • the displays 10 and 20 can be displayed by moving the line of sight in the virtual space. By moving the line of sight in the virtual space, the display information seen in the virtual space changes, and the display on the displays 10 and 20 also changes.
  • the movement of the line of sight in the virtual space is performed according to a preset method.
  • the movement of the line of sight in the virtual space is performed with a preset degree of freedom.
  • the preset degree of freedom is, for example, 3DoF (Degree of Freedom).
  • 3DoF the reference position of the line of sight in the virtual space is fixed, and only the direction of the line of sight in the virtual space can be rotated around the X, Y, and Z axes of the virtual space.
  • the line of sight in the virtual space may be moved by a degree of freedom other than the above and by a method other than the above.
  • a sphere (omnidirectional sphere) 100 is provided in the virtual space as shown in FIG.
  • the two-dimensional display information 200 is arranged along the tangential plane of the sphere 100 toward the center of the sphere 100 . That is, the display information 200 is arranged so as to be visible from the center of the sphere 100 .
  • the center of the sphere 100 is the reference position of the line of sight in the virtual space.
  • the displays 10 and 20 display the display information 200 visible in the direction of the line of sight in the virtual space from the reference position of the line of sight in the virtual space.
  • the shape of the displayed area is the shape of the display screens of the displays 10 and 20, such as a rectangular shape. Since the viewing angles of the displays 10 and 20 (the angles at which the virtual space can be displayed) are limited as described above, only a portion corresponding to a portion of the sphere 100 is displayed. By changing the direction of the line of sight in the virtual space, the position of the displayed area changes, and the display on the displays 10 and 20 changes. Thus, displays 10 and 20 may be omnidirectional displays.
  • the display on the displays 10 and 20 may be performed by an application that performs the display.
  • the direction of the line of sight when the application is activated may be a preset default direction, or may be a different direction for each of the displays 10 and 20 .
  • the line of sight for each display 10, 20 in the virtual space is based on the position or orientation of the display 10, 20 in the real space. Therefore, the displays 10 and 20 may be provided with sensors for detecting the movement (ie positional variation) and orientation (ie attitude) of the displays 10 and 20 themselves. For example, an acceleration sensor that detects acceleration and a gyro sensor that detects angular velocity may be provided.
  • the displays 10 and 20 detect the movement and orientation of the displays 10 and 20 by these sensors, and move the line of sight in the virtual space according to the detected movement and orientation. That is, the line of sight may be moved according to the direction of the head (face) of the user wearing the displays 10 and 20 .
  • the movement of the line of sight in the virtual space may be performed according to the detection of the position or orientation by sensors other than those described above. Also, when the line of sight is moved in 3DoF as described above, only the orientation needs to be detected.
  • the display on the displays 10 and 20 using the line of sight in the virtual space may be performed in the same manner as the conventional display by AR or the like.
  • the holding and processing of information about the virtual space may be performed in either of the displays 10 and 20, or may be performed in a cloud or the like connected to the displays 10 and 20.
  • Display information commonly arranged in a common virtual space is used for display on the displays 10 and 20 . That is, the virtual space and display information may be shared among the multiple displays 10 and 20 . A plurality of displays 10 and 20 with which the virtual space and display information are shared are set in advance.
  • the line of sight of the virtual space in the display on the displays 10 and 20 is independent for each of the displays 10 and 20. FIG. If the lines of sight on the displays 10 and 20 are different, for example, in the case of 3DoF, if the directions of the lines of sight are different, the displays 10 and 20 perform different displays according to the respective lines of sight.
  • the same display is performed on the displays 10 and 20 .
  • an example in which two displays 10 and 20 share a virtual space is shown, but three or more displays 10 and 20 may share a virtual space.
  • an operation related to display for example, a user's operation on the display information 200 may be performed.
  • the displays 10 and 20 receive user's operations and reflect the operations on the display. For example, operations such as movement of the display information 200 in the virtual space, enlargement and reduction of the display information, character input to the display information, and rotation of the sphere 100 may be performed.
  • the operation may be performed using, for example, an information processing device such as a smart phone carried by the user wearing the displays 10 and 20 .
  • the displays 10 and 20 and the smartphone are connected in advance so that information can be transmitted and received.
  • the operation is reflected on the displays 10 and 20 .
  • the smartphone held by the user may be displayed so that a laser pointer appears at the position where the smartphone is pointed.
  • an operation such as designation of display information may be performed by displaying such a laser pointer.
  • the operation may be performed by a dedicated controller attached to the head-mounted display.
  • the operation may be performed by a user's gesture.
  • the part of the user that makes the gesture is, for example, the hand.
  • an operation may be performed using a hand gesture.
  • an operation may be performed by a gesture using a part other than the hand.
  • a camera is provided so as to capture an image of the part where the gesture is performed, and the gesture is determined based on the moving image captured by the camera.
  • the operation may be performed in any manner other than the above.
  • the above displays and operations on the displays 10 and 20 may be performed in the same manner as in conventional methods.
  • the displays 10 and 20 conventional displays having the above functions can be used. Moreover, the displays 10 and 20 have a communication function. The communication functions of the displays 10 and 20 are used to share the virtual space and display information described above and to realize the functions according to the present embodiment. Further, some of the above-described functions of the displays 10 and 20 and functions according to the present embodiment described later may be performed by an information processing device (for example, a smartphone or a PC (personal computer )) may have. That is, the displays 10 and 20 according to the present embodiment may be realized by including the display device and the information processing device.
  • an information processing device for example, a smartphone or a PC (personal computer )
  • the displays 10 and 20 are omnidirectional displays as described above
  • the displays 10 and 20 display images, videos, browsers, etc. as the display information as described above, so that the displays 10 and 20 are attached It is possible to construct a work space dedicated to a user who has This makes it possible to build a world where you can carry your private space anytime, anywhere and concentrate or relax. Also, if the displays 10 and 20 are see-through glasses, it is possible to use the displayed information while doing other work in the real space, that is, to use it while doing other work.
  • Use cases for the displays 10 and 20 as personal tools include work, hobbies, shopping, commuting to work and school, and the like.
  • Use cases for sharing the virtual space and display information on the multiple displays 10 and 20 include meetings, workshops, chats, planning, and the like.
  • the movement-side display 10 may have the functions of the reference-side display 20 according to this embodiment.
  • the reference-side display 20 may have the functions of the movement-side display 10 according to this embodiment.
  • the displays 10 and 20 may have the functions according to this embodiment of both the moving-side display 10 and the reference-side display 20 .
  • the displays 10 and 20 may have functions that conventional display devices such as conventional see-through glasses have, in addition to the functions described below.
  • the function of the movement-side display 10 and the reference-side display 20 according to the present embodiment is to display the virtual space on the movement-side display 10 based on the attention position in the virtual space on the reference-side display 20 according to the display on the reference-side display 20. It moves the line of sight. By moving the line of sight in the virtual space on the movement-side display 10, the display on the movement-side display 10 changes. As a result, the display information displayed on the reference-side display 20 is displayed on the moving-side display 10, and each user can refer to the same display information. However, as will be described later, even when the line of sight in the virtual space moves on the movement-side display 10, the display information displayed on the reference-side display 20 may not be displayed on the movement-side display 10 in some cases.
  • a lion 200a, an elephant 200b, and a horse 200c which are display information 200, are arranged at respective positions in the virtual space.
  • the line of sight in the virtual space on the reference-side display 20 faces the direction in which the lion 200a is arranged, and the reference-side display 20 displays the lion 200a.
  • the elephant 200b and the horse 200c are arranged on the opposite side of the line of sight in the virtual space on the reference-side display 20, and the elephant 200b and the horse 200c are not displayed on the reference-side display 20.
  • the line of sight in the virtual space on the display 10 on the moving side faces the direction where the elephant 200b and the horse 200c are arranged, and the display on the moving side 10 shows the elephant 200b and the horse. 200c is displayed.
  • the lion 200a is arranged on the side opposite to the line-of-sight direction of the virtual space on the moving-side display 10, and the lion 200a is not displayed on the moving-side display 10. - ⁇ Therefore, the user of the moving display 10 and the reference display 20 cannot refer to the same display information 200 .
  • the virtual space on the moving-side display 10 is displayed based on the attention position in the virtual space on the reference-side display 20, as shown in FIG. 3(d).
  • 's line of sight is moved to face the direction where the lion 200a is arranged.
  • the lion 200a is also displayed on the display 10 on the moving side. Therefore, the user of the moving display 10 and the reference display 20 can refer to the same display information 200 (lion 200a in this example).
  • the movement-side display 10 includes a display unit 11, an attention position information acquisition unit 12, and a line-of-sight movement unit 13.
  • the display unit 11 is a functional unit that performs display on the mobile display 10 .
  • the display unit 11 receives and displays display information to be displayed on the display 10 .
  • the display unit 11 may input display information stored in the display 10, or receive and input display information from the outside.
  • the display unit 11 displays the display information arranged in the virtual space according to the line of sight in the virtual space.
  • the display unit 11 shares the virtual space and display information with the reference side display 20, which is another display. The sharing of the virtual space and the display information is performed, for example, by transmitting/receiving the information indicating the position of the display information and the virtual space where the display information is arranged to/from the reference side display 20 .
  • the virtual space and display information may be shared not directly between the displays 10 and 20 but via a server with which the displays 10 and 20 can communicate. Also, the virtual space and display information may be shared between the displays 10 and 20 by a method other than the above. Information other than the above that is transmitted and received between the displays 10 and 20 may be transmitted and received directly between the displays 10 and 20, or may be transmitted and received via a server or the like.
  • the above function of the display unit 11 may be the same as the conventional function. Further, the display by the display unit 11 is controlled by the line-of-sight movement unit 13 as will be described later.
  • the attention position information acquisition unit 12 is a functional unit that acquires attention position information indicating the attention position in the virtual space on the reference side display 20 according to the display on the reference side display 20, which is another display.
  • the attention position information is information that can specify the line of sight in the virtual space corresponding to the attention position.
  • the attention position information is information that can specify the direction of the line of sight in the virtual space.
  • the position-of-interest information indicates the coordinates of the sphere 100 in the coordinate system of the virtual space.
  • the attention position information may indicate two declination angles in the polar coordinate system of the virtual space.
  • the two declination angles in this case are the polar (zenith, elevation) ⁇ and azimuth ⁇ .
  • the virtual space corresponds to the real space
  • the polar angle ⁇ and azimuth angle ⁇ of the virtual space correspond to the polar angle and azimuth angle of the real space. That is, the polar angle ⁇ of the virtual space is an angle corresponding to the vertical direction of the real space, and the azimuth angle ⁇ of the virtual space is an angle corresponding to the horizontal direction of the real space.
  • the attention position information may be information other than the above as long as it indicates the attention position.
  • the focused position information acquisition unit 12 receives and acquires focused position information from the reference side display 20 .
  • the reference-side display 20 transmits attention position information to the moving-side display 10 in response to a request from the moving-side display 10 or by a trigger of the reference-side display 20 itself.
  • the attention position information acquisition unit 12 requests the attention position information from the reference side display 20.
  • the attention position information acquisition unit 12 receives an operation from the user who designates the user of the reference side display 20 through a UI (user interface) as shown in FIG. ) to request attention position information from the reference side display 20 corresponding to the specified user.
  • UI user interface
  • the attention position information acquisition unit 12 outputs the acquired attention position information to the line-of-sight movement unit 13 .
  • the line-of-sight movement unit 13 is a functional unit that moves the line-of-sight in the virtual space displayed on the movement-side display 10 based on the position-of-interest information acquired by the position-of-interest information acquisition unit 12 .
  • the line-of-sight moving unit 13 may also move the line of sight based on the line-of-sight in the virtual space displayed on the movement-side display 10 before movement.
  • the line-of-sight movement unit 13 may move the line-of-sight in a preset direction based on the line-of-sight in the virtual space in the display of the movement-side display 10 before movement.
  • the line-of-sight movement unit 13 moves the display indicating the position of the position of interest or the position of the display information.
  • the side display 10 that is, the display unit 11
  • the line-of-sight movement unit 13 may cause the movement-side display 10 (that is, the display unit 11) to display that the display information related to the attention position indicated by the attention position information is related to the attention position.
  • the line-of-sight movement unit 13 moves the line-of-sight in the virtual space displayed on the movement-side display 10 as follows.
  • the line-of-sight movement unit 13 receives the attention position information from the attention position information acquisition unit 12 .
  • the line-of-sight movement unit 13 moves (synchronizes, transitions) the line-of-sight in the virtual space displayed by the display unit 11 to a position specified by the input attention position information. Due to the movement, the display on the display unit 11 corresponds to the line of sight after the movement.
  • the line-of-sight movement unit 13 may move (rotate) the line-of-sight in the virtual space so that the line-of-sight in the virtual space after movement matches the line-of-sight specified by the attention position information only at the azimuth angle ⁇ . That is, the line-of-sight movement unit 13 may move the line-of-sight in the virtual space only in the horizontal direction.
  • the attention position information may include only information indicating the azimuth angle ⁇ . Further, if the attention position information does not directly indicate the azimuth angle ⁇ , the line-of-sight movement unit 13 may calculate the azimuth angle to be moved at this point.
  • the azimuth of attention ⁇ B ⁇ , which is the azimuth of the direction of the attention position in the virtual space of the reference side display 20 (USER-B) shown in FIG.
  • the line-of-sight moving unit 13 rotates the line-of-sight of the virtual space of the moving-side display 10 by ⁇ in the horizontal direction (that is, around the Z-axis) so that the virtual space of the moving-side display 10 becomes as shown in FIG.
  • the azimuth angle ⁇ A of the line of sight in the virtual space after movement in the space is set to ⁇ .
  • the virtual You can change the display of space.
  • the line-of-sight moving unit 13 may move the line of sight based on the line-of-sight in the virtual space displayed on the movement-side display 10 before movement.
  • the line-of-sight moving unit 13 may move the line of sight in a preset direction (direction of the azimuth angle in the above example) based on the line-of-sight in the virtual space displayed on the movement-side display 10 before movement. .
  • the display range on the moving-side display 10 may not include the attention position and the display information 200 (content of interest, target content) related to the attention position.
  • the display information 200 related to the attention position is, for example, the display information 200 at the attention position, the display information 200 closest to the attention position, or the display information 200 within a certain distance from the attention position. That is, when the line of sight in the virtual space moves, the display information 200 may be out of the field of view.
  • the sight line movement unit 13 moves the attention position or the attention position.
  • the display section 11 may be caused to display the position of the information 200 .
  • the line-of-sight movement unit 13 calculates the display range on the movement-side display 10 from the line-of-sight in the virtual space after movement.
  • the line-of-sight movement unit 13 determines whether or not the position of interest or the display information 200 is included in the calculated display range. , causing the display unit 11 to perform the above display.
  • the display is an arrow 210 (that is, an arrow tag following them) indicating the direction in which the position of interest or display information 200 is located, as shown in FIG. 4(a).
  • the user of the mobile display 10 can easily find the attention position or the display information 200 by referring to this display.
  • the line-of-sight movement unit 13 may cause the display unit 11 to display that the display information related to the attention position indicated by the attention position information is related to the attention position.
  • the display is a highlight display in which a red display 220 is placed around the display information 200 as shown in FIG. 4(b).
  • the display is an animation display in which the display information 200 is hopped up and down as shown in FIG. 4(c).
  • any display other than the above may be used as long as it indicates that the display is related to the position of interest.
  • these displays may be performed when the display information 200 is included in the display range of the moving-side display 10 in addition to when the display information 200 is not included in the display range.
  • the user of the mobile display 10 can easily find the display information 200 or easily recognize the display information 200 by referring to this display.
  • the functions of the mobile display 10 have been described above.
  • the reference side display 20 includes a display section 21, an attention position information generation section 22, and a transmission section .
  • the display unit 21 is a functional unit that displays on the reference side display 20 .
  • the display unit 21 has the same function as the display unit 11 of the mobile display 10 described above.
  • the display unit 21 shares the virtual space and display information with the mobile display 10, which is another display.
  • the function of the display unit 21 related to the sharing is also the same as the function of the display unit 11 of the mobile display 10 .
  • Information used for display by the display unit 21 is referred to by the attention position information generation unit 22 .
  • the attention position information generation unit 22 is a functional unit that generates attention position information indicating the attention position in the virtual space on the reference-side display 20 according to the display on the reference-side display 20 by a predetermined trigger.
  • the attention position information generation unit 22 may detect the line of sight in the physical space of the user wearing the reference side display 20 and generate the attention position information according to the detected line of sight.
  • the attention position information generator 22 may generate the attention position information according to the position specified by the user of the reference side display 20 in the display on the reference side display 20 .
  • the attention position information generation unit 22 may generate the attention position information according to the position of the display information designated by the user of the reference side display 20 in the display on the reference side display 20 .
  • the attention position information generation unit 22 may use an input by at least one of voice, operation, and gesture of the user of the reference-side display 20 as a predetermined trigger.
  • the attention position information generation unit 22 generates attention position information as follows, for example.
  • the attention position information generation unit 22 inputs a trigger for generating attention position information.
  • the attention position information generation unit 22 receives a request for attention position information from the mobile display 10 and inputs the received request as a trigger.
  • the attention position information generation unit 22 may input a trigger other than the following request from the mobile display 10 .
  • the attention position information generation unit 22 inputs the voice of the user of the reference side display 20 as a trigger.
  • the attention position information generation unit 22 inputs the voice (utterance) of the user of the reference-side display 20 through a microphone or the like provided on the reference-side display 20 .
  • the attention position information generation unit 22 recognizes the input voice and determines whether or not the character string obtained by the voice recognition is a tag, which is a character string set as a trigger in advance.
  • speech recognition may be performed by the reference-side display 20, or may be performed by a server that performs speech recognition. When speech recognition is performed by the server, the attention position information generation unit 22 transmits the speech to the server and receives the speech recognition result from the server.
  • the attention position information generation unit 22 determines that the character string obtained by voice recognition is a tag set as a trigger in advance, the voice is used as a trigger.
  • the tags are set in advance using, for example, the virtual space UI of the reference-side display 20 or the dedicated management system of the information processing device connected to the reference-side display 20 .
  • the attention position information generation unit 22 generates the target position information only while the user of the reference side display 20 is pressing a specific button or while the user is making a specific hand gesture. You may input the voice of the said user to .
  • the attention position information generation unit 22 inputs the user's operation of the reference-side display 20 as a trigger. For example, the attention position information generation unit 22 receives an operation of the user and determines whether or not the received operation is a pattern set as a trigger in advance. When the attention position information generation unit 22 determines that the received operation is a pattern set as a trigger in advance, the attention position information generation unit 22 uses the operation as a trigger. Presetting of the pattern may be performed in the same manner as in the case of using sound as a trigger.
  • the trigger pattern is, for example, an operation of tapping the center portion of the trackpad of the smartphone connected to the reference-side display 20 n consecutive times (n is a preset natural number; the same applies hereinafter).
  • the trigger pattern is an operation of pulling the trigger button n consecutive times or an operation of pressing a specific button (bumper) n consecutive times on the dedicated controller connected to the reference side display 20 .
  • the trigger pattern is an operation of reproducing a specific drawing by displaying a laser pointer in a virtual space on a smartphone.
  • a specific figure is, for example, the shape of a circle.
  • the graphical reproduction may be a simple sketch, an actual rendering, or any of the above.
  • the trigger pattern may be another operation.
  • the attention position information generation unit 22 inputs a gesture of the user of the reference-side display 20, such as a hand gesture, as a trigger. For example, the attention position information generation unit 22 receives a gesture of the user and determines whether or not the received gesture is a pattern set as a trigger in advance. When the attention position information generation unit 22 determines that the received gesture is a pattern set as a trigger in advance, the attention position information generation unit 22 uses the gesture as a trigger. Presetting of the pattern may be performed in the same manner as in the case of using sound as a trigger.
  • the trigger pattern is, for example, a gesture that can be detected by an existing conventional system (eg, Fist (hand gesture making a fist), OK (hand gesture making an OK sign), C (hand making a C shape). gesture)).
  • the trigger pattern may be another gesture.
  • it may be a peace sign, an action to switch from goo (clenched fist) to par (fingers spread), or clap.
  • the attention position information generation unit 22 generates attention position information when a trigger is input.
  • the position of interest in the virtual space related to the generated position-of-interest information is, for example, the coordinates of the sphere 100 in the virtual space corresponding to the central position (position of the reticle) of the display screen of the reference-side display 20 .
  • the direction of the line of sight in the virtual space is the center position of the display screen
  • the attention position information generation unit 22 refers to the information to generate attention position information.
  • the attention position information indicates only the predetermined direction of the attention position. (The same applies to the following).
  • the attention position in the virtual space related to the generated attention position information may also correspond to the line of sight in the real space of the user wearing the reference-side display 20 .
  • the attention position information generation unit 22 detects the line of sight of the user in the physical space.
  • the reference-side display 20 is provided with a camera capable of capturing an eyeball of the user.
  • the attention position information generation unit 22 inputs an image of the user's eyeball obtained by imaging with a camera.
  • the attention position information generation unit 22 detects the line of sight of the user in the physical space from the input image of the user's eyeballs.
  • the attention position information generation unit 22 detects the movement of the user's eyeball from the moving image of the user's eyeball, and detects the line of sight based on the movement. As the direction of the line of sight to be detected, the attention position information generation unit 22 uses, for example, the position of the line of sight in the real space on the display screen of the reference side display 20 (the position of the intersection of the line of sight and the display screen, for example, the coordinates on the display screen). ). The detection may be performed by conventional methods.
  • the position of interest in the virtual space related to the generated position-of-interest information is the coordinates of the sphere 100 in the virtual space corresponding to the position of the line of sight in the real space on the display screen of the reference side display 20 . Since the display unit 11 holds information indicating the direction of the line of sight in the virtual space (that is, information indicating the position in the virtual space corresponding to the display screen of the reference-side display 20), the attention position information generation unit 22 From the information and the detected line-of-sight position in the real space, the coordinates of the sphere 100 in the virtual space corresponding to the line-of-sight position are calculated and used as position-of-interest information. Calculation of the position in the virtual space of the coordinates on the display screen may be performed by a conventional method (the same applies to the following).
  • the attention position in the virtual space related to the generated attention position information may also correspond to the position (pointing position) designated by the user of the reference side display 20 in the display on the reference side display 20.
  • the user designates the position of the display screen (for example, coordinates on the display screen) on the reference side display 20 .
  • the designation of the position of the display screen is performed by the user's operation.
  • the designation of the position on the display screen may be performed with a cursor or a pointer.
  • the attention position information generation unit 22 receives a user's operation and acquires information indicating the position of the display screen designated by the operation.
  • the position of interest in the virtual space related to the generated position-of-interest information is the coordinates of the sphere 100 in the virtual space corresponding to the designated position on the display screen of the reference-side display 20 . Since the display unit 11 holds information indicating the direction of the line of sight in the virtual space (that is, information indicating the position in the virtual space corresponding to the display screen of the reference-side display 20), the attention position information generation unit 22 Based on the information and the specified position of the display screen, the coordinates of the sphere 100 in the virtual space corresponding to the specified position of the display screen are calculated and used as position-of-interest information.
  • the attention position in the virtual space related to the generated attention position information also corresponds to the position of the display information (content) specified by the user of the reference side display 20 in the display on the reference side display 20. good too.
  • the user specifies display information on the reference side display 20 .
  • the display information may be displayed on the reference side display 20 .
  • the user specifies display information on the reference side display 20 .
  • the attention position information generation unit 22 acquires information indicating the designated position of the display screen.
  • the attention position information generation unit 22 stores in advance the display information and the tags, which are character strings, in association with each other.
  • the lion 200a shown in FIG. 3 is associated with the tag "#LION”
  • the elephant 200b is associated with the tag "#ELEPHANT”
  • the horse 200c is associated with the tag "#HORSE”.
  • the attention position information generation unit 22 inputs the voice (utterance) of the user of the reference-side display 20 through a microphone or the like provided on the reference-side display 20 .
  • the attention position information generation unit 22 performs voice recognition on the input voice and determines whether or not the character string obtained by the voice recognition is a tag associated with the display information in advance. Note that voice recognition may be performed by the reference-side display 20 in the same manner as described above, or may be performed by a server that performs voice recognition.
  • the attention position information generation unit 22 determines that the character string obtained by voice recognition is a preset tag, it acquires the position in the virtual space of the display information associated with the tag. Since the display unit 11 holds information indicating the position of the display information in the virtual space, the attention position information generation unit 22 acquires the information.
  • the attention position information generation unit 22 calculates the coordinates of the sphere 100 in the virtual space corresponding to the position of the display information in the virtual space, and sets the coordinates of the virtual space sphere 100 as the attention position information. For example, when the display information is arranged on the sphere 100 in the virtual space, the information indicating the coordinates of the position of the display information in the virtual space is used as the position-of-interest information.
  • the position of the intersection of the sphere 100 in the virtual space and a straight line extending from the line-of-sight position in the virtual space and passing through the position in the virtual space of the display information is arranged outside the sphere 100 in the virtual space.
  • the information indicating the coordinates be attention position information.
  • the designation of display information may be performed by a user's operation other than the user's voice on the reference side display 20 .
  • the attention position information generation unit 22 stores in advance the display information and the user's operation in association with each other. For example, as shown in FIG. 5A, a content ID, which is an identifier of display information, and a controller pattern, which is a user's operation, are associated and stored. Examples of controller patterns are similar to the triggering user operations described above.
  • the attention position information generation unit 22 receives a user's operation on the reference side display 20 and uses display information associated with the received operation as designated display information.
  • display information may be designated by a gesture of the user of the reference-side display 20, for example, a hand gesture.
  • the attention position information generation unit 22 stores in advance the display information and the user's gesture in association with each other. For example, as shown in FIG. 5B, a content ID, which is an identifier of display information, and a hand gesture are associated and stored. Examples of hand gestures are similar to the triggering gestures described above.
  • the attention position information generation unit 22 accepts a gesture of the user of the reference-side display 20 and uses the display information associated with the accepted gesture as the designated display information.
  • designation of display information may be performed in a manner other than the above. For example, designation of display information may be performed with a cursor or a pointer. Further, when the display information is specified, the line of sight in the virtual space on the reference side display 20 may be aligned with the position of the display information. Further, when display information is designated as described above, the designation may be used as a trigger for generating attention position information.
  • the attention position information generation unit 22 outputs the generated attention position information to the transmission unit 23 .
  • the transmission unit 23 is a functional unit that transmits the position-of-interest information generated by the position-of-interest information generation unit 22 to the moving-side display 10, which is another display.
  • the transmission unit 23 receives the attention position information from the attention position information generation unit 22 .
  • the transmission unit 23 transmits the attention position information to the mobile display 10, which is the transmission source of the request.
  • the transmission unit 23 transmits the attention position information to the specified movement side display 10 .
  • the mobile display 10 to which the attention position information is transmitted may be designated in advance. For example, all the mobile displays 10 that share the virtual space and the display information may be the mobile displays 10 to which the attention position information is transmitted. Alternatively, the mobile display 10 to which the attention position information is transmitted may be designated by the user of the reference side display 20 at the time the attention position information is transmitted. The above is the function of the reference side display 20 .
  • the processing executed by the moving-side display 10 and the reference-side display 20 according to the present embodiment operation method performed by the moving-side display 10 and the reference-side display 20
  • This processing is performed when the display by the display unit 11 on the moving-side display 10 and the display by the display unit 21 on the reference-side display 20 are performed.
  • the movement-side display 10 and the reference-side display 20 share the virtual space and the display information with each other, and display is performed.
  • a trigger for generation of attention position information is input by the attention position information generation unit 22 on the reference side display 20 (S01). Subsequently, attention position information is generated by the attention position information generation unit 22 according to the display on the reference side display 20 (S02). Subsequently, the generated attention position information is transmitted to the mobile display 10 by the transmission unit 23 (S03).
  • the attention position information is received and acquired by the attention position information acquisition unit 12 (S04). Subsequently, the line-of-sight movement unit 13 moves the line-of-sight in the virtual space displayed on the movement-side display 10 based on the attention position information (S05).
  • the above is the processing executed by the moving-side display 10 and the reference-side display 20 according to the present embodiment.
  • the line of sight in the virtual space displayed on the movement-side display 10 is moved based on the attention position in the virtual space on the reference-side display 20 according to the display on the reference-side display 20 . Therefore, on both displays 10 and 20, display is performed according to the attention position in the virtual space, and for example, the same display information can be referred to by users of the respective displays.
  • the displayed information that can be seen differs for each user. If users can easily refer to the same display information according to the present embodiment, users can communicate with each other while referring to the display information without using words to communicate the position of the display information in the virtual space. It can be done smoothly. In other words, according to the present embodiment, it is possible to appropriately perform display when displaying common virtual space information between the plurality of displays 10 and 20 .
  • the mobile display 10 may have the following configuration.
  • the line of sight may also be moved based on the line of sight in the virtual space displayed on the movement-side display 10 before movement. More specifically, the line of sight may be moved only in a predetermined direction based on the line of sight in the virtual space in the display of the moving-side display 10 before movement, for example, the azimuth angle as described above. According to this configuration, it is possible to make it easier for the user of the movable display 10 to change the display by moving the line of sight.
  • the movement of the line of sight does not necessarily have to be performed as described above, and may be performed in any manner as long as it is based on the attention position information.
  • the display indicating the attention position or the position of the display information is displayed. You may let the part 11 perform. According to this configuration, as described above, the user of the mobile display 10 can easily find the attention position or the display information by referring to this display.
  • the display unit 11 may be caused to display that the display information related to the attention position indicated by the attention position information is related to the attention position. According to this configuration, as described above, the user of the mobile display 10 can easily find the display information 200 or easily recognize the display information 200 by referring to this display. However, it is not always necessary to perform these displays when moving the line of sight.
  • the reference side display 20 may have the following configuration.
  • the line of sight of the user wearing the reference-side display 20 in the physical space may be detected, and the position-of-interest information may also be generated according to the detected line of sight.
  • attention position information may be generated according to the position designated by the user of the reference side display 20 as well. According to these configurations, the user wearing the reference-side display 20 can share the line of sight based on the position where the user is paying more attention. As a result, when displaying common virtual space information between the plurality of displays 10 and 20, the display can be performed more appropriately.
  • attention position information may be generated according to the position of the display information designated by the user of the reference-side display 20 as well.
  • the user wearing the reference side display 20 can share the line of sight based on the display information that the user is paying attention to.
  • attention position information does not necessarily have to be generated in this manner, and may be performed according to the display on the reference-side display 20 .
  • an input by at least one of the user's voice, operation, and gesture on the reference-side display 20 may be used as a trigger for generating attention position information.
  • the user on the reference side display 20 side can easily share the line of sight.
  • the trigger for generating attention position information does not necessarily have to be the above.
  • the display control device has been described as the movement-side display 10 and the reference-side display 20 having a display function, but it does not necessarily have to have a display function.
  • the display control device displays display information arranged in a common virtual space with other displays according to the line of sight of each display in the virtual space (that is, the display unit 11 or the display unit 21 is displayed).
  • a device (system) that is connected to a display and controls display on the display, and includes the attention position information acquisition unit 12 and the line of sight movement unit 13 described above, or the attention position information generation unit 22 described above. , and the transmission unit 23 .
  • the movement of the line of sight in the virtual space on the moving-side display 10 may be a one-time synchronization performed at that moment in the form of a snapshot. It may be dynamic synchronization that tracks the virtual space line of sight on the display 20 .
  • attention position information is continuously transmitted from the reference side display 20 to the movement side display 10, and the movement side display 10 sequentially moves the line of sight in the virtual space based on the attention position information.
  • a tag or pattern used for detecting a trigger or designating information to be displayed on the reference side display 20 may be set only for a specific reference side display 20, or may be set for a plurality of (for example, all) reference side displays. It may be set in common in the display 20 .
  • settings are made only on a specific reference-side display 20, only a specific user using that reference-side display 20 can use the function based on the set information.
  • the setting is common to a plurality of (for example, all) reference-side displays 20, a plurality of (for example, all) users using the reference-side display 20 use the function based on the set information. be able to.
  • each functional block may be implemented using one device that is physically or logically coupled, or directly or indirectly using two or more devices that are physically or logically separated (e.g. , wired, wireless, etc.) and may be implemented using these multiple devices.
  • a functional block may be implemented by combining software in the one device or the plurality of devices.
  • Functions include judging, determining, determining, calculating, calculating, processing, deriving, investigating, searching, checking, receiving, transmitting, outputting, accessing, resolving, selecting, choosing, establishing, comparing, assuming, expecting, assuming, Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc. can't
  • a functional block (component) responsible for transmission is called a transmitting unit or transmitter.
  • the implementation method is not particularly limited.
  • the displays 10 and 20 in one embodiment of the present disclosure may function as computers that perform information processing of the present disclosure.
  • FIG. 7 is a diagram showing an example of a hardware configuration of displays 10 and 20 according to an embodiment of the present disclosure.
  • the displays 10 and 20 described above may physically be configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.
  • the term "apparatus” can be read as a circuit, device, unit, or the like.
  • the hardware configuration of the displays 10 and 20 may be configured to include one or more of the devices shown in the figures, or may be configured without some of the devices.
  • Each function of the displays 10 and 20 is performed by causing the processor 1001 and the memory 1002 to load predetermined software (programs) into hardware such as the processor 1001 and the memory 1002, thereby causing the processor 1001 to perform calculations, control communication by the communication device 1004, and control the memory. It is realized by controlling at least one of data reading and writing in 1002 and storage 1003 .
  • the processor 1001 for example, operates an operating system and controls the entire computer.
  • the processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, registers, and the like.
  • CPU central processing unit
  • each function of the displays 10 and 20 described above may be implemented by the processor 1001.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • the processor 1001 reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and executes various processes according to them.
  • programs program codes
  • software modules software modules
  • data etc.
  • the program a program that causes a computer to execute at least part of the operations described in the above embodiments is used.
  • each function of displays 10 and 20 may be implemented by a control program stored in memory 1002 and running on processor 1001 .
  • FIG. Processor 1001 may be implemented by one or more chips.
  • the program may be transmitted from a network via an electric communication line.
  • the memory 1002 is a computer-readable recording medium, and is composed of at least one of, for example, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. may be
  • ROM Read Only Memory
  • EPROM Erasable Programmable ROM
  • EEPROM Electrical Erasable Programmable ROM
  • RAM Random Access Memory
  • the memory 1002 may also be called a register, cache, main memory (main storage device), or the like.
  • the memory 1002 can store executable programs (program code), software modules, etc. for performing information processing according to an embodiment of the present disclosure.
  • the storage 1003 is a computer-readable recording medium, for example, an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disc, a magneto-optical disc (for example, a compact disc, a digital versatile disc, a Blu-ray disk), smart card, flash memory (eg, card, stick, key drive), floppy disk, magnetic strip, and/or the like.
  • Storage 1003 may also be called an auxiliary storage device.
  • the storage medium included in displays 10 and 20 may be, for example, a database, server, or other suitable medium including at least one of memory 1002 and storage 1003 .
  • the communication device 1004 is hardware (transmitting/receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also called a network device, a network controller, a network card, a communication module, or the like.
  • the input device 1005 is an input device (for example, keyboard, mouse, microphone, switch, button, sensor, etc.) that receives input from the outside.
  • the output device 1006 is an output device (eg, display, speaker, LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated (for example, a touch panel).
  • Each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information.
  • the bus 1007 may be configured using a single bus, or may be configured using different buses between devices.
  • the displays 10 and 20 include hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). , and part or all of each functional block may be implemented by the hardware.
  • processor 1001 may be implemented using at least one of these pieces of hardware.
  • Input/output information may be stored in a specific location (for example, memory) or managed using a management table. Input/output information and the like can be overwritten, updated, or appended. The output information and the like may be deleted. The entered information and the like may be transmitted to another device.
  • the determination may be made by a value represented by one bit (0 or 1), by a true/false value (Boolean: true or false), or by numerical comparison (for example, a predetermined value).
  • notification of predetermined information is not limited to being performed explicitly, but may be performed implicitly (for example, not notifying the predetermined information). good too.
  • Software whether referred to as software, firmware, middleware, microcode, hardware description language or otherwise, includes instructions, instruction sets, code, code segments, program code, programs, subprograms, and software modules. , applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like.
  • software, instructions, information, etc. may be transmitted and received via a transmission medium.
  • the software uses at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.) to website, Wired and/or wireless technologies are included within the definition of transmission medium when sent from a server or other remote source.
  • wired technology coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.
  • wireless technology infrared, microwave, etc.
  • system and “network” used in this disclosure are used interchangeably.
  • information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values from a predetermined value, or may be expressed using other corresponding information. may be represented.
  • determining and “determining” used in this disclosure may encompass a wide variety of actions.
  • “Judgement” and “determination” are, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (eg, lookup in a table, database, or other data structure), ascertaining as “judged” or “determined”, and the like.
  • "judgment” and “determination” are used for receiving (e.g., receiving information), transmitting (e.g., transmitting information), input, output, access (accessing) (for example, accessing data in memory) may include deeming that a "judgment” or “decision” has been made.
  • judgment and “decision” are considered to be “judgment” and “decision” by resolving, selecting, choosing, establishing, comparing, etc. can contain.
  • judgment and “decision” may include considering that some action is “judgment” and “decision”.
  • judgment (decision) may be read as “assuming”, “expecting”, “considering”, or the like.
  • connection means any direct or indirect connection or coupling between two or more elements, It can include the presence of one or more intermediate elements between two elements being “connected” or “coupled.” Couplings or connections between elements may be physical, logical, or a combination thereof. For example, “connection” may be read as "access”.
  • two elements are defined using at least one of one or more wires, cables, and printed electrical connections and, as some non-limiting and non-exhaustive examples, in the radio frequency domain. , electromagnetic energy having wavelengths in the microwave and optical (both visible and invisible) regions, and the like.
  • any reference to elements using the "first,” “second,” etc. designations used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, reference to a first and second element does not imply that only two elements can be employed or that the first element must precede the second element in any way.
  • a and B are different may mean “A and B are different from each other.”
  • the term may also mean that "A and B are different from C”.
  • Terms such as “separate,” “coupled,” etc. may also be interpreted in the same manner as “different.”

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/JP2022/022834 2021-08-25 2022-06-06 表示制御装置 Ceased WO2023026628A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023543701A JP7603827B2 (ja) 2021-08-25 2022-06-06 表示制御装置
US18/291,756 US12307008B2 (en) 2021-08-25 2022-06-06 Display control device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021137104 2021-08-25
JP2021-137104 2021-08-25

Publications (1)

Publication Number Publication Date
WO2023026628A1 true WO2023026628A1 (ja) 2023-03-02

Family

ID=85321763

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/022834 Ceased WO2023026628A1 (ja) 2021-08-25 2022-06-06 表示制御装置

Country Status (3)

Country Link
US (1) US12307008B2 (https=)
JP (1) JP7603827B2 (https=)
WO (1) WO2023026628A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110152068A1 (en) 2009-12-17 2011-06-23 General Electric Company Processing of high surface area oxides

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1091057A (ja) * 1996-09-17 1998-04-10 Mitsubishi Electric Corp 技術相談支援システム
JP2000020753A (ja) * 1998-07-07 2000-01-21 Mitsubishi Electric Corp 仮想空間制御装置
JP2018073172A (ja) * 2016-10-31 2018-05-10 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および画像生成方法
JP2018142230A (ja) * 2017-02-28 2018-09-13 キヤノンマーケティングジャパン株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6228392B2 (ja) * 2013-05-31 2017-11-08 任天堂株式会社 パノラマ画像表示プログラム、パノラマ画像表示装置、パノラマ画像表示システム、および、パノラマ画像表示方法
US10146333B1 (en) * 2015-05-21 2018-12-04 Madrona Venture Fund Vi, L.P. Virtual environment 3D pointer mapped to 2D windowed surface
JP2020039052A (ja) 2018-09-04 2020-03-12 国立大学法人広島大学 画像処理システムおよびｈｍｄ
JP7326774B2 (ja) * 2019-03-06 2023-08-16 株式会社リコー 画像処理システム、撮像装置、情報処理装置、画像処理方法及びプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1091057A (ja) * 1996-09-17 1998-04-10 Mitsubishi Electric Corp 技術相談支援システム
JP2000020753A (ja) * 1998-07-07 2000-01-21 Mitsubishi Electric Corp 仮想空間制御装置
JP2018073172A (ja) * 2016-10-31 2018-05-10 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および画像生成方法
JP2018142230A (ja) * 2017-02-28 2018-09-13 キヤノンマーケティングジャパン株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム

Also Published As

Publication number Publication date
US20240345657A1 (en) 2024-10-17
JPWO2023026628A1 (https=) 2023-03-02
JP7603827B2 (ja) 2024-12-20
US12307008B2 (en) 2025-05-20

Similar Documents

Publication Publication Date Title
US10102674B2 (en) Virtual reality headset connected to a mobile computing device
US10275046B2 (en) Accessing and interacting with information
US10620721B2 (en) Position-based location indication and device control
US9530232B2 (en) Augmented reality surface segmentation
US20210011556A1 (en) Virtual user interface using a peripheral device in artificial reality environments
US10181219B1 (en) Phone control and presence in virtual reality
US10416783B2 (en) Causing specific location of an object provided to a device
EP2965299A1 (en) Modifying functionality based on distances between devices
US10591986B2 (en) Remote work supporting system, remote work supporting method, and program
JP7603827B2 (ja) 表示制御装置
JP7779062B2 (ja) 情報処理装置、情報処理システム、およびプログラム
JP6374203B2 (ja) 表示システム及びプログラム
JP7777039B2 (ja) 情報処理装置
JP7583948B2 (ja) 表示制御装置
WO2023026700A1 (ja) 表示制御装置
JP2018128917A (ja) 入力システム
WO2022201739A1 (ja) 表示制御装置
US20250157090A1 (en) Display control apparatus
JP7717628B2 (ja) 情報処理装置
JP2024089241A (ja) 表示制御装置
WO2022190735A1 (ja) 表示制御装置
JP2025145162A (ja) 制御装置及び制御方法
CN118429578A (zh) 基于扩展现实的控制方法、装置、终端和存储介质
CN115617164A (zh) 交互方法、装置和近眼显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22860923

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023543701

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 18291756

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22860923

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 18291756

Country of ref document: US