WO2025169262A1 - 情報表示端末 - Google Patents

情報表示端末

Info

Publication number
WO2025169262A1
WO2025169262A1 PCT/JP2024/003668 JP2024003668W WO2025169262A1 WO 2025169262 A1 WO2025169262 A1 WO 2025169262A1 JP 2024003668 W JP2024003668 W JP 2024003668W WO 2025169262 A1 WO2025169262 A1 WO 2025169262A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
experience
content
information
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/JP2024/003668
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
康彦 國井
望 下田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Maxell Ltd
Original Assignee
Maxell Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Maxell Ltd filed Critical Maxell Ltd
Priority to PCT/JP2024/003668 priority Critical patent/WO2025169262A1/ja
Priority to JP2025574886A priority patent/JPWO2025169262A1/ja
Priority to CN202480074468.7A priority patent/CN122295643A/zh
Publication of WO2025169262A1 publication Critical patent/WO2025169262A1/ja
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to an information display terminal.
  • a user may wear an information display device such as a head-mounted display (HMD) and experience content.
  • HMD head-mounted display
  • the user may set an area to be used for experiencing the content.
  • This area (hereinafter sometimes referred to as the experience area) is an area related to real space, and within this area, the user may, for example, move and/or perform actions while experiencing the content.
  • Patent Document 1 also states, "A head-mounted display (HMD) 1, which is operated by gesture movements of a user 3, includes a distance image acquisition means 106 that detects gesture movements, a position information acquisition means 103 that acquires position information of the HMD 1, and a communication means 2 that communicates with other HMDs 1'.
  • the control unit 205 sets and displays an operation space 600 in which the gesture movements of the user 3 are valid, and exchanges position information and operation space information with other HMDs 1 via the communication means 2, adjusting the operation space of the HMD itself so that the operation spaces 600, 600' do not overlap.
  • the distance image acquisition means 106 detects a nearby person 4, the operation space is adjusted so that the position of the detected person does not overlap with the operation space 600.
  • Information display devices such as HMDs are expected to be used in a variety of ways, not only by user gestures but also depending on the content being displayed, such as when the user is seated or moving around in real space. Due to these usage patterns, the area required for the user to experience the content is not fixed. Therefore, when there are multiple information display devices in a real space of limited size, such as a single room, it is necessary to take into account the content being displayed and other circumstances in order to appropriately set the experience area.
  • FIG. 8 is a diagram visually illustrating an example of a VR experience area set by the HMD in the processing of FIG. 7 .
  • FIG. 10 is a diagram showing an example of a setting screen for performing a process of acquiring information from another device.
  • 10 is a flowchart illustrating an example of a process for acquiring information from another device.
  • FIG. 10 is a diagram showing an example of a setting screen for performing a process of providing information to another device.
  • 10 is a flowchart illustrating an example of a process for providing information to another device.
  • FIG. 3 is a diagram illustrating an example of information transmitted and received by the HMD.
  • 10 is a flowchart illustrating an example of a process for setting a VR experience area according to the second embodiment.
  • FIG. 10 is a diagram showing an example of a setting screen for performing a process of acquiring information from another device.
  • 10 is a flowchart illustrating an example of a process for acquiring information from another device.
  • FIG. 10 is
  • FIG. 1 shows an example of the hardware configuration of an HMD.
  • the HMD 1 includes a camera 10, a distance sensor 11, a display 12, a speaker 13, a microphone 14, a group of sensors 15, a control unit 16, an internal bus 17, a communication unit 20, a processor 21, memory 22, storage 23, a basic operation program 24, a VR viewing program 25, and an approach transmission program 26.
  • camera 10 captures the real space in front of HMD 1. If camera 10 is equipped with multiple cameras, it may capture a 360-degree view of the surroundings of HMD 1. Also, if camera 10 is equipped with a 360-degree camera, it may capture a 360-degree view of the surroundings of HMD 1 using the 360-degree camera.
  • the gaze sensor may include a left eye gaze sensor that detects the gaze of the left eye, and a right eye gaze sensor that detects the gaze of the right eye, and can detect the movement and direction of the left and right eyes to capture the user's gaze point.
  • the communication unit 20 (communication interface in Figure 1) is equipped with multiple communication protocols, such as LAN communication, Internet communication, and short-range communication, and uses them depending on the purpose.
  • the processor 21 receives VR content from a server capable of distributing VR content, and sends and receives data, for example, via Internet communication using the VR viewing program 25.
  • the processor 21 can directly communicate with other information display terminals, for example, via Bluetooth (registered trademark) or LAN communication, to send and receive data.
  • the processor 21 may also directly connect to a content distribution device, for example, to receive VR content and send and receive data.
  • the content distribution device is, for example, a computer such as a personal computer, home game console, portable game console, or smartphone.
  • the controller 41A can communicate with the HMD 1A and is used, for example, by user A to perform predetermined operations on VR content.
  • the controller 41A can also communicate with the content distribution device 42 and may receive predetermined operations on VR content via the content distribution device 42.
  • the input interface used by user A is not limited to the controller 41A, but may be provided in the HMD 1A separately from the controller 41A.
  • buttons and a touch panel may be provided on the HMD 1A, and input may be performed by the user operating the buttons or touch panel.
  • the camera 10 may also detect gesture operations by the user, or an eye tracking sensor may be included in the sensor group 15 to detect gaze operations by the user.
  • the router 43 is configured to relay communications. For example, a wireless LAN environment may be constructed using the router 43.
  • the HMD 1A worn by user A receives VR content distributed from a server via, for example, an access point or network, allowing user A to view the VR content.
  • the network is not limited to the Internet, but may also be an intranet.
  • the HMD 1A may also receive VR content distributed from a content distribution device 42.
  • the VR content may be downloaded to the HMD 1A in advance from a server or content distribution device 42, and the VR content stored in the memory 22 of the HMD 1A may be executed.
  • the VR experience area is an area used to experience VR content, and is an area where the user moves and/or performs actions while experiencing the VR content.
  • the VR experience area is set to avoid real objects in the real space S.
  • real objects are objects that should be avoided while experiencing the VR content, such as a shelf, television, or router 43, but the type of real object is not particularly limited, and other real objects such as a sofa, table, or wall may also be used.
  • the HMD 1A will, for example, interrupt viewing of the VR content to avoid a collision.
  • the HMD 1A will switch to displaying VR images (such as messages or boundary displays of the experience area) to alert the user, or images of the surrounding real space captured by the camera 10, or will superimpose such images on the VR content, thereby urging user A to avoid departing from the area.
  • VR images such as messages or boundary displays of the experience area
  • FIG. 4 shows VR experience area P1
  • user B cannot see the VR experience area P1 set by user A within real space S.
  • user B cannot tell whether he or she is inside or outside the VR experience area P1, and must take care to avoid contact.
  • FIG. 5 is a diagram showing an example of a VR experience area set by user B in the real space where user A exists.
  • a VR experience area P2 is set.
  • User B can set the VR experience area P2 using, for example, controller 41B.
  • controller 41B is capable of communicating with HMD 1B and is used, for example, to perform predetermined operations on the VR content.
  • HMD 1A and HMD 1B have the same configuration, but this is not limited to this.
  • HMD 1A and HMD 1B may also be information display terminals with different configurations.
  • the user can operate the controller to set their own VR experience area so as to avoid the VR experience areas of other users.
  • user A's VR experience area P1 is displayed on the display 12 of HMD 1B, and user B can understand user A's VR experience area P1.
  • User B can then draw line R to avoid VR experience area P1 and set their own VR experience area so that an overlapping area OS does not occur. Note that this is not limited to when controller 41B is used, but even when user B uses another input interface, the occurrence of an overlapping area OS can be prevented by displaying user A's VR experience area P1.
  • the player position information 102 is information regarding the position of the HMD 1 when VR content is scheduled to be executed or is currently being executed.
  • the player position information 102 is position information obtained by the HMD 1 through calculation using, for example, GNSS signals received by a GNSS sensor included in the sensor group 15.
  • the player position information 102 may also be position information obtained by the HMD 1 estimating its own position from feature points in real space. In other words, the player position information 102 may be position information based on V-SLAM (Visual Simultaneous Localization and Mapping).
  • the player position information 102 may also be position information obtained by the HMD 1 using a position information service, for example.
  • the player position information 102 may also be position information obtained using Wi-Fi CSI, or position information obtained using other known methods.
  • the play area information 103 is information that indicates a VR experience area that has been set up for the user to experience VR content.
  • the play area information 103 can be expressed using coordinates corresponding to vertices.
  • a rectangular VR experience area may be set using four coordinate positions, or a different polygonal VR experience area may be set by increasing or decreasing the coordinate positions.
  • the coordinate positions may use a local coordinate system with the user as the origin, or a world coordinate system with a specific position in the real space S as the origin.
  • Other information 104 may include, for example, information regarding the age and physique of the user experiencing the VR content, information regarding the amount charged for the VR content, priority information regarding the setting of play areas with other users (setting of VR experience areas), and information regarding the user's planned usage schedule for experiencing the content.
  • priority determines which user's experience area will be set first in overlapping areas. In this case, in overlapping areas, the VR experience area of a user with a higher priority is set first over the VR experience area of a user with a lower priority.
  • the planned usage schedule may also be expressed, for example, as the date, time, etc. when the user plans to experience the VR content. Age, physique, amount charged, priority, planned usage schedule, etc. can be set in advance.
  • This information display terminal includes a display, a communication interface, an input interface used for user input operations, and a processor.
  • the processor communicates with another device present in the same real-world space as the information display terminal via the communication interface, receives information indicating a first experience area, which is an area set for experiencing content running on the other device, and determines whether a second experience area, which is an area selected by the user via the input interface, overlaps with the first experience area.
  • the processor determines that the second experience area does not overlap with the first experience area, it displays on the display a message prompting the user to select the content they wish to experience using the information display terminal, and compares the size of the experience request area required for experiencing the content selected by the user via the input interface with the size of the second experience area. If the size of the second experience area is equal to or larger than the size of the experience request area, the processor controls to set the second experience area as an area for experiencing the content selected by the user. Also provided are an information processing method executed by the information display terminal, and an information processing system including the information display terminal and a server or content distribution device.
  • the HMD adjusts the experience area with other devices.
  • the HMD 1 acquires information about the other device (S1201) and superimposes the acquired VR experience area of the other device on the camera image captured by the camera 10 (S1202). The HMD 1 then sets the VR experience area based on the area selected by the user (S1203).
  • the information acquired by the HMD 1 includes, for example, information about the VR experience area of the other device (i.e., play area information 103), position information (i.e., player position information 102), and information about the VR content currently being executed (i.e., content information 101).
  • the HMD 1 displays a message prompting the user to select the VR content to be experienced and accepts the user's selection (S1204). If the VR content has multiple play modes, the HMD 1 also prompts the user to select a play mode for the VR content and accepts that selection. Although not shown, in S1203, similar to S704 in FIG. 7, it may be determined whether the set VR experience area overlaps with the VR experience area of another device, and only proceed to S1204 if it is determined that there is no overlap.
  • the HMD 1 compares the size of the VR experience area set in S1203 with the size of the VR experience request area corresponding to the VR content and play mode selected by the user in S1204 (S1205). If it is determined that the size of the VR experience area is equal to or larger than the size of the VR experience request area (S1205-YES), a VR experience area large enough to experience the VR content selected by the user has been secured, and the HMD 1 begins executing the VR content (S1214). Then, processing ends.
  • the HMD 1 performs area adjustment, including negotiation with other devices, as described below.
  • the HMD1 calculates the VR experience request area of the other device using the VR content information of the other device obtained in S1201 (S1209). Note that instead of the HMD1 calculating the VR experience request area of the other device, information regarding the VR experience request area may be obtained as part of the VR content information in S1201. The HMD1 then determines whether the area obtained by subtracting the changed area determined in S1208 from the VR experience area of the other device obtained in S1201 is equal to or larger than the size of the VR experience request area of the other device (S1210). In other words, the HMD1 determines whether the user of the other device can continue experiencing the VR content even if the area determined in S1208 is reduced.
  • the HMD1 determines not only whether there are multiple play modes, but also whether there is a play mode among the multiple play modes that allows the user of the other device to experience VR content even if the VR experience area of the other device is reduced by the changed area calculated in S1208.
  • a determination is made as to whether the size of the reduced area is equal to or larger than the size of the VR experience request area corresponding to the play mode.
  • the HMD 1 If the user selects to request a play mode from another device (S1216-YES), the HMD 1 sends a request to change the play mode to the other device (S1217). Then, as described above, depending on the determination result received from the other device, the HMD 1 either changes the VR experience area and starts executing the VR content (S1213-S1214), or returns to S1203. On the other hand, if the user selects not to make a request to the other device (S1216-NO), the HMD 1 returns to S1203.
  • the HMD 1 sends a request to change the VR content being executed to the other device (S1219). As described above, depending on the determination result received from the other device, the HMD 1 either changes the VR experience area and starts executing the VR content (S1213-S1214), or returns to S1203. On the other hand, if the user selects not to make a request to another device (S1218-NO), the HMD 1 returns to S1203.
  • a notification is sent prompting the user to select whether to adjust the VR experience area with other devices in S1207, whether to request a change of play mode from other devices in S1216, or whether to request a change of VR content from other devices in S1218
  • at least some of the information contained in the other information obtained in S1201, such as priority, planned use schedule, charge amount, age, and physique, may be presented. This allows the user to use this information as a reference when deciding whether to make a request, for example, not to request a change if their own priority is low or if the end time of another user is approaching.
  • the HMD 1 may use other information to determine whether to adjust with other devices or send a request.
  • the HMD 1 transmits information about its own VR experience area, location information, and information about the VR content being executed to another device through the process shown in FIG. 10B (S1401).
  • the HMD 1 receives a change request from another device (S1402), it evaluates the received request (S1403-S1405).
  • the HMD 1 may also receive information about the VR experience area of the other device, location information, and information about the VR content to be executed.
  • the HMD 1 may obtain VR experience area information, etc. from the other device regardless of whether or not a change request has been received from the other device.
  • the HMD 1 determines whether the change is permitted (S1411). By the user setting the permission or prohibition in advance, the user's sense of immersion while experiencing the VR content can be maintained. Furthermore, in order to determine in S1413 whether the reduction in area will have an impact on the user's VR content experience, the change may be permitted as the initial setting. However, this is not limited to this, and in S1411, a notification may be displayed prompting the user to select whether to permit the change.
  • the HMD1 calculates an area change proposal for changing the VR experience area (S1412). That is, the HMD1 calculates the size of the VR experience area after the area change, the shape of the VR experience area after the area change, and the position of the center of gravity of the VR experience area after the area change due to the movement of the VR experience area, as the area change proposal. Note that if the HMD1 receives data on the changed area calculated by another requesting device, for example, in S1208 of FIG. 12, along with the change request in S1402, the HMD1 may calculate the area change proposal using that data.
  • the HMD1 determines whether the size of the changed VR experience area is equal to or larger than the size of the VR experience request area of the VR content currently being executed (S1413). Note that this example only describes a comparison between the VR experience area and the VR experience request area, but if there is an unused area in real space that is not being used as a VR experience area by any device, the use of the unused area may also be taken into consideration when determining whether or not to change the area of the VR experience area.
  • the HMD 1 determines that changing the VR experience area will be larger than the VR experience request area and will not affect the user's VR content experience (S1413-YES), it changes the VR experience area based on the area change plan (S1414).
  • the HMD 1A may change the VR experience area P1 so that it is smaller than the VR experience request area P1R, or may change it to a VR experience area P11 that is smaller than only the portion in the direction in which the overlap area OS is located.
  • the VR experience area is not limited to a rectangle, and may be changed to another shape such as a hexagon to remove only the overlap area OS.
  • the VR experience area P1 after changing the size and shape of the VR experience area P1, it may be moved away from the VR experience area of the HMD 1B to create an interference area. If the VR experience areas of each user are adjacent to each other, there is a high possibility of a collision occurring if the users deviate from the VR experience area. Therefore, it is desirable to create interference areas between the VR experience areas to separate each area. A predetermined distance may be secured for this interference area, or a distance may be secured using a value set by the user. When moving the VR experience area, adjusting it so that it includes the user's current location allows content playback to continue. The VR experience area may also be adjusted in stages multiple times to increase the distance between users.
  • the HMD 1 transmits the change results to the other device that made the request (S1406).
  • the change results in S1406 may be transmitted to a device located within a predetermined range from the HMD 1 via short-range communication.
  • the HMD 1 may notify information regarding the reduction or movement of the area. For example, if the reduction rate of the changed VR experience area or the amount of movement of the center of gravity of the VR experience area is changed to a value greater than a predetermined threshold, it is desirable for the HMD 1 to notify the user. Furthermore, if the center of gravity position of the changed VR experience area is away from the user's position by more than a predetermined distance, a notification may be sent to alert the user.
  • the process may proceed to S1421 or S1432 described below, and the play mode or content may be changed.
  • the HMD 1 may inform the user by video or audio whether to change the play mode or content.
  • the HMD 1 determines whether there are other play modes that can be changed to for the currently executed VR content (S1421).
  • the HMD 1 changes the play mode in S1424 and controls the VR experience area to change to correspond to the VR experience request area required for the changed play mode.
  • the area change proposal is calculated in S1421, for example.
  • the HMD 1 transmits a result to the requesting device indicating that the play mode cannot be changed (S1441). Furthermore, if the user inputs that the play mode cannot be changed (S1423-NO), the HMD 1 similarly transmits a result to the requesting device indicating that the play mode cannot be changed (S1441).
  • the setting for allowing play mode changes may be performed through initial settings or advance user settings, and the processing of S1422 to S1423 may be omitted. In this case, the user's sense of immersion while experiencing the VR content can be maintained.
  • the HMD 1 If it is determined in S1402 that the request received is for a content change (S1405-YES), the HMD 1 notifies the user that a request to change the content being experienced has been received (S1431). For example, the HMD 1 displays on the display 12 a message indicating that a content change request has been received, along with a message prompting the user to select whether or not to change the content.
  • the HMD 1 changes the content (S1433) and transmits the change results to the device that made the request (S1406).
  • the HMD 1 changes the content to be executed in S1433, and also controls the VR experience area to be changed to correspond to the VR experience request area required for the changed content.
  • the notification in S1431 may also include a notification urging the user to select other content, and in S1432 the user may input permission for the change and select content different from the current content. In this case, it is desirable to display in the notification in S1431 a list that includes only candidate content for change that has a VR experience request area smaller than the VR experience request area of the content currently being executed, or to set it so that content other than the candidate content for change cannot be selected.
  • the HMD 1 transmits to the requesting device that the content cannot be changed (S1441).
  • the second embodiment by using experience area information and content information from the user's own device and other devices to adjust areas with other devices, even if the user's own device alone is unable to set an appropriate VR experience area, it is possible to obtain an opportunity to set a VR experience area appropriate for the user's content experience.
  • the processes for setting the VR experience area, obtaining information from other devices, and providing information to other devices were performed by an information display terminal such as an HMD, but this is not limited to this.
  • an information display terminal such as an HMD
  • at least some of the processes shown in FIGS. 12 and 14 may be performed by a server or content distribution device using content information, location information, etc. transmitted from an information display terminal such as HMD 1A or HMD 1B.
  • This information display terminal includes a display, a communication interface, an input interface used for input operations by a user of the information display terminal, a camera for capturing images of real space, and a processor.
  • the processor communicates with another device existing in the same real space as the information display terminal via the communication interface, receives information indicating a first experience area set up for experiencing first content being executed on the other device, and, when an area is selected by the user via the input interface, uses the received information to display the first experience area on the display, superimposed on an image of real space captured by the camera.
  • the processor also receives information indicating a second experience area selected by the user and second content selected by the user via the input interface, and compares the size of the second experience area with the size of a second experience request area corresponding to the second content. If the size of the second experience area is smaller than the size of the second experience request area, the processor controls the display to display a message prompting the user to select whether to perform coordination with the other device. Also provided are an information processing method executed on the information display terminal, and an information processing system equipped with the information display terminal and a server or content distribution device.
  • an HMD combines the experience areas of its own device and other devices and resets the experience area.
  • HMD 1B in FIG. 5 combines the experience area with other devices such as HMD 1A.
  • FIG. 15 is a flowchart showing an example of the VR experience area setting process. As in the first and second embodiments, this process is executed by the processor 21, and may be started automatically when the HMD 1B in FIG. 5 is started, for example, or may be started by an operation by user B.
  • the HMD 1 acquires information about the other device (S1501) and superimposes the acquired VR experience area of the other device on the camera image acquired by the camera 10 (S1502). The HMD 1 then sets the VR experience area based on the area selected by the user (S1503).
  • the information acquired by the HMD 1 includes, for example, information about the VR experience area of the other device (i.e., play area information 103), position information (i.e., player position information 102), and information about the VR content currently being executed (i.e., content information 101).
  • the HMD 1 displays a message prompting the user to select the VR content to be experienced and accepts the user's selection (S1504). If the VR content has multiple play modes, the HMD 1 also prompts the user to select the play mode for the VR content and accepts that selection. Although not shown, in S1503, similar to S704 in FIG. 7, it may be determined whether the set VR experience area overlaps with the VR experience area of another device, and only proceed to S1504 if it is determined that there is no overlap.
  • the HMD 1 uses the content information obtained in S1501 to determine whether the VR content received in S1504 is the same as the VR content being executed on the other device (S1505). If it is determined that the respective VR contents are the same (S1505-YES), the HMD 1 notifies the user to select whether or not to experience the VR content together with other users (S1506).
  • the HMD1 determines whether multiplay, which involves executing VR content in cooperation with other devices, is possible (S1507).
  • the HMD1 determines whether multiplay is possible based on whether the condition for the number of compatible players is met, for example, using content information for the HMD1's own device and content information for the other devices acquired in S1501.
  • the HMD1 may also use content progress information included in the content information to make this determination based on whether the difference in the content progress status between the HMD1's own device and the other devices is within a predetermined range.
  • the HMD1 may also determine whether content execution in cooperation with other devices is possible based on information for each user, such as player level, stage information, and the area in which they are playing within the content.
  • the HMD 1 determines that content execution is possible in cooperation with other devices (S1507-YES), it sends a request for content execution cooperation to the other devices (S1508). Note that the order of S1506 and S1507 may be reversed, and if the HMD 1 determines that content execution is possible in cooperation with other devices, it may notify the user to choose whether or not to experience VR content together with other users.
  • the other device When the other device receives the request sent from HMD1, it notifies the user of that device, prompting them to choose whether or not they would like to experience VR content together with the other user. Once the user has input their selection, the selection result is sent to the HMD1 that made the request.
  • the HMD 1 combines its own VR experience area with the VR experience area of the other device (S1510).
  • a combined VR experience area P31 may be set that includes the VR experience area P2 of HMD 1B and the VR experience area P1 of HMD 1A and maximizes it within the real space S.
  • the VR experience areas P1 and P2 may be combined by connecting them with a connection area having a predetermined width and shape. It is desirable to set the width and shape of the connection area to allow the user to pass through.
  • the VR experience areas P1 and P2 may be combined by connecting them so that the angle of the vertex of the connection between the VR experience areas P1 and P2 is not less than 90 degrees.
  • the VR experience area may be set to satisfy the recommended area required for multiplayer play, regardless of the position or shape of VR experience area P1 or VR experience area P2. For example, if the lengths of two sides of the recommended area are 3 m x 3 m, VR experience area P34 is set to encompass 3 m x 3 m.
  • the VR experience area since setting the VR experience area to a complex shape makes it difficult for users to understand, when combining VR experience areas, it is preferable to set it to a polygon with as few vertices as possible, with no more than four vertices. Furthermore, if there are obstacles such as a television or table, or people other than user A and user B, in real space S, it is preferable to combine the VR experience area so as not to include those areas.
  • the HMD 1 determines whether the combined VR experience area is equal to or larger than the VR experience request area required for multiplay of the selected VR content. If it is determined that the size of the combined VR experience area satisfies the VR experience request area for multiplay (S1511-YES), the HMD 1 changes the VR experience area to correspond to the combined VR experience area (S1512). After changing the VR experience area, the HMD 1 starts executing the content (S1513).
  • the HMD 1 transmits data about the synthesized VR experience area to the other device. If the play modes of the HMD 1 and the other device are different, they may be changed to the same play mode, or the user may be notified that they will be changed to the same play mode, and then a process for changing to the same play mode may be performed. Alternatively, instead of changing to the same play mode, multiplay may be performed between the HMD 1 and the other device while maintaining different play modes depending on the real space or the user's reasons.
  • the HMD 1 determines whether there is an area in the real space that can be modified (S1521) using measurement information of the real space acquired by the camera 10 or distance sensor 11. For example, if the HMD 1 determines that there is an area in the real space that is not being used as a VR experience area and that there is an area where the VR experience area can be expanded (S1521—YES), it modifies and resets the VR experience area (S1522) and starts execution of the content (S1513).
  • the owner of the content progress in the VR experience area is the user who previously played the content, and users who join later will follow the play of the owner user.
  • Ownership authority may be transferred by the authorized user to another user, or may be determined using information such as priority, planned usage schedule, charged amount, age, and physique obtained from the HMD 1A or HMD 1B. For example, users with high priorities or users with high billing amounts may be given priority as owners who will be in charge of the progress of the content.
  • the play mode of the VR content may be automatically changed to reduce the multiplayer VR experience request area, or the play mode may be changed in response to input from the user.
  • the user may be divided again and a VR experience area that can be experienced by each user may be set again. In this case, it is desirable to divide the combined VR experience area equally.
  • information such as priority, planned usage schedule, charge amount, age, and physique obtained from HMD 1A and HMD 1B may be used to determine the division.
  • the HMD 1 ends the processing.
  • a VR experience area for multiplay with other devices can be set.
  • the processing is not limited to that shown, and it is also possible to perform a combination of parts of FIG. 12 and FIG. 15, for example.
  • the HMD 1 may perform the processing from S1505 onwards instead of the processing from S1208 onwards.
  • the HMD 1 may perform the processing from S1505 onwards instead of returning to S1203.
  • the experience areas of the user's own device and other devices can be combined to set an appropriate VR experience area when multiple users experience the same content.
  • the VR experience area setting process is performed by an information display terminal such as an HMD, but this is not limited to this.
  • some or all of the process in FIG. 15 may be performed by a server or content distribution device.
  • information regarding the conditions for experiencing content together with other users is transmitted from an information display terminal such as HMD 1A or HMD 1B and registered in advance in the server or content distribution device.
  • the server or content distribution device may determine whether to combine the VR experience areas without prompting the user of the information display terminal to make a selection or notifying them, and may control HMD 1A or HMD 1B to change the VR experience area according to the determination result, or may transmit information for making the change.
  • the processor also receives information indicating a second experience area selected by the user and second content selected by the user via the input interface, and compares the first content with the second content. If the first content and the second content are the same content, the processor determines whether the content can be executed in cooperation with the other device, and if the content can be executed in cooperation with the other device, sends a collaboration request to the other device via the communication interface. Also provided are an information processing method executed on the information display terminal, and an information processing system equipped with the information display terminal and a server or content distribution device.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/JP2024/003668 2024-02-05 2024-02-05 情報表示端末 Pending WO2025169262A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/JP2024/003668 WO2025169262A1 (ja) 2024-02-05 2024-02-05 情報表示端末
JP2025574886A JPWO2025169262A1 (cg-RX-API-DMAC7.html) 2024-02-05 2024-02-05
CN202480074468.7A CN122295643A (zh) 2024-02-05 2024-02-05 信息显示终端

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2024/003668 WO2025169262A1 (ja) 2024-02-05 2024-02-05 情報表示端末

Publications (1)

Publication Number Publication Date
WO2025169262A1 true WO2025169262A1 (ja) 2025-08-14

Family

ID=96699521

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2024/003668 Pending WO2025169262A1 (ja) 2024-02-05 2024-02-05 情報表示端末

Country Status (3)

Country Link
JP (1) JPWO2025169262A1 (cg-RX-API-DMAC7.html)
CN (1) CN122295643A (cg-RX-API-DMAC7.html)
WO (1) WO2025169262A1 (cg-RX-API-DMAC7.html)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240303941A1 (en) * 2023-03-08 2024-09-12 Canon Kabushiki Kaisha Information processing apparatus, method for controlling the same, and medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012108577A (ja) * 2010-11-15 2012-06-07 Panasonic Corp 3d−ui操作空間協調装置
JP2013539377A (ja) * 2011-07-01 2013-10-24 エンパイア テクノロジー ディベロップメント エルエルシー ジェスチャベースのゲームのための安全スキーム
JP2014146236A (ja) * 2013-01-30 2014-08-14 Mitsubishi Electric Corp 入力装置、情報処理方法、及び情報処理プログラム
WO2019038875A1 (ja) * 2017-08-24 2019-02-28 マクセル株式会社 ヘッドマウントディスプレイ
JP2019063174A (ja) * 2017-09-29 2019-04-25 グリー株式会社 ゲーム処理プログラム、ゲーム処理方法、および、ゲーム処理装置
JP2022102913A (ja) * 2020-12-25 2022-07-07 株式会社コナミデジタルエンタテインメント ゲームシステム、それに用いるコンピュータプログラム、及び制御方法
JP2023017615A (ja) * 2021-07-26 2023-02-07 富士フイルムビジネスイノベーション株式会社 情報処理システム及びプログラム

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012108577A (ja) * 2010-11-15 2012-06-07 Panasonic Corp 3d−ui操作空間協調装置
JP2013539377A (ja) * 2011-07-01 2013-10-24 エンパイア テクノロジー ディベロップメント エルエルシー ジェスチャベースのゲームのための安全スキーム
JP2014146236A (ja) * 2013-01-30 2014-08-14 Mitsubishi Electric Corp 入力装置、情報処理方法、及び情報処理プログラム
WO2019038875A1 (ja) * 2017-08-24 2019-02-28 マクセル株式会社 ヘッドマウントディスプレイ
JP2019063174A (ja) * 2017-09-29 2019-04-25 グリー株式会社 ゲーム処理プログラム、ゲーム処理方法、および、ゲーム処理装置
JP2022102913A (ja) * 2020-12-25 2022-07-07 株式会社コナミデジタルエンタテインメント ゲームシステム、それに用いるコンピュータプログラム、及び制御方法
JP2023017615A (ja) * 2021-07-26 2023-02-07 富士フイルムビジネスイノベーション株式会社 情報処理システム及びプログラム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240303941A1 (en) * 2023-03-08 2024-09-12 Canon Kabushiki Kaisha Information processing apparatus, method for controlling the same, and medium
US12700190B2 (en) * 2023-03-08 2026-08-04 Canon Kabushiki Kaisha Information processing apparatus, method for controlling the same, and medium

Also Published As

Publication number Publication date
JPWO2025169262A1 (cg-RX-API-DMAC7.html) 2025-08-14
CN122295643A (zh) 2026-06-26

Similar Documents

Publication Publication Date Title
US10657701B2 (en) Dynamic entering and leaving of virtual-reality environments navigated by different HMD users
CN108479060B (zh) 一种显示控制方法及电子设备
JP6309779B2 (ja) プログラム、ゲーム装置およびゲームシステム
JP6240353B1 (ja) 仮想空間において情報を提供するための方法、そのためのプログラム、および、そのための装置
CN111512277B (zh) 信息处理装置、信息处理方法及程序
JP6342024B1 (ja) 仮想空間を提供するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
JP6615732B2 (ja) 情報処理装置および画像生成方法
JP6203369B1 (ja) 情報処理方法及び当該情報処理方法をコンピュータに実行させるためのプログラム
KR20160124479A (ko) 서버, 사용자 단말 장치 및 그 제어 방법
JP2017146607A (ja) ヘッドマウントディスプレイでユーザーの動きに応答する画像レンダリング
JP6276434B1 (ja) 仮想空間における移動を支援するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
JP6234622B1 (ja) 仮想空間を介して通信するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
JP6523493B1 (ja) プログラム、情報処理装置、及び情報処理方法
KR20200060361A (ko) 정보 처리 장치, 정보 처리 방법, 및 프로그램
CN114245755B (zh) 信息处理装置、信息处理方法和记录介质
JP2017220224A (ja) 仮想空間を提供するための方法、当該方法をコンピュータに実現させるためのプログラム、および仮想空間を提供するためのシステム
JP6203346B1 (ja) 仮想空間を提供する方法、プログラム、および記録媒体
JP2018097847A (ja) 情報処理方法及び当該情報処理方法をコンピュータに実行させるためのプログラム
US12099644B2 (en) Information processing apparatus and information processing method
JP7438786B2 (ja) プログラム、情報処理方法、及び情報処理装置
JP7030075B2 (ja) プログラム、情報処理装置、及び情報処理方法
KR20210133058A (ko) 6dof 온라인 멀티 플레이어 vr 관광체험 시스템
KR20220000165A (ko) 가상 현실 게임용 중계 화면 생성 방법 및 이를 수행하는 가상 현실 시스템
US20240305835A1 (en) Image sharing method and image sharing system, and storage medium
JP2018124989A (ja) 仮想空間における移動を支援するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24923946

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2025574886

Country of ref document: JP

Kind code of ref document: A