WO2024199169A1 - 人机交互方法、装置、设备和存储介质 - Google Patents

人机交互方法、装置、设备和存储介质 Download PDF

Info

Publication number
WO2024199169A1
WO2024199169A1 PCT/CN2024/083499 CN2024083499W WO2024199169A1 WO 2024199169 A1 WO2024199169 A1 WO 2024199169A1 CN 2024083499 W CN2024083499 W CN 2024083499W WO 2024199169 A1 WO2024199169 A1 WO 2024199169A1
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
interface
interacted
handed
virtual space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/083499
Other languages
English (en)
French (fr)
Inventor
刘静薇
刘硕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Publication of WO2024199169A1 publication Critical patent/WO2024199169A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Definitions

  • Embodiments of the present disclosure relate to a human-computer interaction method, apparatus, device, and storage medium.
  • VR virtual reality
  • AR augmented reality
  • MR mixed reality
  • users interact with various spatial interfaces at a long distance by emitting a directional virtual ray in the virtual space, which makes the interaction effect in the virtual scene relatively simple and lacks a certain interactive interest.
  • the embodiments of the present disclosure provide a human-computer interaction method, device, equipment and storage medium to achieve convenient interaction of any spatial interface in a virtual space and enhance the diversity and fun of interaction in the virtual space.
  • an embodiment of the present disclosure provides a human-computer interaction method, which is applied to an XR device.
  • the method includes:
  • the target gesture includes one of a two-handed frame selection gesture and a single-handed pinch gesture.
  • an embodiment of the present disclosure provides a human-computer interaction device, which is configured in an XR device, and the device includes:
  • An interface selection module for presenting a selection effect of the interface to be interacted with in the virtual space in response to the detected target gesture
  • An interface interaction module used for controlling the interface to be interacted with to perform a corresponding interaction operation in the virtual space according to the associated movement of the target gesture
  • the target gesture includes one of a two-handed frame selection gesture and a single-handed pinch gesture.
  • an embodiment of the present disclosure provides an electronic device, the electronic device comprising:
  • a processor and a memory the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the human-computer interaction method provided in the first aspect of the present disclosure.
  • an embodiment of the present disclosure provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the human-computer interaction method provided in the first aspect of the present disclosure.
  • an embodiment of the present disclosure provides a computer program product, including a computer program/instructions, which enable a computer to execute the human-computer interaction method provided in the first aspect of the present disclosure.
  • FIG1 is a flow chart of a human-computer interaction method provided by an embodiment of the present disclosure
  • FIG2 is an exemplary schematic diagram of a two-handed frame selection gesture provided by an embodiment of the present disclosure
  • FIG3 is a flow chart of another human-computer interaction method provided by an embodiment of the present disclosure.
  • FIG4a is an exemplary schematic diagram of determining a to-be-interacted interface through a two-handed frame selection gesture provided by an embodiment of the present disclosure
  • FIG4b is an exemplary schematic diagram of presenting an interface clone of a to-be-interacted interface in a two-handed frame selection area corresponding to a two-handed frame selection gesture provided by an embodiment of the present disclosure
  • FIG4c is an exemplary schematic diagram of overlapping of two hands in a two-handed frame selection gesture provided by an embodiment of the present disclosure
  • FIG5a is an exemplary schematic diagram of a single-hand pinch gesture provided by an embodiment of the present disclosure.
  • FIG5b is another exemplary schematic diagram of a single-hand pinch gesture provided in an embodiment of the present disclosure.
  • FIG6 is an exemplary schematic diagram of presenting a selected special effect of a to-be-interacted interface through a single-hand pinch gesture provided by an embodiment of the present disclosure
  • FIG7a is an exemplary schematic diagram of calling out a quick function panel of an interface to be interacted with through a second type of one-hand pinch gesture provided by an embodiment of the present disclosure
  • FIG7b is an exemplary schematic diagram of a second type of one-hand pinch gesture for a slide selection operation on any function control in the quick function panel provided by an embodiment of the present disclosure
  • FIG8 is a schematic diagram of a human-computer interaction device provided by an embodiment of the present disclosure.
  • FIG. 9 is a schematic block diagram of an electronic device provided by an embodiment of the present disclosure.
  • words such as “exemplary” or “for example” are used to indicate examples, illustrations or descriptions. Any embodiment or scheme described as “exemplary” or “for example” in the embodiments of the present disclosure should not be interpreted as being more preferred or more advantageous than other embodiments or schemes. Specifically, the use of words such as “exemplary” or “for example” is intended to present related concepts in a specific way.
  • the invention disclosed in the present invention is: for the space interface interaction in virtual space, First, the corresponding target gesture is set.
  • the target gesture can include one of the two-handed selection gesture and the one-handed pinch gesture, which conforms to the user's gesture operation habits in real scenes.
  • the target gesture and the associated movement of the target gesture are detected in real time to control the interface to be interacted with to perform the corresponding interactive operation in the virtual space, thereby realizing convenient interaction of any spatial interface in the virtual space and enhancing the diversity and fun of interaction in the virtual space.
  • FIG1 is a flow chart of a human-computer interaction method provided in an embodiment of the present disclosure, which can be applied to XR devices, but is not limited thereto.
  • the method can be executed by a human-computer interaction device provided in the present disclosure, wherein the human-computer interaction device can be implemented in any software and/or hardware manner.
  • the human-computer interaction device can be configured in an electronic device such as AR/VR/MR that can simulate a virtual scene, and the present disclosure does not impose any restrictions on the specific type of electronic device.
  • the method may include the following steps:
  • the virtual space can be a corresponding virtual environment simulated by an XR device for a real interactive scene selected by any user, so as to display corresponding interactive information in the virtual space.
  • the virtual space can be a simulation environment of the real world, a semi-simulated and semi-fictional virtual scene, or a purely fictional virtual scene.
  • the user selects a certain type of live broadcast scene to construct a corresponding virtual live broadcast environment as the virtual space in the present disclosure, so that each audience enters the virtual space to realize the corresponding live broadcast interaction.
  • the XR device can simulate a specific virtual scene for the user after the real scene and the virtual scene are merged, so that the user enters the pre-built virtual space.
  • multiple space interfaces are usually displayed within the virtual space, such as a live broadcast screen, a public barrage screen, a function control screen, and various function panels called up by any function control on the function control screen.
  • the present invention can pre-define corresponding target gestures for various interactive operations supported by the spatial interface according to the adaptability between the user's gesture operation habits in real scenes and the interactive operations of each spatial interface, so that the corresponding interactive operations of the spatial interface can be accurately triggered by capturing the user's gestures in the virtual space.
  • the target gesture in the present disclosure may include but is not limited to one of a two-handed selection gesture and a one-handed pinch gesture.
  • the gesture instructions issued by the user will be detected in real time.
  • the gesture instructions may include but are not limited to gesture voice instructions, gesture actions controlled by controllers such as real handles, and gesture images corresponding to the user's real hands in real scenes, etc.
  • the gesture actions that the hand model in the virtual space needs to perform are analyzed, so as to detect in real time whether the hand model in the virtual space is currently performing the corresponding target gesture.
  • the hand model in the virtual space When it is detected that the hand model in the virtual space performs a certain target gesture, it means that the user currently needs to interact with a certain spatial interface in the virtual space. Therefore, by analyzing the position information of the hand model in the virtual space in the target gesture, it is determined that the user specifies the spatial interface of this interaction through the target gesture, thereby determining the interface to be interacted in the present disclosure.
  • the present disclosure can present the selected special effects of the interface to be interacted in the virtual space, so as to make a corresponding response to the user's selection result of the spatial interface for this interaction. Then, by checking the selected special effects of the interface to be interacted, the user can determine whether the interface to be interacted is the spatial interface that the user wants to interact with this time.
  • the position information of the hand model in the target gesture can be adjusted to timely select a new spatial interface and respond accordingly through the selected special effects, so as to intuitively select the interface to be interacted that the user currently wants to interact with, thereby ensuring the accuracy of the interface to be interacted.
  • the present disclosure can set multiple associated actions for the target gesture, and each associated action can correspond to an interactive operation.
  • setting multiple associated movements for the target gesture can ensure the continuity between gesture actions, without the user having to constantly switch different gestures to perform corresponding interactive operations, ensuring the interaction of the interface to be interacted with. Convenience.
  • the present disclosure will continue to detect the position information of the hand model in the target gesture in real time to determine the associated movement performed by the target gesture, thereby determining the interactive operation to be performed this time. Then, in the virtual space, the interface to be interacted can be controlled to perform the corresponding interactive operation, thereby realizing convenient interaction of any spatial interface in the virtual space.
  • the technical solution provided by the embodiment of the present disclosure detects the target gesture in real time after entering the virtual space.
  • the target gesture may include one of a two-handed frame selection gesture and a one-handed pinch gesture.
  • the selected special effects of the interface to be interacted with are presented in the virtual space.
  • the associated motion performed by the target gesture is detected in real time to control the interface to be interacted with to perform corresponding interactive operations in the virtual space, thereby realizing convenient interaction of any spatial interface in the virtual space, enhancing the diversity and fun of interaction in the virtual space, and improving the interactive atmosphere in the virtual space.
  • the target gesture in the present disclosure may include one of a two-handed frame selection gesture and a one-handed pinch gesture.
  • the present disclosure may respectively describe the specific interaction process of any spatial interface in the virtual space from the two cases of a two-handed frame selection gesture and a one-handed pinch gesture.
  • the target gesture is a two-handed selection gesture.
  • the two-handed frame selection gesture may be a gesture action of forming a relative boundary frame through some fingers in the two-handed model, thereby framing the current spatial interface to be interacted with in the virtual space.
  • the two-handed frame selection gesture in the present disclosure may be as shown in FIG. 2, where the palm of one of the one-handed models faces outward, that is, faces away from the user, and the palm of the other one-handed model faces inward, that is, faces the user.
  • the thumb and index finger in each one-handed model may be separated to present an L shape, so that the thumb and index finger in each one-handed model may serve as corresponding frame selection boundaries, and form a relatively quadrilateral bounding box to serve as the corresponding two-handed frame selection gesture.
  • FIG3 is a flow chart of another human-computer interaction method provided by an embodiment of the present disclosure. As shown in FIG3 , the method may include the following steps:
  • S310 in response to the detected two-handed framing gesture, determine the to-be-interacted interface and the two-handed framing area in the virtual space according to the two-handed postures in the two-handed framing gesture and the user's head posture.
  • the gesture commands issued by the user can be detected in real time, such as gesture voice commands, gesture actions controlled by controllers such as real handles, and gesture images corresponding to the user's real hands in real scenes, etc. Then, by parsing the gesture command, it is determined whether the current gesture action in the virtual space is a two-handed selection gesture.
  • a two-handed frame selection gesture When a two-handed frame selection gesture is detected, it means that the user currently wants to interact with a certain spatial interface in the virtual space.
  • the two-handed frame selection gesture usually selects the spatial interface between the two hands as the interface to be interacted with from the user's viewing angle. Therefore, the present disclosure can first obtain the posture information of the two-handed model and the user's head posture information in the two-handed frame selection gesture.
  • the posture information of the two-hand model can be determined by the real handle posture or the real hand posture
  • the user's head posture information can be determined by the posture information of the XR device worn by the user.
  • the relative center point between the two-hand models can be determined.
  • the user's eye point can be determined through the user's head posture information.
  • Figure 4a by connecting the eye point and the relative center point and extending the line toward the spatial interface, the viewing line between the user's hands in the virtual space can be represented. Then, by determining the nearest spatial interface pointed by the extension line, the corresponding interface to be interacted can be determined.
  • the present disclosure can also determine the two-handed framing area formed by the target finger in the virtual space by analyzing the posture information of the target finger in the two-handed framing gesture, so as to intuitively display the interaction effect of the interface to be interacted with within the two-handed framing area.
  • the present invention determines the interface to be interacted with in the virtual space, it can present the selection effects of the interface to be interacted with in the two-hand frame area formed between the two-hand models, so as to make a corresponding response to the user's selection result of the spatial interface of this interaction, thereby improving the intuitiveness of the selection of the interface to be interacted with.
  • the present disclosure can adsorb the interface to be interacted near the user when there is a near-field interaction demand for the interface to be interacted, and provide a near-field interaction mode for the interface to be interacted.
  • the present disclosure can be implemented through the following steps: determining the static duration of the two-handed frame selection gesture; if the static duration is less than the preset duration threshold, presenting the interface clone of the interface to be interacted in the two-handed frame selection area, and adjusting the transparency of the interface to be interacted; if the static duration is greater than or equal to the preset duration threshold, the interface to be interacted is adsorbed into the two-handed frame selection area and presented.
  • the present disclosure can determine whether the user has a near-field interaction intention with respect to the interface to be interacted with by the duration of the two-handed frame selection gesture remaining in a static state. Therefore, when the two-handed frame selection gesture is detected, the static duration of the two-handed frame selection gesture can be determined in real time. Then, by determining whether the static duration of the two-handed frame selection gesture reaches a preset duration threshold, it is analyzed whether the user has a near-field interaction intention with respect to the interface to be interacted with.
  • the present disclosure can present an interface clone of the interface to be interacted in the two-handed frame selection area, and use this as a selection special effect of the interface to be interacted to prompt the selection of the interface to be interacted.
  • the present disclosure when the present disclosure presents the interface clone of the interface to be interacted in the two-handed frame selection area, it will further adjust the transparency of the interface to be interacted, for example, reducing the transparency of the interface to be interacted to 50%, so as to highlight the interface clone in the two-handed frame selection area.
  • the present disclosure can directly adsorb the interface to be interacted from its original position to the two-handed frame selection area for presentation, and control the size of the interface to be interacted to fit the two-handed frame selection area, so as to serve as the selection effect of the interface to be interacted with.
  • the present disclosure can detect the position information of the two-handed model in the two-handed frame selection gesture in real time to determine the associated gesture action performed by the two-handed model under the two-handed frame selection gesture.
  • the two-handed frame selection area formed by the two-handed frame selection gesture will move with the The two hands move toward each other and the size of the two hands keeps getting smaller.
  • the interface to be interacted with or the interface clone of the interface to be interacted with is presented in the two-handed framed area.
  • the present disclosure can continuously scale the interface to be interacted with or the interface clone of the interface to be interacted with according to the size of the two-handed framed area, so that the interface to be interacted with or the interface clone of the interface to be interacted with can always be within the two-handed framed area, so as to present a virtual scaling effect of the interface to be interacted with in the two-handed framed area.
  • the two-handed model in the two-handed frame selection gesture After the two-handed model in the two-handed frame selection gesture continuously performs the two-handed movement toward each other, the two-handed model in the two-handed frame selection gesture will eventually overlap, as shown in Figure 4c.
  • the two hands in the two-handed frame selection gesture overlap it means that the user wants to minimize or close the interface to be interacted with, and then the interface to be interacted with can be directly controlled to perform the corresponding minimize operation or close operation in the virtual space.
  • the present disclosure can provide an interaction cancellation operation for the interface to be interacted, that is, a flip operation of any one hand in the two-handed framing gesture. Therefore, by detecting in real time whether any one hand in the two-handed framing gesture performs a flip operation, it is determined whether the interaction operation of the interface to be interacted needs to be canceled at present.
  • the interface to be interacted can be directly controlled to return to a non-interactive state, thereby canceling all interaction operations that the user has performed on the interface to be interacted but have not yet confirmed to be completed.
  • the target gesture is a one-hand pinch gesture.
  • the one-hand pinch gesture can be a gesture action formed by putting together at least two fingers of any one-hand model in the two-hand model, and according to the posture of the one-hand pinch gesture, a corresponding virtual ray can be emitted outward from the finger pinch point, pointing to the spatial interface to be interacted with in the virtual space.
  • the one-hand pinch gesture in the present disclosure may be as shown in FIG. 5a and FIG. 5b, where the thumb and any other finger (such as the index finger or the middle finger) in any one-hand model may be put together to form a corresponding one-hand pinch gesture.
  • the contact point where the thumb and any other finger are put together may be the finger pinch point in the one-hand pinch gesture.
  • the interface to be interacted with in the virtual space can be determined according to the virtual ray emitted by the one-hand pinch gesture; and the selected special effects of the interface to be interacted with can be presented in the virtual space.
  • the position information of the target finger for performing the pinch action in the one-hand model corresponding to the one-hand pinch gesture can be obtained first.
  • the specified direction of the finger pinch point in the virtual space can be determined based on the position information of the target finger.
  • a corresponding virtual ray can be emitted outward in the specified direction to point to any spatial interface in the virtual space, thereby determining the corresponding interface to be interacted with.
  • the virtual ray in the present disclosure can be presented linearly, or can be presented implicitly by presenting a cursor point at the intersection between the virtual ray and the interface to be interacted with.
  • the present invention can add a new display style for the interface to be interacted with, such as adding an interface border effect as shown in Figure 6, so as to distinguish it from other spatial interfaces and present the selected special effects of the interface to be interacted with, so that the user can adjust the interface to be interacted with in time by viewing the selected special effects, thereby ensuring the accuracy of the interface to be interacted with.
  • a new display style for the interface to be interacted with such as adding an interface border effect as shown in Figure 6, so as to distinguish it from other spatial interfaces and present the selected special effects of the interface to be interacted with, so that the user can adjust the interface to be interacted with in time by viewing the selected special effects, thereby ensuring the accuracy of the interface to be interacted with.
  • the one-hand model can perform a one-hand pinch gesture in different palm orientations
  • the one-hand pinch gesture may have different palm orientations.
  • the present disclosure can set different interactive operations for the one-hand pinch gestures with different palm orientations, so that the same gesture can trigger different interactive operations in different orientations.
  • the one-hand pinch gesture may be divided into a first type of one-hand pinch gesture and a second type of one-hand pinch gesture according to the direction of the palm in the one-hand pinch gesture.
  • the first type of one-hand pinch gesture may be a one-hand pinch gesture formed by putting the thumb and index finger together with the palm facing downward as shown in FIG5a.
  • the second type of one-hand pinch gesture may be a one-hand pinch gesture formed by putting the thumb and middle finger together with the palm facing upward as shown in FIG5b.
  • the target gesture is the first type of one-hand pinch gesture
  • the interface to be interacted with is presented in the virtual space.
  • the target finger for performing the pinching action in the one-hand model of the first type of one-hand pinching gesture is first determined.
  • the associated movement performed by the target finger in the first type of one-hand pinching gesture is determined.
  • the user can be set to control the minimization or closing operation of the interface to be interacted with by quickly popping out one of the target fingers after making a one-hand pinch gesture, such as the index finger performing a quick pop-up action in the first type of one-hand pinch gesture when the thumb and index finger are pinched.
  • a one-hand pinch gesture such as the index finger performing a quick pop-up action in the first type of one-hand pinch gesture when the thumb and index finger are pinched.
  • the present disclosure detects that a certain target finger in the first type of one-hand pinch gesture has a certain relative acceleration relative to other target fingers, it can be determined that the target finger in the first type of one-hand pinch gesture has performed a relative acceleration movement, indicating that the target finger in the first type of one-hand pinch gesture has a fast pop-up pinch-release action through a rapid relative movement, indicating that the user wants to minimize or close the interface to be interacted. Therefore, in response to the relative acceleration movement of the target finger in the first type of one-hand pinch gesture, the interface to be interacted can be directly controlled to perform a corresponding minimize operation or close operation.
  • the present disclosure can analyze whether the user wants to cancel the interactive operation of the interface to be interacted by judging whether the target finger joint points in the first type of one-hand pinch gesture are in the same spatial plane.
  • the target finger joint points may be specific joint points on at least three fingers in the first type of one-hand pinch gesture.
  • the interface to be interacted with can be directly controlled to return to a non-interacted state, thereby canceling all interaction operations that the user has performed on the interface to be interacted with but have not yet confirmed to be completed.
  • the target gesture is the second type of one-hand pinch gesture
  • the present disclosure may also set a quick function panel for the interface to be interacted with, and the quick function panel is provided with function controls corresponding to various interactive operations supported by the interface to be interacted with, such as minimizing, closing, and showing all interfaces. Then, in order to ensure accurate calling out of the quick function panel, the present disclosure may set the second type of one-hand pinch gesture as the calling out instruction of the quick function panel of the interface to be interacted with.
  • the finger pinch point of the second type of one-hand pinch gesture can be further determined.
  • the quick function panel of the interface to be interacted with can be presented at the finger pinch point, so that the user can quickly trigger the corresponding function control on the quick function panel through the second type of one-hand pinch gesture to perform the corresponding interactive operation, without having to call out the corresponding quick function panel by manipulating the real handle or right-clicking the mouse, thereby improving the scalability of calling out the quick function panel.
  • the quick function panel can present different panel styles, which is not limited in the present disclosure.
  • the finger pinch point can be located at the position of different function controls in the quick function panel, thereby selecting the interactive operations corresponding to different function controls.
  • the interface to be interacted can be directly controlled to perform the interactive operation corresponding to the function control, thereby improving the interactive convenience of the spatial interface in the virtual space.
  • the technical solution provided by the embodiment of the present disclosure detects the target gesture in real time after entering the virtual space.
  • the target gesture may include one of a two-handed frame selection gesture and a one-handed pinch gesture.
  • the selected special effects of the interface to be interacted with are presented in the virtual space.
  • the associated motion performed by the target gesture is detected in real time to control the interface to be interacted with to perform corresponding interactive operations in the virtual space, thereby realizing convenient interaction of any spatial interface in the virtual space, enhancing the diversity and fun of interaction in the virtual space, and improving the interactive atmosphere in the virtual space.
  • FIG8 is a schematic diagram of a human-computer interaction device provided in an embodiment of the present disclosure.
  • the human-computer interaction device 800 may be configured in an XR device.
  • the human-computer interaction device 800 may include:
  • An interface selection module 810 for presenting a selection effect of the interface to be interacted with in the virtual space in response to the detected target gesture
  • An interface interaction module 820 configured to control the interface to be interacted with to perform a corresponding interaction operation in the virtual space according to the associated movement of the target gesture
  • the target gesture includes one of a two-handed frame selection gesture and a single-handed pinch gesture.
  • the interface selection module 810 may include:
  • An interface selection unit used to determine the interface to be interacted with and the two-handed frame selection area in the virtual space according to the two-handed frame selection gesture and the user's head posture;
  • a special effect presentation unit is used to present the selected special effect of the interface to be interacted with in the two-handed frame selection area.
  • the special effect presentation unit may be specifically used for:
  • the interface to be interacted with is adsorbed into the two-handed frame selection area and presented.
  • the interface interaction module 820 may include:
  • An interface zooming unit configured to present a virtual zooming effect of the interface to be interacted with in the two-handed frame selection area in response to the two-handed movement corresponding to the two-handed frame selection gesture;
  • the interface interaction unit is used to control the interface to be interacted with to perform a corresponding minimization operation or a closing operation when the two hands in the two-hand frame selection gesture overlap.
  • the human-computer interaction device 800 may further include:
  • the interaction canceling module is used to control the interface to be interacted to return to a non-interactive state in response to a flipping operation of any one hand in the two-handed frame selection gesture.
  • the interface selection module 810 may be specifically used to:
  • the selected special effect of the interface to be interacted with is presented in the virtual space.
  • the one-hand pinch gesture is divided into a first type of one-hand pinch gesture and a second type of one-hand pinch gesture according to a gesture direction.
  • the interface interaction module 820 may be specifically configured to:
  • the interface to be interacted with is controlled to perform a corresponding minimization operation or a closing operation.
  • the interaction cancellation module may also be used to:
  • the to-be-interacted interface is controlled to return to a non-interacted state.
  • the interface interaction module 820 may also be specifically used to:
  • the interface to be interacted with is controlled to execute an interaction operation corresponding to the function control.
  • the sliding selection operation is a pinch-and-release operation after the finger pinch point of the second type of one-hand pinch gesture slides to any function control in the shortcut function panel.
  • the target gesture after entering the virtual space, the target gesture will be detected in real time, and the target gesture may include one of a two-handed frame selection gesture and a one-handed pinch gesture.
  • the selected special effect of the interface to be interacted will be presented in the virtual space.
  • the associated movement performed by the target gesture is detected in real time, so as to control the interface to be interacted to perform the corresponding interactive operation in the virtual space, thereby realizing convenient interaction of any spatial interface in the virtual space, enhancing the diversity and fun of interaction in the virtual space, and improving the interactive atmosphere in the virtual space.
  • the device 800 shown in Figure 8 can execute any method embodiment provided by the present disclosure, and the aforementioned and other operations and/or functions of each module in the device 800 shown in Figure 8 are respectively for implementing the corresponding processes of the above-mentioned method embodiments, which will not be repeated here for the sake of brevity.
  • the software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps in the above method embodiment in combination with its hardware.
  • FIG. 9 is a schematic block diagram of an electronic device provided by an embodiment of the present disclosure.
  • the electronic device 900 may include:
  • the memory 910 and the processor 920 the memory 910 is used to store the computer program and transmit the program code to the processor 920.
  • the processor 920 can call and run the computer program from the memory 910 to implement the method in the embodiment of the present disclosure.
  • the processor 920 may be configured to execute the above method embodiments according to instructions in the computer program.
  • the processor 920 may include but is not limited to:
  • DSP digital signal processor
  • ASIC application-specific integrated circuit
  • FPGA field programmable gate array
  • the memory 910 includes but is not limited to:
  • Non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory.
  • the volatile memory can be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • DDR SDRAM double data rate synchronous dynamic random access memory
  • ESDRAM enhanced synchronous dynamic random access memory
  • SLDRAM synchronous link DRAM
  • DR RAM direct RAM bus random access memory
  • the computer program may be divided into one or more modules, which are stored in the memory 910 and executed by the processor 920 to complete the method provided by the present disclosure.
  • the one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device 900.
  • the electronic device may further include:
  • the transceiver 930 may be connected to the processor 920 or the memory 910 .
  • the processor 920 may control the transceiver 930 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices.
  • the transceiver 930 may include a transmitter and a receiver.
  • the transceiver 930 may further include an antenna, and the number of antennas may be one or more.
  • bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.
  • the present disclosure also provides a computer storage medium on which a computer program is stored.
  • the computer program is executed by a computer, the computer is enabled to perform the method of the above method embodiment.
  • the embodiments of the present disclosure also provide a computer program product including a computer program/instruction, which, when executed by a computer, enables the computer to execute the method of the above method embodiment.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode.
  • the computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration.
  • the available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid state disk (solid state disk, SSD)), etc.
  • a magnetic medium e.g., a floppy disk, a hard disk, a tape
  • an optical medium e.g., a digital video disc (digital video disc, DVD)
  • a semiconductor medium e.g., a solid state disk (solid state disk, SSD)

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开实施例提供了一种人机交互方法、装置、设备和存储介质。该方法包括：响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效；根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作；其中，所述目标手势包括双手框选手势和单手捏合手势中的其中一种。本公开实施例可以实现虚拟空间内任一空间界面的便捷交互，增强虚拟空间内的交互多样性和趣味性，提升虚拟空间内的交互氛围。

Description

人机交互方法、装置、设备和存储介质
本申请要求于2023年3月28日递交的中国专利申请第202310318461.2号的优先权，在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。
技术领域
本本公开的实施例涉及一种人机交互方法、装置、设备和存储介质。
背景技术
目前，XR技术的应用场景越来越广泛了，具体包含虚拟现实(Virtual Reality，简称为VR)、增强现实(Augmented Reality，简称为AR)和混合现实(Mixed Reality，简称为MR)等。在虚拟场景下会存在多个空间界面，用户可以在各个空间界面上进行相应交互，来沉浸式体验真实的虚拟场景。
通常情况下，用户通过在虚拟空间内发出一条指向性的虚拟射线，来与远距离下的各个空间界面进行交互，使得虚拟场景下的交互效果比较单一，缺乏一定的交互趣味性。
发明内容
本公开实施例提供一种人机交互方法、装置、设备和存储介质，实现虚拟空间内任一空间界面的便捷交互，增强虚拟空间内的交互多样性和趣味性。
第一方面，本公开实施例提供了一种人机交互方法，应用于XR设备，该方法包括：
响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效；
根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作；
其中，所述目标手势包括双手框选手势和单手捏合手势中的其中一种。
第二方面，本公开实施例提供了一种人机交互装置，配置于XR设备，该装置包括：
界面选中模块，用于响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效；
界面交互模块，用于根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作；
其中，所述目标手势包括双手框选手势和单手捏合手势中的其中一种。
第三方面，本公开实施例提供了一种电子设备，该电子设备包括：
处理器和存储器，该存储器用于存储计算机程序，该处理器用于调用并运行该存储器中存储的计算机程序，以执行本公开第一方面中提供的人机交互方法。
第四方面，本公开实施例提供了一种计算机可读存储介质，用于存储计算机程序，该计算机程序使得计算机执行如本公开第一方面中提供的人机交互方法。
第五方面，本公开实施例提供了一种计算机程序产品，包括计算机程序/指令，该计算机程序/指令使得计算机执行如本公开第一方面中提供的人机交互方法。
附图说明
为了更清楚地说明本公开实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的一种人机交互方法的流程图；
图2为本公开实施例提供的双手框选手势的示例性示意图；
图3为本公开实施例提供的另一种人机交互方法的流程图；
图4a为本公开实施例提供的通过双手框选手势确定待交互界面的示例性示意图；
图4b为本公开实施例提供的在双手框选手势对应的双手框选区域内呈现待交互界面的界面分身的示例性示意图；
图4c为本公开实施例提供的双手框选手势中的双手发生交叠的示例性示意图；
图5a为本公开实施例提供的单手捏合手势的一种示例性示意图；
图5b为本公开实施例提供的单手捏合手势的另一种示例性示意图；
图6为本公开实施例提供的通过单手捏合手势呈现待交互界面的选中特效的示例性示意图；
图7a为本公开实施例提供的通过第二类单手捏合手势唤出待交互界面的快捷功能面板的示例性示意图；
图7b为本公开实施例提供的第二类单手捏合手势对于快捷功能面板内任一功能控件的滑动选中操作的示例性示意图；
图8为本公开实施例提供的一种人机交互装置的示意图；以及
图9为本公开实施例提供的电子设备的示意性框图。
具体实施方式
下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本公开一部分实施例，而不是全部的实施例。基于本公开中的实施例，本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都属于本公开保护的范围。
需要说明的是，本公开的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本公开的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或服务器不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本公开实施例中，“示例性的”或者“例如”等词用于表示作例子、例证或说明，本公开实施例中被描述为“示例性的”或者“例如”的任何实施例或方案不应被解释为比其它实施例或方案更优选或更具优势。确切而言，使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。
为了解决虚拟空间内通过虚拟射线与各个空间界面交互时交互效果较为单一的问题，本公开的发明构思是：针对虚拟空间内的空间界面交互，预 先设定对应的目标手势，该目标手势可以包括双手框选手势和单手捏合手势中的其中一种，符合真实场景下的用户手势操作习惯。在虚拟空间内通过实时检测目标手势和目标手势的关联运动，来控制待交互界面在虚拟空间内执行对应的交互操作，从而实现虚拟空间内任一空间界面的便捷交互，增强虚拟空间内的交互多样性和趣味性。
图1为本公开实施例提供的一种人机交互方法的流程图，该方法可以应用于XR设备中，但不限于此。该方法可以由本公开提供的人机交互装置来执行，其中，人机交互装置可以通过任意的软件和/或硬件的方式实现。示例性地，人机交互装置可配置于AR/VR/MR等能够模拟虚拟场景的电子设备，本公开对电子设备的具体类型不作任何限制。
具体的，如图1所示，该方法可以包括如下步骤：
S110，响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效。
本公开中，虚拟空间可以为XR设备针对任一用户选择的某一真实互动场景，模拟出的相应虚拟环境，以便在虚拟空间内显示相应的互动信息。其中，虚拟空间可以是对真实世界的仿真环境，也可以是半仿真半虚构的虚拟场景，还可以是纯虚构的虚拟场景。
例如，用户选中某一类型的直播场景，来构建相应的虚拟直播环境，作为本公开中的虚拟空间，使得各个观众进入到该虚拟空间内来实现相应的直播互动。
通常情况下，用户在佩戴好XR设备后，通过开启该XR设备，使得XR设备处于工作状态。进而，XR设备可以为该用户模拟出由真实场景和虚拟场景融合后的某一具体虚拟场景，使得用户进入到预先构建好的虚拟空间内。
可以理解的是，为了确保用户在虚拟空间内的全方位便捷互动，虚拟空间内通常会显示多个空间界面，例如直播屏、弹幕公屏、功能操控屏以及通过功能操控屏上的任一功能控件所唤出的各功能面板等。
所以，为了保证用户在虚拟空间内与任一空间界面的便捷交互，本公开可以按照用户在真实场景下的手势操作习惯与各个空间界面交互操作之间的适配性，预先为空间界面所支持的各种交互操作定义对应的目标手势，以便在虚拟空间内通过捕捉用户手势即可准确触发空间界面的相应交互操作。
其中，为了确保虚拟空间内通过用户手势操控空间界面交互时能够更为符合用户的手势操作习惯，本公开中的目标手势可以包括但不限于双手框选手势和单手捏合手势中的其中一种。
因此，用户在进入虚拟空间后，会实时检测用户发出的手势指令，该手势指令可以包括但不限于手势语音指令、通过真实手柄等控制器所操控的手势动作以及用户在真实场景下的真实手部对应的手势图像等。通过解析该手势指令，来分析虚拟空间内手部模型所需要执行的手势动作，以此实时检测虚拟空间内的手部模型当前是否执行对应的目标手势。
当检测到虚拟空间内手部模型执行某一目标手势时，说明用户当前需要与虚拟空间内的某一空间界面进行相应交互。所以，通过分析目标手势中手部模型在虚拟空间内的位姿信息，来判断用户通过目标手势指定本次交互的空间界面，以此确定出本公开中的待交互界面。
而且，考虑到通过目标手势在虚拟空间内指定待交互界面时，可能存在由于手势指向误差而导致出现该待交互界面并不是用户当前想要交互的空间界面的情况。所以，为了避免待交互界面的选择误差，本公开在确定出虚拟空间内的待交互界面后，可以在虚拟空间内呈现该待交互界面的选中特效，以面向用户对本次交互的空间界面选择结果作出相应回应。那么，用户通过查看待交互界面的选中特效，可以判断该待交互界面是否为本次想要交互的空间界面。如果该待交互界面不是本次想要交互的空间界面，可以通过调整目标手势中手部模型的位姿信息，来及时选择新的空间界面并通过选中特效作出相应回应，以此通过直观选择出当前想要交互的待交互界面，从而保证待交互界面的准确性。
S120，根据目标手势的关联运动，控制待交互界面在虚拟空间内执行对应的交互操作。
可以理解的是，通过目标手势选出本次的待交互界面时，用户可以与该待交互界面进行多种交互，例如界面缩放、最小化、关闭、唤出等。所以，为了保证待交互界面的准确交互，本公开可以针对目标手势设定多种关联动作，每个关联动作可以对应一种交互操作。
而且，为目标手势设定多种关联运动可以保证手势动作间的连贯性，无需用户不断切换不同的手势来执行对应的交互操作，确保待交互界面的交互 便捷性。
所以，在确定出虚拟空间内的待交互界面后，本公开会继续实时检测目标手势中手部模型的位姿信息，来确定目标手势所执行的关联运动，以此确定出本次需要执行的交互操作。然后，在虚拟空间内，可以控制该待交互界面执行对应的交互操作，从而实现虚拟空间内任一空间界面的便捷交互。
本公开实施例提供的技术方案，进入虚拟空间后会实时检测目标手势，该目标手势可以包括双手框选手势和单手捏合手势中的其中一种。响应于检测到的目标手势，会在虚拟空间内呈现待交互界面的选中特效。然后，实时检测目标手势执行的关联运动，以此控制待交互界面在虚拟空间内执行对应的交互操作，从而实现虚拟空间内任一空间界面的便捷交互，增强虚拟空间内的交互多样性和趣味性，提升虚拟空间内的交互氛围。
作为本公开中的一种可选实现方案，本公开中的目标手势可以包括双手框选手势和单手捏合手势中的其中一种。为了确保虚拟空间内任一空间界面的交互准确性，本公开可以从双手框选手势和单手捏合手势这两种情况下，分别对虚拟空间内任一空间界面的具体交互过程进行说明。
第一种情况，目标手势为双手框选手势。
本公开中，双手框选手势可以为通过双手模型中的部分手指形成一个相对边界框的手势动作，以此可以框选出虚拟空间内当前待交互的空间界面。
在一些可实现方式中，本公开中双手框选手势可以如图2所示，其中一个单手模型的手掌向外，也就是背向用户，而另一个单手模型的手掌向内，也就是面向用户。而且，每个单手模型中的大拇指和食指可以分开呈现出L形状，使得每个单手模型中的大拇指和食指可以作为对应的框选边界，而形成一个相对四边形的边界框，来作为对应的双手框选手势。
由上述内容可知，在需要检测虚拟空间内的双手框选手势时，可以直接通过检测双手模型中大拇指和食指的位姿信息，无需检测其余三个手指的位姿信息，即可判断双手模型是否执行了双手框选手势。
接下来，对于通过双手框选手势触发的虚拟空间内任一空间界面的具体交互过程进行说明。
图3为本公开实施例提供的另一种人机交互方法的流程图，如图3所示，该方法可以包括如下步骤：
S310，响应于检测到的双手框选手势，根据双手框选手势中的双手位姿和用户头部位姿，确定虚拟空间内的待交互界面和双手框选区域。
用户进入虚拟空间后，可以实时检测用户发出的手势指令，例如手势语音指令、通过真实手柄等控制器所操控的手势动作以及用户在真实场景下的真实手部对应的手势图像等。然后，通过解析该手势指令，来判断虚拟空间内当前的手势动作是否为双手框选手势。
当检测到双手框选手势时，说明用户当前想要与虚拟空间内的某一空间界面进行交互。而双手框选手势通常会从用户观看视角下，将框选在双手之间的空间界面作为待交互界面。所以，本公开首先可以获取双手框选手势中双手模型的位姿信息和用户头部位姿信息。
其中，双手模型的位姿信息可以由真实手柄位姿或者真实手部位姿来确定，而用户头部位姿信息可以通过用户佩戴的XR设备的位姿信息来确定。
然后，根据双手模型在虚拟空间内的位姿信息，可以确定出双手模型间的相对中心点。而通过用户头部位姿信息，可以确定出用户的眼部点。如图4a所示，通过连接眼部点和相对中心点，并朝向空间界面进行连线延长，可以表示用户在虚拟空间内双手之间的观看视线。进而，通过判断该延长线指向的最近空间界面，可以确定出对应的待交互界面。
而且，为了保证双手框选手势对于待交互界面交互的直观性，本公开还可以通过分析双手框选手势中目标手指的位姿信息，来确定目标手指在虚拟空间内形成的双手框选区域，以便在双手框选区域内直观显示待交互界面的交互效果。
S320，在双手框选区域内呈现待交互界面的选中特效。
为了避免待交互界面的选择误差，本公开在确定出虚拟空间内的待交互界面后，可以在双手模型之间形成的双手框选区域内呈现该待交互界面的选中特效，以面向用户对本次交互的空间界面选择结果作出相应回应，提升待交互界面的选择直观性。
作为本公开中的一种可选实现方案，考虑到待交互界面可能距离用户较远，可以支持远场交互，而并不支持近场交互。那么，为了提升待交互界面的交互多样性，本公开可以在对待交互界面存在近场交互需求时，将待交互界面吸附到用户附近，而为待交互界面提供一种近场交互方式。
本公开中，对于待交互界面在双手框选区域内的选中特效呈现，本公开可以通过下述步骤来实现：确定双手框选手势的静态持续时长；如果静态持续时长小于预设持续阈值，则在双手框选区域内呈现待交互界面的界面分身，并调整待交互界面的透明度；如果静态持续时长大于等于预设持续阈值，则将待交互界面吸附到双手框选区域内而呈现。
也就是说，本公开可以通过双手框选手势保持处于静止状态下的持续时长，来判断用户对于待交互界面是否存在近场交互意图。所以，在检测到双手框选手势时，可以实时确定双手框选手势的静态持续时长。然后，通过判断双手框选手势的静态持续时长是否达到预设持续阈值，来分析用户对于待交互界面是否存在近场交互意图。
如果双手框选手势的静态持续时长小于预设持续阈值，说明用户对于待交互界面并不存在近场交互意图。那么，如图4b所示，本公开可以在双手框选区域内呈现出待交互界面的界面分身，以此作为待交互界面的选中特效，来对待交互界面进行选中提示。而且，为了保证待交互界面的交互真实性，本公开在双手框选区域内呈现出待交互界面的界面分身时，还会进一步调整待交互界面的透明度，例如将待交互界面的透明度降低为50％，以突出双手框选区域内的界面分身。
而如果双手框选手势的静态持续时长大于等于预设持续阈值，说明双手框选手势在预设持续阈值的时长下一直保持不动，而表示用户对于待交互界面存在近场交互意图。那么，本公开可以直接将待交互界面从原本位置处吸附到双手框选区域内进行呈现，并控制待交互界面的大小能够适合该双手框选区域，以此作为待交互界面的选中特效。
S330，响应于双手框选手势对应的双手相向运动，在双手框选区域呈现待交互界面的虚拟缩放特效。
在确定出虚拟空间内的待交互界面后，通过控制双手框选手势中的双手模型执行对应的关联运动，可以触发待交互界面执行对应的交互操作。所以，本公开可以实时检测双手框选手势中双手模型的位姿信息，来确定双手模型在双手框选手势下所执行的关联手势动作。
当检测到双手框选手势对应的双手相向运动时，也就是双手模型在双手框选手势下不断接近对方，那么双手框选手势所形成的双手框选区域会随着 双手相向运动不断变小。而双手框选区域内呈现有待交互界面或者待交互界面的界面分身。所以，在双手框选手势执行双手相向运动的过程中，本公开可以根据双手框选区域的大小不断对待交互界面或者待交互界面的界面分身进行相应缩放，使得待交互界面或者待交互界面的界面分身能够一直处于双手框选区域内，以在双手框选区域呈现出待交互界面的虚拟缩放特效。
S340，当双手框选手势中的双手发生交叠时，控制待交互界面执行对应的最小化操作或关闭操作。
双手框选手势中的双手模型在不断执行双手相向运动后，双手框选手势中的双手模型最终会发生交叠，如图4c所示。在双手框选手势中的双手发生交叠时，说明用户想要将待交互界面最小化或者关闭，那么可以直接控制待交互界面在虚拟空间内执行对应的最小化操作或关闭操作。
此外，由于通过双手框选手势选出待交互界面后，用户可能不再想要与该待交互界面进行交互。那么，本公开可以为待交互界面提供一个交互取消操作，也就是双手框选手势中任一单手的翻转操作。所以，通过实时检测双手框选手势中任一单手是否执行翻转操作，来判断当前是否需要取消待交互界面的交互操作。在检测到双手框选手势中任一单手的翻转操作时，说明用户可能不再想要与该待交互界面进行交互，那么可以直接控制该待交互界面返回到未交互状态，从而取消用户对于待交互界面已执行但还未确认完成的所有交互操作。
第二种情况，目标手势为单手捏合手势。
本公开中，单手捏合手势可以为双手模型中任一单手模型的至少两个手指凑合到一起而形成的手势动作，并按照单手捏合手势的位姿可以从手指捏合点向外发出相应的虚拟射线，而指向虚拟空间内当前待交互的空间界面。
在一些可实现方式中，本公开中单手捏合手势可以如图5a和图5b所示，任一个单手模型中的大拇指和剩余其他手指中的任一手指(例如食指或中指)可以凑合到一起，而形成对应的单手捏合手势。而且，大拇指和剩余其他手指中的任一手指凑合到一起的接触点可以是单手捏合手势中的手指捏合点。
由上述内容可知，在需要检测虚拟空间内的单手捏合手势时，可以直接通过检测单手模型中大拇指和剩余其他手指中的任一手指的位姿信息，无需检测另外三个手指的位姿信息，即可判断单手模型是否执行了单手捏合手势。
那么，对于待交互界面的选中特效，可以根据单手捏合手势发出的虚拟射线，确定虚拟空间内的待交互界面；在虚拟空间内呈现待交互界面的选中特效。
也就是说，当检测到虚拟空间内的单手捏合手势时，首先可以获取该单手捏合手势对应的单手模型中用于执行捏合动作的目标手指的位姿信息。然后，根据目标手指的位姿信息可以确定出手指捏合点在虚拟空间内的指定方向。进而，从该手指捏合点处，可以按照该指定方向向外发出对应的虚拟射线，以指向虚拟空间内的任一空间界面，从而确定出对应的待交互界面。
可以理解的是，本公开中的虚拟射线可以线性呈现，也可以隐性呈现而在该虚拟射线与所指向的待交互界面间的交点处呈现一个光标点即可。
然后，为了避免待交互界面的选择误差，本公开可以为待交互界面增添一种新的显示样式，例如增添一种如图6所示的界面边框效果等，使其区分于其他空间界面，而呈现出该待交互界面的选中特效，以便用户通过查看该选中特效来及时调整待交互界面，确保待交互界面的准确性。
在一些可实现方式中，由于单手模型在不同手掌朝向下均可以执行单手捏合手势，使得单手捏合手势可能存在不同的手掌朝向。而为了避免虚拟空间内由于手势过多而影响到空间界面的便捷交互，本公开对于不同手掌朝向的单手捏合手势，可以设定不同的交互操作，以实现同一手势在不同朝向下触发不同的交互操作。
本公开中，按照单手捏合手势中的手掌朝向，可以将单手捏合手势分为第一类单手捏合手势和第二类单手捏合手势。
示例性的，第一类单手捏合手势可以为如图5a所示的手掌朝下、由大拇指和食指凑合到一起而形成的单手捏合手势。第二类单手捏合手势可以为如图5b所示的手掌朝上、由大拇指和中指凑合到一起而形成的单手捏合手势。
此时，不同的单手捏合手势会触发待交互界面执行不同的交互操作。接下来本公开可以从第一类单手捏合手势和第二类单手捏合手势这两方面，分别对根据目标手势的关联运动，控制待交互界面在虚拟空间内执行对应的交互操作的步骤进行详细说明。
1)目标手势为第一类单手捏合手势
对于虚拟空间内的第一类单手捏合手势，在虚拟空间内呈现出待交互界 面的选中特效后，首先会确定出第一类单手捏合手势的单手模型中用于执行捏合动作的目标手指。通过实时检测目标手指的位姿信息，确定第一类单手捏合手势中目标手指所执行的关联运动。
本公开中，可以设定用户通过在做出单手捏合手势后快速弹出其中一个目标手指，例如大拇指和食指捏合时的第一类单手捏合手势中食指执行快速弹出的动作，来控制待交互界面的最小化或关闭操作。
所以，本公开在检测第一类单手捏合手势中某一目标手指相对于其他目标手指存在一定的相对加速度时，可以确定第一类单手捏合手势中的目标手指执行了相对加速运动，说明第一类单手捏合手势中的目标手指通过快速的相对运动而发生了某一目标手指快速弹出的捏合松开动作，表示用户想要最小化或关闭待交互界面。所以，响应于第一类单手捏合手势中目标手指的相对加速运动，可以直接控制待交互界面执行对应的最小化操作或关闭操作。
可以理解的是，如果第一类单手捏合手势中目标手指发生慢慢松开捏合的手势动作，那么并不会控制待交互界面执行最小化或关闭操作。
由于通过第一类单手捏合手势选出待交互界面后，用户可能不再想要与该待交互界面进行交互。那么，本公开可以通过判断第一类单手捏合手势中的目标手指关节点是否处于同一空间平面内，来分析用户是否想要取消待交互界面的交互操作。其中，目标手指关节点可以为第一类单手捏合手势中至少三个手指上的特定关节点。
在检测到第一类单手捏合手势中的目标手指关节点处于同一空间平面内，说明用户不再想要与该待交互界面进行交互，那么可以直接控制该待交互界面返回到未交互状态，从而取消用户对于待交互界面已执行但还未确认完成的所有交互操作。
2)目标手势为第二类单手捏合手势
为了确保待交互界面的快捷交互，本公开还可以为待交互界面设定一个快捷功能面板，该快捷功能面板内设置有待交互界面可支持的各类交互操作对应的功能控件，例如最小化、关闭、显示所有界面等。那么，为了保证快捷功能面板的准确唤出，本公开可以设定第二类单手捏合手势为待交互界面的快捷功能面板的唤出指令。
所以，对于虚拟空间内的第二类单手捏合手势，在虚拟空间内呈现出待 交互界面的选中特效后，可以继续确定出第二类单手捏合手势的手指捏合点。并且，如图7a所示，可以在该手指捏合点处呈现待交互界面的快捷功能面板，以便用户通过第二类单手捏合手势在快捷功能面板上快捷触发对应的功能控件，来执行对应的交互操作，无需通过操控真实手柄或鼠标右键来唤出对应的快捷功能面板，提升快捷功能面板唤出的可扩展能力。
其中，快捷功能面板可以呈现出不同的面板样式，本公开对此不作限定。
由于快捷功能面板呈现于第二类单手捏合手势的手指捏合点处，那么通过第二类单手捏合手势的不断滑动，可以使得手指捏合点位于快捷功能面板内不同功能控件的位置处，从而选择不同的功能控件对应的交互操作。
所以，如图7b所示，通过实时检测第二类单手捏合手势中的手指捏合点在快捷功能面板内的滑动操作，可以确定第二类单手捏合手势的手指捏合点滑动至快捷功能面板内的哪一功能控件处。然后，在检测到第二类单手捏合手势的手指捏合点滑动至快捷功能面板内的某一功能控件处后继续执行了捏合松开操作时，说明用户通过第二类单手捏合手势选中快捷功能面板内的该功能控件对应的交互操作，从而生成第二类单手捏合手势面向快捷功能面板内该功能控件的滑动选中操作。那么，响应于第二类单手捏合手势面向快捷功能面板内任一功能控件的滑动选中操作，可以直接控制待交互界面执行该功能控件对应的交互操作，从而提升虚拟空间内空间界面的交互便捷性。
本公开实施例提供的技术方案，进入虚拟空间后会实时检测目标手势，该目标手势可以包括双手框选手势和单手捏合手势中的其中一种。响应于检测到的目标手势，会在虚拟空间内呈现待交互界面的选中特效。然后，实时检测目标手势执行的关联运动，以此控制待交互界面在虚拟空间内执行对应的交互操作，从而实现虚拟空间内任一空间界面的便捷交互，增强虚拟空间内的交互多样性和趣味性，提升虚拟空间内的交互氛围。
图8为本公开实施例提供的一种人机交互装置的示意图，该人机交互装置800可以配置于XR设备中，该人机交互装置800可以包括：
界面选中模块810，用于响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效；
界面交互模块820，用于根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作；
其中，所述目标手势包括双手框选手势和单手捏合手势中的其中一种。
在一些可实现方式中，如果所述目标手势为双手框选手势，则界面选中模块810，可以包括：
界面选中单元，用于根据所述双手框选手势中的双手位姿和用户头部位姿，确定虚拟空间内的待交互界面和双手框选区域；
特效呈现单元，用于在所述双手框选区域内呈现所述待交互界面的选中特效。
在一些可实现方式中，特效呈现单元，可以具体用于：
确定所述双手框选手势的静态持续时长；
如果所述静态持续时长小于预设持续阈值，则在所述双手框选区域内呈现所述待交互界面的界面分身，并调整所述待交互界面的透明度；
如果所述静态持续时长大于等于所述预设持续阈值，则将所述待交互界面吸附到所述双手框选区域内而呈现。
在一些可实现方式中，如果所述目标手势为双手框选手势，则界面交互模块820，可以包括：
界面缩放单元，用于响应于所述双手框选手势对应的双手相向运动，在所述双手框选区域呈现所述待交互界面的虚拟缩放特效；
界面交互单元，用于当所述双手框选手势中的双手发生交叠时，控制所述待交互界面执行对应的最小化操作或关闭操作。
在一些可实现方式中，人机交互装置800，还可以包括：
交互取消模块，用于响应于所述双手框选手势中任一单手的翻转操作，控制所述待交互界面返回到未交互状态。
在一些可实现方式中，如果所述目标手势为单手捏合手势，则界面选中模块810，可以具体用于：
根据所述单手捏合手势发出的虚拟射线，确定虚拟空间内的待交互界面；
在所述虚拟空间内呈现所述待交互界面的选中特效。
在一些可实现方式中，所述单手捏合手势按照手势朝向分为第一类单手捏合手势和第二类单手捏合手势。
在一些可实现方式中，如果所述目标手势为第一类单手捏合手势，则界面交互模块820，可以具体用于：
响应于所述第一类单手捏合手势中目标手指的相对加速运动，控制所述待交互界面执行对应的最小化操作或关闭操作。
在一些可实现方式中，如果所述目标手势为第一类单手捏合手势，则交互取消模块，还可以用于：
如果所述第一类单手捏合手势中的目标手指关节点处于同一空间平面内，则控制所述待交互界面返回到未交互状态。
在一些可实现方式中，如果所述目标手势为第二类单手捏合手势，则界面交互模块820，还可以具体用于：
在所述第二类单手捏合手势的手指捏合点处呈现所述待交互界面的快捷功能面板；
响应于所述第二类单手捏合手势面向所述快捷功能面板内任一功能控件的滑动选中操作，控制所述待交互界面执行所述功能控件对应的交互操作。
在一些可实现方式中，所述滑动选中操作为所述第二类单手捏合手势的手指捏合点滑动至所述快捷功能面板内任一功能控件处后的捏合松开操作。
本公开实施例中，进入虚拟空间后会实时检测目标手势，该目标手势可以包括双手框选手势和单手捏合手势中的其中一种。响应于检测到的目标手势，会在虚拟空间内呈现待交互界面的选中特效。然后，实时检测目标手势执行的关联运动，以此控制待交互界面在虚拟空间内执行对应的交互操作，从而实现虚拟空间内任一空间界面的便捷交互，增强虚拟空间内的交互多样性和趣味性，提升虚拟空间内的交互氛围。
应理解的是，该装置实施例与本公开中的方法实施例可以相互对应，类似的描述可以参照本公开中的方法实施例。为避免重复，此处不再赘述。
具体地，图8所示的装置800可以执行本公开提供的任一方法实施例，并且图8所示的装置800中的各个模块的前述和其它操作和/或功能分别为了实现上述方法实施例的相应流程，为了简洁，在此不再赘述。
上文中结合附图从功能模块的角度描述了本公开实施例的上述方法实施例。应理解，该功能模块可以通过硬件形式实现，也可以通过软件形式的指令实现，还可以通过硬件和软件模块组合实现。具体地，本公开实施例中的方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路和/或软件形式的指令完成，结合本公开实施例公开的方法的步骤可以直接体现为硬件 译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。可选地，软件模块可以位于随机存储器，闪存、只读存储器、可编程只读存储器、电可擦写可编程存储器、寄存器等本领域的成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述方法实施例中的步骤。
图9为本公开实施例提供的电子设备的示意性框图。
如图9所示，该电子设备900可包括：
存储器910和处理器920，该存储器910用于存储计算机程序，并将该程序代码传输给该处理器920。换言之，该处理器920可以从存储器910中调用并运行计算机程序，以实现本公开实施例中的方法。
例如，该处理器920可用于根据该计算机程序中的指令执行上述方法实施例。
在本公开的一些实施例中，该处理器920可以包括但不限于：
通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等等。
在本公开的一些实施例中，该存储器910包括但不限于：
易失性存储器和/或非易失性存储器。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synch link DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DR RAM)。
在本公开的一些实施例中，该计算机程序可以被分割成一个或多个模块，该一个或者多个模块被存储在该存储器910中，并由该处理器920执行，以完成本公开提供的方法。该一个或多个模块可以是能够完成特定功能的一系列计算机程序指令段，该指令段用于描述该计算机程序在该电子设备900的执行过程。
如图9所示，该电子设备还可包括：
收发器930，该收发器930可连接至该处理器920或存储器910。
其中，处理器920可以控制该收发器930与其他设备进行通信，具体地，可以向其他设备发送信息或数据，或接收其他设备发送的信息或数据。收发器930可以包括发射机和接收机。收发器930还可以进一步包括天线，天线的数量可以为一个或多个。
应当理解，该电子设备900中的各个组件通过总线系统相连，其中，总线系统除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。
本公开还提供了一种计算机存储介质，其上存储有计算机程序，该计算机程序被计算机执行时使得该计算机能够执行上述方法实施例的方法。
本公开实施例还提供一种包含计算机程序/指令的计算机程序产品，该计算机程序/指令被计算机执行时使得计算机执行上述方法实施例的方法。
当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行该计算机程序指令时，全部或部分地产生按照本公开实施例该的流程或功能。该计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。该计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，该计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。该计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质(例如，软盘、硬盘、磁带)、光介质(例如数字视频光盘(digital video disc，DVD))、或者半导体介质(例如固态硬盘(solid state disk，SSD))等。
以上仅为本公开的具体实施方式，但本公开的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本公开揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本公开的保护范围之内。因此，本公开的保护范围应以该权利要求的保护范围为准。

Claims (15)

  1. 一种人机交互方法，应用于扩展现实XR设备，包括：
    响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效；
    根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作；
    其中，所述目标手势包括双手框选手势和单手捏合手势中的其中一种。
  2. 根据权利要求1所述的方法，其中，如果所述目标手势为双手框选手势，则所述在虚拟空间内呈现待交互界面的选中特效，包括：
    根据所述双手框选手势中的双手位姿和用户头部位姿，确定所述虚拟空间内的所述待交互界面和双手框选区域；
    在所述双手框选区域内呈现所述待交互界面的选中特效。
  3. 根据权利要求2所述的方法，其中，所述在所述双手框选区域内呈现所述待交互界面的选中特效，包括：
    确定所述双手框选手势的静态持续时长；
    如果所述静态持续时长小于预设持续阈值，则在所述双手框选区域内呈现所述待交互界面的界面分身，并调整所述待交互界面的透明度；
    如果所述静态持续时长大于等于所述预设持续阈值，则将所述待交互界面吸附到所述双手框选区域内而呈现。
  4. 根据权利要求2所述的方法，其中，所述根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作，包括：
    响应于所述双手框选手势对应的双手相向运动，在所述双手框选区域呈现所述待交互界面的虚拟缩放特效；
    当所述双手框选手势中的双手发生交叠时，控制所述待交互界面执行对应的最小化操作或关闭操作。
  5. 根据权利要求1-4任一项所述的方法，其中，如果所述目标手势为双手框选手势，所述方法还包括：
    响应于所述双手框选手势中任一单手的翻转操作，控制所述待交互界面返回到未交互状态。
  6. 根据权利要求1所述的方法，其中，如果所述目标手势为单手捏合手 势，则所述在虚拟空间内呈现待交互界面的选中特效，包括：
    根据所述单手捏合手势发出的虚拟射线，确定虚拟空间内的待交互界面；
    在所述虚拟空间内呈现所述待交互界面的选中特效。
  7. 根据权利要求1所述的方法，其中，所述单手捏合手势按照手势朝向分为第一类单手捏合手势和第二类单手捏合手势。
  8. 根据权利要求7所述的方法，其中，如果所述目标手势为第一类单手捏合手势，则所述根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作，包括：
    响应于所述第一类单手捏合手势中目标手指的相对加速运动，控制所述待交互界面执行对应的最小化操作或关闭操作。
  9. 根据权利要求7或8所述的方法，其中，如果所述目标手势为第一类单手捏合手势，所述方法还包括：
    如果所述第一类单手捏合手势中的目标手指关节点处于同一空间平面内，则控制所述待交互界面返回到未交互状态。
  10. 根据权利要求7所述的方法，其中，如果所述目标手势为第二类单手捏合手势，则所述根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作，包括：
    在所述第二类单手捏合手势的手指捏合点处呈现所述待交互界面的快捷功能面板；
    响应于所述第二类单手捏合手势面向所述快捷功能面板内任一功能控件的滑动选中操作，控制所述待交互界面执行所述功能控件对应的交互操作。
  11. 根据权利要求10所述的方法，其中，所述滑动选中操作为所述第二类单手捏合手势的手指捏合点滑动至所述快捷功能面板内任一功能控件处后的捏合松开操作。
  12. 一种人机交互装置，配置于扩展现实XR设备，包括：
    界面选中模块，被配置为响应于检测到的目标手势，在虚拟空间内呈现待交互界面的选中特效；
    界面交互模块，被配置为根据所述目标手势的关联运动，控制所述待交互界面在所述虚拟空间内执行对应的交互操作；
    其中，所述目标手势包括双手框选手势和单手捏合手势中的其中一种。
  13. 一种电子设备，包括：
    处理器；以及
    存储器，被配置为存储所述处理器的可执行指令；
    其中，所述处理器被配置为经由执行所述可执行指令来执行权利要求1-11任一项所述的人机交互方法。
  14. 一种计算机可读存储介质，其上存储有计算机程序，其中，所述计算机程序被处理器执行时实现权利要求1-11任一项所述的人机交互方法。
  15. 一种包含计算机程序/指令的计算机程序产品，其中，当所述计算机程序产品包含的所述计算机程序/指令在电子设备上运行时，使得所述电子设备执行权利要求1-11任一项所述的人机交互方法。
PCT/CN2024/083499 2023-03-28 2024-03-25 人机交互方法、装置、设备和存储介质 Ceased WO2024199169A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310318461.2 2023-03-28
CN202310318461.2A CN116540866A (zh) 2023-03-28 2023-03-28 一种人机交互方法、装置、设备和存储介质

Publications (1)

Publication Number Publication Date
WO2024199169A1 true WO2024199169A1 (zh) 2024-10-03

Family

ID=87442455

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/083499 Ceased WO2024199169A1 (zh) 2023-03-28 2024-03-25 人机交互方法、装置、设备和存储介质

Country Status (2)

Country Link
CN (1) CN116540866A (zh)
WO (1) WO2024199169A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120595938A (zh) * 2025-05-16 2025-09-05 杭州尼欧装饰新材料有限公司 装饰纸凹版加工控制方法、装置、电子设备及存储介质

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116540866A (zh) * 2023-03-28 2023-08-04 北京字跳网络技术有限公司 一种人机交互方法、装置、设备和存储介质
CN118760382A (zh) * 2024-06-13 2024-10-11 北京达佳互联信息技术有限公司 多媒体资源互动方法、装置、终端及计算机可读存储介质
CN120104010B (zh) * 2025-05-09 2025-10-21 北京虹宇科技有限公司 三维空间中的多选方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112051961A (zh) * 2020-09-04 2020-12-08 脸萌有限公司 虚拟交互方法、装置、电子设备及计算机可读存储介质
CN112181219A (zh) * 2020-08-31 2021-01-05 华为技术有限公司 一种图标显示方法及其装置
CN113238650A (zh) * 2021-04-15 2021-08-10 青岛小鸟看看科技有限公司 手势识别和控制的方法、装置及虚拟现实设备
CN115509361A (zh) * 2022-10-12 2022-12-23 北京字跳网络技术有限公司 虚拟空间交互方法、装置、设备和介质
CN116540866A (zh) * 2023-03-28 2023-08-04 北京字跳网络技术有限公司 一种人机交互方法、装置、设备和存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112817443A (zh) * 2021-01-22 2021-05-18 歌尔科技有限公司 基于手势的显示界面控制方法、装置、设备及存储介质
CN113282166A (zh) * 2021-05-08 2021-08-20 青岛小鸟看看科技有限公司 头戴式显示设备的交互方法、装置及头戴式显示设备
CN113282169B (zh) * 2021-05-08 2023-04-07 青岛小鸟看看科技有限公司 头戴式显示设备的交互方法、装置及头戴式显示设备
CN114327063B (zh) * 2021-12-28 2024-08-16 亮风台（上海）信息科技有限公司 目标虚拟对象的交互方法、装置、电子设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112181219A (zh) * 2020-08-31 2021-01-05 华为技术有限公司 一种图标显示方法及其装置
CN112051961A (zh) * 2020-09-04 2020-12-08 脸萌有限公司 虚拟交互方法、装置、电子设备及计算机可读存储介质
CN113238650A (zh) * 2021-04-15 2021-08-10 青岛小鸟看看科技有限公司 手势识别和控制的方法、装置及虚拟现实设备
CN115509361A (zh) * 2022-10-12 2022-12-23 北京字跳网络技术有限公司 虚拟空间交互方法、装置、设备和介质
CN116540866A (zh) * 2023-03-28 2023-08-04 北京字跳网络技术有限公司 一种人机交互方法、装置、设备和存储介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120595938A (zh) * 2025-05-16 2025-09-05 杭州尼欧装饰新材料有限公司 装饰纸凹版加工控制方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN116540866A (zh) 2023-08-04

Similar Documents

Publication Publication Date Title
WO2024199169A1 (zh) 人机交互方法、装置、设备和存储介质
CN105518575B (zh) 与自然用户界面的双手交互
US20170263033A1 (en) Contextual Virtual Reality Interaction
US11693544B2 (en) Mobile terminal display picture control method, apparatus, and device and storage medium
CN108355347B (zh) 交互控制方法、装置、电子设备及存储介质
JP2017513106A (ja) スクリーンショットの生成
CN113282169B (zh) 头戴式显示设备的交互方法、装置及头戴式显示设备
JP6360509B2 (ja) 情報処理プログラム、情報処理システム、情報処理方法、および情報処理装置
CN113457117B (zh) 游戏中的虚拟单位选取方法及装置、存储介质及电子设备
CN113282166A (zh) 头戴式显示设备的交互方法、装置及头戴式显示设备
CN108776544B (zh) 增强现实中的交互方法及装置、存储介质、电子设备
WO2024251162A1 (zh) 一种三维空间中的多窗口处理方法、设备及系统
US20160216771A1 (en) Image projecting device having wireless controller and image projecting method thereof
US12449918B2 (en) Panel interaction method, apparatus, device and storage medium
CN107092410A (zh) 一种触摸屏的界面交互方法、设备以及智能终端设备
WO2025223184A1 (zh) 人机交互方法、装置、设备和介质
WO2024077873A1 (zh) 虚拟场景缩放方法、装置、存储介质与电子设备
CN118151740A (zh) 一种手势交互方法、装置及电子设备
CN116088689A (zh) 一种人机交互方法、装置、设备和存储介质
CN116755563A (zh) 用于头戴显示设备的交互控制方法和装置
CN118363686A (zh) 应用的调用方法、装置、设备、介质和程序产品
WO2024077872A1 (zh) 显示位置调整方法、装置、存储介质与电子设备
CN116126205A (zh) 交互控制方法、装置、可穿戴设备及存储介质
US20250370587A1 (en) Control method, apparatus, device, and medium for an application in an extended reality space
CN115993894A (zh) 一种触控响应方法、装置、交互平板及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24777957

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 24777957

Country of ref document: EP

Kind code of ref document: A1