WO2019091369A1 - 虚拟环境与物理硬件的交互方法、装置和存储介质 - Google Patents

虚拟环境与物理硬件的交互方法、装置和存储介质 Download PDF

Info

Publication number
WO2019091369A1
WO2019091369A1 PCT/CN2018/114139 CN2018114139W WO2019091369A1 WO 2019091369 A1 WO2019091369 A1 WO 2019091369A1 CN 2018114139 W CN2018114139 W CN 2018114139W WO 2019091369 A1 WO2019091369 A1 WO 2019091369A1
Authority
WO
WIPO (PCT)
Prior art keywords
physical hardware
role
virtual environment
state information
attribute
Prior art date
Application number
PCT/CN2018/114139
Other languages
English (en)
French (fr)
Inventor
李晓峰
胡锦宏
Original Assignee
深圳市创客工场科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市创客工场科技有限公司 filed Critical 深圳市创客工场科技有限公司
Publication of WO2019091369A1 publication Critical patent/WO2019091369A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/61—Installation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/65—Updates

Definitions

  • the present disclosure relates to the field of computer application technologies, and in particular, to a method, an apparatus, and a computer readable storage medium for interacting between a virtual environment and physical hardware.
  • the implemented application can implement a virtual environment for the user to perform the manipulation of the characters in the virtual environment.
  • the virtual environment may be a game played by the user, and the role being manipulated is a virtual character in the game of the game.
  • the interaction between the existing virtual environment and the physical hardware has the limitation that the configuration role and the physical hardware cannot be customized, and the threshold is high.
  • the present disclosure provides a method, device, and computer for implementing the interaction between the virtual environment and the physical hardware. Read the storage medium.
  • a method for interacting a virtual environment with physical hardware comprising:
  • the attribute state information that is stored synchronously is synchronously updated, and the synchronization update is performed so that the party that does not apply the external change responds Describe external changes.
  • An interaction device between a virtual environment and physical hardware comprising:
  • Loading a module configured to perform loading of a role associated with physical hardware in the virtual environment, where the physical hardware accesses the virtual environment by being associated with the role;
  • a configuration module configured to perform attribute configuration on the role and the physical hardware to obtain attribute status information after the attribute configuration, where the attribute status information respectively corresponds to the role and the physical hardware;
  • a synchronous storage module configured to perform synchronous storage of the attribute state information between the role and the physical hardware
  • the attribute state information that is synchronously stored is synchronously updated, and the party that has not applied the external change responds to the External changes.
  • An interaction device between a virtual environment and physical hardware including:
  • a memory having stored thereon computer readable instructions that, when executed by the processor, implement a method of interacting between a virtual environment and physical hardware as previously described.
  • a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements a method of interacting between a virtual environment and physical hardware as previously described.
  • the physical hardware for customizing the interaction of the virtual environment, and the role of the physical hardware in the virtual environment will first perform the loading of the role associated with the physical hardware in the virtual environment, that is, the role of the physical hardware in the virtual environment.
  • the physical hardware is connected to the virtual environment through the association with the role, and then the attributes and physical hardware are configured to obtain attribute status information corresponding to the role and physical hardware, and finally between the role and the physical hardware.
  • the synchronous storage of the attribute state information is performed, so that under the action of the attribute state information of the synchronous storage, when any one of the character and the physical hardware is applied with an external change, the attribute state information changes, and on the other hand, the change is synchronized, and further Responding to the external changes imposed, thus realizing the interaction between the virtual environment and the physical hardware, and because the attribute and physical hardware involved are shared attribute state information, the program control of the physical hardware no longer needs to be separate. Programming, physical hardware and virtual environment are in the same World, it makes between the physical hardware and the natural role can communicate to customize realize low threshold interactive virtual environment and the physical hardware.
  • FIG. 1 is a schematic diagram of an implementation environment of the present disclosure, according to an exemplary embodiment
  • FIG. 2 is a block diagram of an apparatus, according to an exemplary embodiment
  • FIG. 3 is a flowchart of a method for interacting a virtual environment with physical hardware according to an exemplary embodiment
  • FIG. 4 is a flowchart of a method for interacting a virtual environment with physical hardware according to another exemplary embodiment
  • FIG. 5 is a flow diagram depicting the details of step 310, illustrated in accordance with the corresponding embodiment of Figure 3;
  • FIG. 6 is a flow chart depicting the details of step 350, illustrated in accordance with the corresponding embodiment of Figure 3;
  • FIG. 7 is a flow diagram depicting the details of step 430, illustrated in accordance with the corresponding embodiment of Figure 4;
  • FIG. 8 is a schematic diagram illustrating the presence of attribute state information at an active layer according to an exemplary embodiment
  • FIG. 9 is a sequence diagram showing interaction between a user, a character, and physical hardware, according to an exemplary embodiment
  • FIG. 10 is a block diagram showing an interaction device between a virtual environment and physical hardware, according to an exemplary embodiment
  • FIG. 11 is a block diagram showing an interaction device between a virtual environment and physical hardware, according to another exemplary embodiment
  • FIG 12 is a block diagram depicting the details of a load module, shown in accordance with the corresponding embodiment of Figure 10.
  • FIG. 1 is a schematic diagram of an implementation environment of the present disclosure, according to an exemplary embodiment.
  • the implementation environment involved in the present disclosure includes a control terminal 110 and physical hardware 130.
  • the control terminal 110 is used to implement a virtual environment and control logic related to the virtual environment.
  • the control terminal 110 may be at least one of a terminal device such as a computer terminal, a smart phone, and a tablet computer.
  • the physical hardware 130 is a physical hardware that is separated from the control terminal 110 and exists in the physical world. For example, it may be various electronic components such as sensors, or may be a trolley equipped with various sensors and packaged by a certain shape housing.
  • a hardware device equipped with a communication connection interface eg, a WiFi communication connection interface).
  • the physical hardware 130 will be connected to the virtual environment constructed by the control terminal 110.
  • the physical hardware can be made through external changes imposed in the virtual environment, such as manipulation of characters. 130 senses and responds; on the other hand, it is also possible to apply external changes to the physical hardware, thereby causing the characters in the virtual environment to perceive and respond.
  • control terminal 110 is uniquely present, and the physical hardware 130 may be one or two or more, and may be of a single type or a plurality of types.
  • device 200 is a block diagram of an apparatus, according to an exemplary embodiment.
  • device 200 can be a smartphone in the implementation environment described above.
  • apparatus 200 can include one or more of the following components: processing component 202, memory 204, power component 206, multimedia component 208, audio component 210, sensor component 214, and communication component 216.
  • Processing component 202 typically controls the overall operation of device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations, and the like.
  • Processing component 202 can include one or more processors 218 to execute instructions to perform all or part of the steps of the methods described below.
  • processing component 202 can include one or more modules to facilitate interaction between component 202 and other components.
  • processing component 202 can include a multimedia module to facilitate interaction between multimedia component 208 and processing component 202.
  • Memory 204 is configured to store various types of data to support operation at device 200. Examples of such data include instructions for any application or method operating on device 200.
  • the memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read only memory (Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), Read Only Memory ( Read-Only Memory (ROM), magnetic memory, flash memory, disk or optical disk. Also stored in memory 204 is one or more modules configured to be executed by the one or more processors 218 to perform any of the following Figures 2, 3, 4, and 5 Show all or part of the steps in the method.
  • SRAM Static Random Access Memory
  • EEPROM Electrically erasable programmable read only memory
  • EPROM Erasable Programmable Read Only Memory
  • PROM Programmable Red-Only Memory
  • ROM Read
  • Power component 206 provides power to various components of device 200.
  • Power component 206 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 200.
  • the multimedia component 208 includes a screen between the device 200 and the user that provides an output interface.
  • the screen may include a liquid crystal display (LCD) and a touch panel. If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may sense not only the boundary of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the screen may also include an Organic Light Emitting Display (OLED).
  • OLED Organic Light Emitting Display
  • the audio component 210 is configured to output and/or input an audio signal.
  • the audio component 210 includes a microphone (Microphone, MIC for short) that is configured to receive an external audio signal when the device 200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 204 or transmitted via communication component 216.
  • audio component 210 also includes a speaker for outputting an audio signal.
  • Sensor assembly 214 includes one or more sensors for providing status assessment of various aspects to device 200.
  • sensor assembly 214 can detect an open/closed state of device 200, relative positioning of components, and sensor component 214 can also detect changes in position of one component of device 200 or device 200 and temperature changes of device 200.
  • the sensor assembly 214 can also include a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 216 is configured to facilitate wired or wireless communication between device 200 and other devices.
  • the device 200 can access a wireless network based on a communication standard such as WiFi (WIreless-Fidelity).
  • communication component 216 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 216 also includes a Near Field Communication (NFC) module to facilitate short range communication.
  • NFC Near Field Communication
  • the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth technology, and other technologies. .
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • the apparatus 200 may be configured by one or more Application Specific Integrated Circuits (ASICs), digital signal processors, digital signal processing devices, programmable logic devices, field programmable gate arrays, Implemented by a controller, microcontroller, microprocessor or other electronic component for performing the methods described below.
  • ASICs Application Specific Integrated Circuits
  • digital signal processors digital signal processing devices
  • programmable logic devices programmable logic devices
  • field programmable gate arrays Implemented by a controller, microcontroller, microprocessor or other electronic component for performing the methods described below.
  • FIG. 3 is a flowchart of a method for interacting a virtual environment with physical hardware, according to an exemplary embodiment.
  • the interaction between the virtual environment and the physical hardware is applicable to the control terminal 110 referred to in the implementation environment shown in FIG. 1.
  • the control terminal 110 is the device shown in FIG. 2 in an exemplary embodiment.
  • the method for interacting the virtual environment with the physical hardware includes at least the following steps.
  • step 310 the control terminal performs loading of the role associated with the physical hardware in the virtual environment, and the physical hardware accesses the virtual environment through association with the role.
  • the physical hardware is a physical hardware that can be controlled by a program, for example, a combination of various components such as a sensor, a display screen, a motor, and the like, and the physical hardware can implement the action execution through program control.
  • the virtual environment is built by a program running on the terminal device, and the user will realize the interaction between the user and the virtual environment by manipulating the various roles in the virtual environment.
  • the physical hardware exists outside the virtual environment and will exist in the virtual environment in the form of roles.
  • the definition of the role associated with the physical hardware is performed in advance, and specifically, the display style of the character in the virtual environment and the actions that can be performed are defined.
  • the resource file configuration required for a character to load a virtual environment will be used to define the display style of the character in the virtual environment.
  • the relationship between the role and the hardware of the object in the virtual environment including the external change of the role in the virtual environment by the user's operation, generates a change in its own action, and then drives the physical hardware to execute.
  • Certain actions including physical hardware perception of external changes, are passed to the characters in the virtual environment, which in turn causes the role to be affected and perform certain actions.
  • sensors assembled in physical hardware sense external changes, such as changes in temperature, light, etc., and then transmit relevant information to the main control module that they have, and the main control module feeds back to the associated role in the virtual environment.
  • the physical hardware is a motor and a combination of various components. After a user operation is performed on the associated role in the virtual environment, the physical hardware can be executed by the motor under the control action of the character on the physical hardware. Mechanical movement.
  • the physical hardware will access the virtual environment through the role loaded in the virtual environment, and thus the mutual control between the physical hardware and the virtual environment can be achieved.
  • step 330 attribute configuration is performed on the character and the physical hardware to obtain attribute state information after the attribute configuration, and the attribute state information corresponds to the role and the physical hardware, respectively.
  • each of the program control information is corresponding to the attribute status information.
  • the attribute status information indicates the variables required to implement program control and the assignment of variables.
  • the attributes are configured for the role and the physical hardware, and the attribute status information corresponding to the role and the attribute status information corresponding to the physical hardware are obtained.
  • attribute status information corresponding to the role and the physical hardware because of the relationship between the role and the physical hardware, the attribute status information corresponding to the role and the attribute status information corresponding to the physical hardware There is also a correlation between them. That is to say, the change of one attribute status information will lead to the change of the attribute status information of the other party, so that the interaction between the role and the physical hardware can be made.
  • step 350 synchronous storage of attribute state information is performed between the character and the physical hardware.
  • the role has its corresponding attribute state information
  • the physical hardware also has its corresponding attribute state information. So far, the attribute state information corresponding to each of the roles and the physical hardware will be synchronized. All attribute state information obtained by performing attribute configuration is shared by the role and physical hardware.
  • Sharing that is, when either one of the role and the physical hardware is applied with an external change, the attribute state information of the synchronous storage is synchronously updated, and the party that has not applied the external change responds to the external change by the synchronous update.
  • Synchronously stored attribute status information will also be updated synchronously as subsequent physical changes to the physical hardware and roles are perceived.
  • the external change is applied to any one of the character and the physical hardware, and the external change referred to may be a user's operation or a perceived environment, for example, a virtual environment or a change in the environment in the physical world. It can also be a change caused by the input of external information, and will not be enumerated here.
  • the roles in the virtual environment and the physical hardware are in the same world, which opens up the communication difficulties between the roles and the physical hardware, and so on, so that the roles and physical hardware can communicate with each other.
  • the programming logic can be completed in an intuitive manner, and the threshold of programming is reduced as much as possible, and the non-professional development is eliminated. Users can even complete it even for school-age children.
  • FIG. 4 is a flowchart of a method for interacting a virtual environment with physical hardware, according to another exemplary embodiment. After the step 350, the method for interacting the virtual environment with the physical hardware further includes the following steps.
  • step 410 receiving an external change applied by either of the character and the physical hardware, performing a modification operation of the corresponding attribute state information in response to the external change, and obtaining the changed attribute state information.
  • the modification operation includes the modification of the attribute state information and the addition, deletion, and the modification operation is an operation of changing the attribute state information originally existing.
  • the attribute state information stored by the party to which the external change is applied is triggered to modify the operation, and the attribute state information stored by itself is modified to the new attribute state information corresponding to the external change, which is the party to which the external change is applied.
  • the party to which the external change is applied will also perform a corresponding action as the attribute state information corresponding to itself changes, for example, including the party to which the external change is not applied. Control action.
  • a touch operation is triggered on a role in a virtual environment.
  • the attribute status information corresponding to the attribute is triggered to be modified, so that the attribute status information corresponding to the role changes, and as the change occurs, the role is also caused.
  • a dynamic display of the response touch operation is performed in the virtual environment, and the changed attribute status information is also synchronized to the physical hardware.
  • step 430 the changed attribute state information is synchronized between the character and the physical hardware.
  • the attribute status information exists because the party that has not applied the external change exists. Synchronize the changed attribute status information to ensure the accuracy of the information between the two and the timeliness of sharing.
  • step 450 the party that does not impose an external change in both the character and the physical hardware is controlled to respond to the external change based on the synchronized attribute state information.
  • the party who does not apply the external change will perceive the attribute state change caused by the applied external change to the party to which the external change is applied, and the change will drive the external application not to be applied.
  • the changing party responds to external changes by performing certain actions due to the correlation between the two.
  • the party that has not applied the external change after obtaining the attribute status information of the synchronous update, will change the attribute status information corresponding to itself, and the changed attribute status information will control or drive the party that has not applied the external change. Respond by specifying the execution of the action.
  • the physical hardware and the role can be in the same operating environment, that is, the physical hardware and the program control in the role can be implemented together. Programming, no longer need to be based on the role and physical hardware programming, and then no longer need to solve the communication between the two, at the user level, will enable users to freely interact between the role and physical hardware.
  • FIG. 5 is a flow chart depicting the details of step 310, illustrated in accordance with the corresponding embodiment of FIG.
  • the step 310, as shown in FIG. 5, includes at least the following steps.
  • step 311 the loading and rendering of the character in the virtual environment is performed by the configuration file corresponding to the character, and the graphic display of the character in the virtual environment is obtained.
  • the configuration file corresponding to the role is used to define and describe the display style of the character and the actions that can be performed.
  • a role associated with physical hardware in addition to defining and describing the display style of the character in the virtual environment, and performing various visual actions in the virtual environment, also defining control actions on the physical hardware, and A responsive action performed on an external change applied to the physical hardware.
  • the configuration file includes resource files and attribute status information
  • the resource file is related to the display style of the character in the virtual environment
  • the attribute status information is related to actions that the role can perform.
  • the role associated with the physical hardware can be loaded into the virtual environment through the defined configuration file, and the display is displayed in the virtual environment to obtain the graphic display of the character in the virtual environment.
  • step 313 the physical hardware associated with the control role creates a process to which the user belongs, and establishes a connection between the created hardware process and the virtual environment main process to which the role belongs, so that the physical hardware accesses the virtual environment.
  • the virtual environment is built at the beginning to create a virtual environment main process for this purpose, through the virtual environment main process to achieve the implementation of the virtual environment related program control.
  • the control of the action triggered by the role may be implemented by creating a thread, that is, adopting the virtual environment main process. Multi-threaded mode.
  • the access of the physical hardware in the virtual environment enables the communication between the physical hardware and the associated role in the virtual environment to be performed by the hardware process and the virtual environment main process.
  • the corresponding thread is directly connected to the associated role through the corresponding thread.
  • the multi-threaded mode ensures that the actions triggered by various roles in the virtual environment are concurrently executed, and the linkage between the physical hardware and the associated roles is also optimized.
  • the associated role is affected by external changes and is triggered to perform a physical hardware control action
  • the control action since the control action is predefined by the associated role, there is a corresponding thread, and at this time, only the role of the corresponding thread is required.
  • the attribute state information corresponding to the control action is generated, and the thread transfers the attribute state information to the virtual environment main thread, and then transfers the physical state hardware to the physical hardware through the connection between the virtual environment main process and the hardware process, so that the dynamically changed attribute state information is synchronized.
  • the physical hardware under the control of the synchronized attribute state information, the physical hardware is driven to perform the specified action. At this point, the execution of the control action is also completed for the associated role.
  • the interaction between the character and the physical environment can be directly and smoothly performed, and the role and physicality of the user-owned physical hardware can be loaded in the virtual environment.
  • the loading of the associated role in the virtual environment so that the role associated with the physical hardware can be rendered and displayed in the virtual environment, and in the implementation of the process, the configuration of the action performed by the character is also included.
  • the loading of the role associated with the physical hardware is an extended implementation in the virtual environment.
  • the program control related to the role will trigger the configuration of the action block.
  • the process is implemented, that is, the configuration of the action performed by the character is realized through the configuration of the action block.
  • the action block is a graphic existence form corresponding to one or several pieces of code information controlled by a program related to the character, and the action block maps the code information.
  • the code logic is formed by the action block and the stitching relationship between the action blocks.
  • Each character has several action blocks available to it, for example, it can be displayed in a toolbar corresponding to the virtual environment. The role that the user can freely load into the virtual environment for the physical hardware he owns configures the action block according to the control needs.
  • the code logic that needs to perform the action is formed, and then the control of the role in the virtual environment can be realized, thereby further controlling the physical hardware by the character, and vice versa, the physical hardware can also reversely control the virtual environment.
  • the role that is, the code logic that responds to the physical hardware is deployed for this role through the configuration of the action block.
  • a corresponding thread is created for the action block, and the execution of the code logic mapped by the action block is implemented by the created thread control role.
  • the corresponding code logic can be realized through the configuration of the action block, and the graphical programming can be implemented for the user, and the user can perform the graphicization at the same time.
  • FIG. 6 is a flow diagram depicting the details of step 350, illustrated in accordance with the corresponding embodiment of FIG.
  • the step 350, as shown in FIG. 6, includes at least the following steps.
  • step 351 the process is triggered according to the attribute state information, and the attribute state information obtained by configuring the attribute is created to the virtual environment main process to which the role belongs, and the attribute is obtained by configuring the physical hardware.
  • the attribute status information is created to the hardware process to which the physical hardware belongs.
  • both the role in the virtual environment and the physical hardware have their own processes.
  • the roles in the virtual environment belong to the main process of the virtual environment, while the physical hardware belongs to the hardware process.
  • the roles and physical hardware are respectively configured with attributes, so as to obtain the attribute status information carrying the required variables and the assignment of the variables.
  • the configuration of the variable including the declaration of the variable, the modification of the variable, of course, for the modification of the variable, on the one hand, the modification of the original variable, on the other hand, the implementation of the new variable.
  • the corresponding attribute status information does not exist for the role and physical hardware. You need to configure this. Therefore, the configured attribute status information will be created.
  • the storage address of the attribute state information in the memory space may be allocated by way of hash assignment, and after the assignment of the presence address is completed, the attribute state information is stored.
  • variable name carried by the attribute state information is hashed to be indexed according to the variable name to the corresponding storage address in the memory space, and after the corresponding storage address is found, the write operation can be performed, and the attribute state information is written. .
  • step 353 the attribute state information between the role and the process to which the physical hardware belongs is synchronized with each other, and the virtual environment main process to which the role belongs and the hardware process to which the physical hardware belongs share the attribute state information.
  • the written attribute state information can be synchronized.
  • the synchronization of the written attribute status information may be implemented by broadcasting between processes. That is to say, after the completion of the writing of the attribute state information, the broadcast between the processes can be performed, so that other processes can be synchronized to the attribute state information, thereby realizing the sharing of the attribute state information between all processes, which facilitates the process.
  • FIG. 7 is a flow diagram depicting the details of step 430, illustrated in accordance with the corresponding embodiment of FIG. This step 430, as shown in FIG. 7, includes at least the following steps.
  • step 431 the changed attribute state information is updated for the belonging process at the side to which the external change is applied.
  • the built virtual environment has been loaded with the role associated with the physical hardware, and the physical hardware is also connected to the virtual environment. At this time, the role of the virtual environment and any physical hardware can be performed. External changes are applied.
  • the belonging process When the physical hardware or the associated role senses an external change, the belonging process causes a modification operation of the attribute state information to be triggered in the mapped memory space.
  • the storage address may also be located according to the variable name that is applied, and the storage address is the address to which the attribute status information triggering the modification operation is written, and will be stored at the storage address. Perform a modification operation on the attribute status information written.
  • step 433 the changed attribute state information is synchronized from the party to which the external change is applied to the process to which the party to which the external change is not applied.
  • the change of attribute state information in other processes is realized by communication between processes.
  • the communication between the indicated processes may be the execution of a broadcast communication.
  • the attribute state information can be shared between processes, and the realization of communication and the interaction between the character and the physical hardware can be implemented with lower difficulty, thereby avoiding the complexity of data processing.
  • the exemplary embodiments as described above it is possible to enable a user, even a younger user, such as a child, to programmatically interoperate itself with a character in a virtual environment, and interact with physical hardware, desired roles and physical hardware.
  • the implemented actions can be implemented by the quick configuration performed by the user. For example, when the physical hardware is turned on, the associated role in the virtual environment outputs the specified voice. When the physical hardware is turned off, the associated role in the virtual environment enters. Sleep state.
  • the state of the virtual environment changes, for example, the character that the user manipulates the physical hardware association succeeds in the game of the game, the physical hardware flashes and plays the music.
  • the physical hardware senses that the external temperature is decreasing, its associated role in the virtual environment will control events such as snowing.
  • Physical hardware also accepts speech so that its associated characters in the virtual environment convert speech into text.
  • the following takes a physical hardware as an example and combines a specific scenario to describe the interaction process between the virtual environment and the physical hardware.
  • FIG. 8 is a simplified schematic diagram illustrating the presence of attribute status information at an active layer, in accordance with an exemplary embodiment.
  • the attribute status information will exist as a global attribute, that is, the difference between the cross-process, the cross-physical entity, the user, the role, and the physical hardware will no longer exist, thereby causing the three
  • the interaction is transparent to the user, and the user, role, and physical hardware are in the same world.
  • FIG. 9 is a timing diagram showing interaction between a user, a character, and physical hardware, according to an exemplary embodiment. It should be further emphasized that the role referred to here is the associated role of physical hardware. The user builds a virtual environment, loads the role into the virtual environment, and configures the attributes of the roles and physical hardware.
  • users can also manipulate characters or physical hardware.
  • the user After the roles associated with the physical hardware are loaded into the virtual environment, as shown in FIG. 9, the user performs the attribute configuration of the role and the physical hardware, that is, creates attribute status information for the role, and also creates attribute status information for the physical hardware.
  • step 520 is performed such that the changed attribute status information is synchronized to the physical hardware.
  • step 540 is performed to perform corresponding synchronization to the character.
  • the physical hardware or role will perceive and respond to the user's interaction with the character or physical hardware, as shown in steps 550 through 560, and as shown in steps 570 through 580.
  • the attribute status information is not only consistent in different program control, but also consistent across physical entities, it can automatically maintain the connection synchronization process, simplify the code implementation in programming, and enhance the linkage between roles and physical hardware.
  • the status panel, remote control and console of the physical hardware can be realized simply and quickly through the virtual environment.
  • FIG. 10 is a block diagram showing an interaction device between a virtual environment and physical hardware, according to an exemplary embodiment.
  • the interaction device between the virtual environment and the physical hardware includes at least: a loading module 610, a configuration module 630, and a synchronization storage module 650.
  • the loading module 610 is configured to perform loading of a role associated with physical hardware in the virtual environment, and the physical hardware accesses the virtual environment through association with the role.
  • the configuration module 630 is configured to perform attribute configuration on the role and the physical to obtain attribute status information after the attribute is configured, and the attribute status information corresponds to the role and the physical hardware, respectively.
  • the synchronous storage module 650 is configured to perform synchronous storage of attribute state information between the character and the physical hardware.
  • the synchronously stored attribute state information is synchronously updated, and the party that has not applied the external change responds to the external change by the synchronous update.
  • FIG. 11 is a block diagram showing an interaction device between a virtual environment and physical hardware, according to another exemplary embodiment.
  • the interaction device between the virtual environment and the physical hardware as shown in FIG. 11, further includes: a change awareness module 710, a change synchronization module 730, and a response control module 750.
  • the change awareness module 710 is configured to receive an external change applied by either one of the character and the physical hardware, and perform a modification operation of the corresponding attribute state information in response to the external change to obtain the changed attribute state information.
  • a change synchronization module 730 is configured to synchronize the changed attribute state information between the character and the physical hardware.
  • the response control module 750 is configured to respond to external changes in a party that does not impose an external change in both the control role and the physical hardware based on the synchronized attribute state.
  • FIG. 12 is a block diagram depicting the details of a load module, shown in accordance with the corresponding embodiment of Figure 10.
  • the loading module 610 includes at least: a loading rendering unit 611 and an attribute creating unit 613.
  • the loading and rendering unit 611 is configured to perform loading and rendering of characters in the virtual environment through a configuration file corresponding to the character, and obtain a graphic display of the character in the virtual environment.
  • the attribute creation unit 613 is configured to control the physical hardware associated with the role to create a process to which the role belongs, and establish a connection between the created hardware process and the virtual environment main process to which the role belongs, so that the physical hardware accesses the virtual environment.
  • the disclosure further provides an interaction device between the virtual environment and the physical hardware, where the interaction between the virtual environment and the physical hardware may be performed in any of the foregoing implementation environments, and FIG. 2, FIG. 3, FIG. 4, and FIG. All or part of the steps of the interaction between the virtual environment and the physical hardware shown.
  • the device includes:
  • a memory configured to store processor executable instructions
  • processor configured to execute:
  • the attribute state information of the synchronous storage is synchronously updated according to an external change applied by either one of the character and the physical hardware, and the party not applying the external change responds to the external change.
  • a storage medium is also provided, which is a computer readable storage medium, such as a temporary and non-transitory computer readable storage medium including instructions.
  • the storage medium includes, for example, a memory 204 of instructions that are executable by processor 218 of apparatus 200 to perform the methods described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种实现虚拟环境与物理硬件的交互方法、装置和计算机可读存储介质。所述方法包括：控制端进行虚拟环境中物理硬件关联角色的加载，物理硬件通过与角色的关联接入虚拟环境；对角色和物理硬件进行属性配置，以获得属性配置后的属性状态信息；在角色和物理硬件之间进行属性状态信息的同步存储；当角色和物理硬件二者任一方被施加外部变化时，进行属性状态信息的同步更新，使得未施加所述外部变化的一方响应外部变化。由于所涉及的角色和物理硬件二者之间共享属性状态信息，使得物理硬件的程序控制不再需要单独编程，物理硬件和虚拟环境同处于一个世界，故使得物理硬件和角色之间能够天然通信，低门槛的自定义实现虚拟环境与物理硬件的交互。

Description

虚拟环境与物理硬件的交互方法、装置和存储介质
本公开要求申请日为2017年11月13日、申请号为2017111174674、发明创造名称为《虚拟环境与物理硬件的交互方法、装置和存储介质》的发明专利申请的优先权。
技术领域
本公开涉及计算机应用技术领域，特别涉及一种虚拟环境与物理硬件的交互方法、装置和计算机可读存储介质。
背景技术
随着计算机应用的不断发展，在所实现的应用程序中，除了为用户提供各种功能的实现之外，还能够为用户实现虚拟环境，以供用户进行虚拟环境中角色的操控。例如，此虚拟环境，可以是用户进入的对局游戏，所操控的角色即为对局游戏中的虚拟角色。
现有虚拟环境的构建，是在应用程序发布之前便已经开发完成，并且所能够实现的交互也仅限于虚拟环境中的角色之间。
一方面，无法自定义的实现虚拟环境中角色的配置，另一方面，如若需要经由虚拟环境中角色实现与物理硬件之间的交互，则在开发构建此虚拟环境的同时，不得不针对于物理硬件而单独开发编程，即虚拟环境的实现和与虚拟环境交互的物理硬件所涉及的程序控制，是分别编程实现的且需要在此基础上处理复杂的通信问题，实现门槛高。
也就是说，现有的虚拟环境与物理硬件之间的交互，存在着无法自定义配置角色和物理硬件，实现门槛高的局限性。
发明内容
为了解决相关技术中虚拟环境与物理硬件之间的交互无法自定义配置角色和物理硬件，且实现门槛高的技术问题，本公开提供一种实现虚拟环境与物理硬件的交互方法、装置和计算机可读存储介质。
一种虚拟环境与物理硬件的交互方法，所述方法包括：
进行虚拟环境中物理硬件所关联角色的加载，所述物理硬件通过与所述角色的关联接入所述虚拟环境；
对所述角色和所述物理硬件进行属性配置，以获得所述属性配置后的属性状态信息，所述属性状态信息分别对应于所述角色和所述物理硬件；
在所述角色和所述物理硬件之间进行所述属性状态信息的同步存储；
其中，当所述角色和所述物理硬件二者任一方被施加外部变化时，同步存储的所述属性状态信息进行得到同步更新，通过所述同步更新使得未施加所述外部变化的一方响应所述外部变化。
一种虚拟环境与物理硬件的交互装置，所述装置包括：
加载模块，配置为进行虚拟环境中物理硬件所关联角色的加载，所述物理硬件通过与所述角色的关联接入所述虚拟环境；
配置模块，配置为对所述角色和所述物理硬件进行属性配置，以获得所述属性配置后的属性状态信息，所述属性状态信息分别对应于所述角色和所述物理硬件；
同步存储模块，配置为在所述角色和所述物理硬件之间进行所述属性状态信息的同步存储；
其中，当所述角色和所述物理硬件二者任一方被施加外部变化时，同步存储的所述属性状态信息进行同步更新，通过所述同步更新使得未施加所述外部变化的一方响应所述外部变化。
一种虚拟环境与物理硬件的交互装置，包括：
处理器；以及
存储器，所述存储器上存储有计算机可读指令，所述计算机可读指令被所述处理器执行时实现如前所述的虚拟环境与物理硬件的交互方法。
一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如前所述的虚拟环境与物理硬件的交互方法。
本公开的实施例提供的技术方案可以包括以下有益效果：
针对于自定义实现虚拟环境交互的物理硬件，以及此物理硬件在虚拟环境所融入的角色，将首先对虚拟环境中物理硬件所关联角色，即物理硬件在虚拟环境中融入的角色，执行加载，使物理硬件通过与角色的关联而得以接入虚拟环境，然后对角色和物理硬件进行属性配置，以获得属性配置后分别对应于角色和物理硬件的属性状态信息，最后在角色和物理硬件之间进行属性状态信息的同步存储，由此即可在同步存储的属性状态信息作用下，当角色和物理硬件中任意一方被施加外部变化造成属性状态信息变化，另一方面则被同步此变化，进而响应所施加的外部变化，因此实现了虚拟环境与物理硬件之间的交互，并且由于所涉及的角色和物理硬件二者之间是共享属性状态信息的，使得物理硬件的程序控制不再需要单独编程，物理硬件和虚拟环境同处于一个世界，故使得物理硬件和角色之间能够天然通信，从而低门槛的自定义实现虚拟环境与物理硬件的交互。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性的，并不能限制本公开。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例， 并于说明书一起用于解释本公开的原理。
图1根据一示例性实施例示出的本公开所涉及实施环境的示意图；
图2是根据一示例性实施例示出的一种装置的框图；
图3是根据一示例性实施例示出的一种虚拟环境与物理硬件的交互方法的流程图；
图4是根据另一示例性实施例示出的一种虚拟环境与物理硬件的交互方法的流程图；
图5是根据图3对应实施例示出的对步骤310的细节进行描述的流程图；
图6是根据图3对应实施例示出的对步骤350的细节进行描述的流程图；
图7是根据图4对应实施例示出的对步骤430的细节进行描述的流程图；
图8是根据一示例性实施例在作用层面对属性状态信息进行阐述的简要示意图；
图9是根据一示例性实施例示出的用户、角色和物理硬件三者之间交互的时序图；
图10是根据一示例性实施例示出的一种虚拟环境与物理硬件的交互装置的框图；
图11是根据另一示例性实施例示出的一种虚拟环境与物理硬件的交互装置的框图；
图12是根据图10对应实施例示出的对加载模块的细节进行描述的框图。
具体实施方式
这里将详细地对示例性实施例执行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。
图1是根据一示例性实施例示出的本公开所涉及实施环境的示意图。本公开所涉及的实施环境，包括控制端110以及物理硬件130。
控制端110用于实现虚拟环境以及虚拟环境所相关的控制逻辑。控制端110可以是电脑终端、智能手机、平板电脑等终端设备中的至少一种。物理硬件130是脱离于控制端110存在于物理世界中的实体硬件，例如，可以是传感器等各种电子元器件，也可以是装配了各种传感器并由一定形状壳体封装的小车，任一配备了通信连接接口(如，WiFi通信连接接口)的硬件设备。
物理硬件130作为物理世界中真实存在的实体硬件，将接入到控制端110所构建的虚拟环境中，一方面，能够通过虚拟环境中施加的外部变化，例如对角色的操控，而使得物理硬件130感知并响应；另一方面，也能够对物理硬件施加外部变化，至此而使得虚拟环境中的角色感知并响应。
也就是说，在此实施环境中，将实现了虚拟环境和物理硬件二者之间双向的交互，能够借由虚拟环境中的角色操控物理硬件，也能够由物理硬件操控虚拟环境中的角色。
在此应当说明的是，控制端110是唯一存在的，而物理硬件130则可以是一个或者两个以上的，并且可以是单一种类或者多种种类的。
图2是根据一示例性实施例示出的一种装置的框图。例如，装置200可以是上述实施环境中的智能手机。
参照图2，装置200可以包括以下一个或多个组件：处理组件202，存储器204，电源组件206，多媒体组件208，音频组件210，传感器组件214以及通信组件216。
处理组件202通常控制装置200的整体操作，诸如与显示，电话呼叫，数据通信，相机操作以及记录操作相关联的操作等。处理组件202可以包括一个或多个处理器218来执行指令，以完成下述的方法的全部或部分步骤。此外，处理组件202可以包括一个或多个模块，便于处理组件202和其他组件之间的交互。例如，处理组件202可以包括多媒体模块，以方便多媒体组件208和处理组件202之间的交互。
存储器204被配置为存储各种类型的数据以支持在装置200的操作。这些数据的示例包括用于在装置200上操作的任何应用程序或方法的指令。存储器204可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(Static Random Access Memory，简称SRAM)，电可擦除可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，简称EEPROM)，可擦除可编程只读存储器(Erasable Programmable Read Only Memory，简称EPROM)，可编程只读存储器(Programmable Red-Only Memory，简称PROM)，只读存储器(Read-Only Memory，简称ROM)，磁存储器，快闪存储器，磁盘或光盘。存储器204中还存储有一个或多个模块，该一个或多个模块被配置成由该一个或多个处理器218执行，以完成下述图2、图3、图4和图5任一所示方法中的全部或者部分步骤。
电源组件206为装置200的各种组件提供电力。电源组件206可以包括电源管理系统，一个或多个电源，及其他与为装置200生成、管理和分配电力相关联的组件。
多媒体组件208包括在所述装置200和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(Liquid Crystal Display，简称LCD)和触摸面板。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。屏幕还可以包括有机电致发光显示器(Organic Light Emitting Display，简称OLED)。
音频组件210被配置为输出和/或输入音频信号。例如，音频组件210包括一个麦克风(Microphone，简称MIC)，当装置200处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器204或经由通信组件216发送。在一些实施例中，音频组件210还包括一个扬声器，用于输出音频信号。
传感器组件214包括一个或多个传感器，用于为装置200提供各个方面的状态评估。例如，传感器组件214可以检测到装置200的打开/关闭状态，组件的相对定位，传感器 组件214还可以检测装置200或装置200一个组件的位置改变以及装置200的温度变化。在一些实施例中，该传感器组件214还可以包括磁传感器，压力传感器或温度传感器。
通信组件216被配置为便于装置200和其他设备之间有线或无线方式的通信。装置200可以接入基于通信标准的无线网络，如WiFi(WIreless-Fidelity，无线保真)。在一个示例性实施例中，通信组件216经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信组件216还包括近场通信(Near Field Communication，简称NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(Radio Frequency Identification，简称RFID)技术，红外数据协会(Infrared Data Association，简称IrDA)技术，超宽带(Ultra Wideband，简称UWB)技术，蓝牙技术和其他技术来实现。
在示例性实施例中，装置200可以被一个或多个应用专用集成电路(Application Specific Integrated Circuit，简称ASIC)、数字信号处理器、数字信号处理设备、可编程逻辑器件、现场可编程门阵列、控制器、微控制器、微处理器或其他电子元件实现，用于执行下述方法。
图3是根据一示例性实施例示出的一种虚拟环境与物理硬件的交互方法的流程图。该虚拟环境与物理硬件的交互方法，适用于图1所示实施环境所指的控制端110，该控制端110在一个示例性实施例中是图2所示的装置。如图3所示，该虚拟环境与物理硬件的交互方法，至少包括以下步骤。
在步骤310中，控制端进行虚拟环境中物理硬件所关联角色的加载，物理硬件通过与角色的关联接入虚拟环境。
其中，物理硬件是可进行程序控制的实体硬件，例如，传感器、显示屏、马达等各种零部件的组合，物理硬件能够通过程序控制实现动作执行。虚拟环境是由运行于终端设备的程序构建的，用户将通过对虚拟环境中各种角色的操控而实现用户与虚拟环境之间的交互。物理硬件存在于虚拟环境外部，将以角色的形式存在于虚拟环境中。
也就是说，预先进行了物理硬件所关联角色的定义，具体而言，将定义角色在虚拟环境中的显示样式以及所能够执行的动作。例如，角色载入虚拟环境所需要的资源文件配置，将用于定义角色在虚拟环境中的显示样式。
应当理解，所加载至虚拟环境中的角色，是与物理硬件相关联的，因此，其在虚拟环境中所能够执行的动作，也与虚拟环境存在着关联性。
应当说明进一步说明的是，虚拟环境中角色与物联硬件之间的关联性，包括虚拟环境中角色被用户的操作等外部变化作用于其上，产生自身动作变化，进而带动物理硬件响应而执行一定的动作，也包括物理硬件感知到外部变化，而传递至虚拟环境中的角色，进而使得此角色受到影响而执行一定的动作。
例如，物理硬件中装配的传感器感知到外部变化，例如，温度、光线等的变化，便将 相关的信息传送至自身具备的主控模块，由主控模块向虚拟环境中关联的角色反馈，进而使关联的角色响应所感知的外部变化。
又例如，物理硬件是马达以及各种零部件的组合，在对虚拟环境中关联角色施加用户操作之后，即可在角色对物理硬件的控制动作下使得物理硬件在自身马达的驱动下执行各种机械运动。
因此，物理硬件将通过虚拟环境中加载的角色而接入虚拟环境，至此便可通过物理硬件和虚拟环境二者之间的通信而实现二者之间的相互控制。
在步骤330中，对角色和物理硬件进行属性配置，以获得属性配置后的属性状态信息，属性状态信息分别对应于角色和物理硬件。
其中，无论是物理硬件还是其所关联的角色，在所进行的程序控制中分别有各自所对应的属性状态信息。属性状态信息指示了实现程序控制所需要的变量以及变量的赋值。
分别为角色和物理硬件进行属性配置，进而得到角色所对应的属性状态信息以及物理硬件所对应的属性状态信息。
在此应当说明的是，对应于角色和物理硬件的属性状态信息，由于角色和物理硬件二者之间存在着关联性，因此，对应于角色的属性状态信息与对应于物理硬件的属性状态信息之间也存在着关联性。也就是说，一方属性状态信息的变化，将导致另一方属性状态信息的变化，以此方能够使得角色和物理硬件二者之间相互作用，互相联动。
在步骤350中，在角色和物理硬件之间进行属性状态信息的同步存储。
其中，如前所述的，角色有其对应的属性状态信息，并且物理硬件也有其所对应的属性状态信息，至此，将在角色和物理硬件二者之间同步各自所对应的属性状态信息，使得进行属性配置所获得的所有属性状态信息被角色和物理硬件共享。
共享，即当角色和物理硬件二者任一方被施加外部变化时，同步存储的属性状态信息进行同步更新，通过同步更新使得未施加外部变化的一方响应外部变化。
随着后续进行的物理硬件和角色所能够感知到的外部变化，同步存储的属性状态信息也将随之而获得同步更新。
具体而言，外部变化是施加于角色和物理硬件中的任意一方的，所指的外部变化，可以是用户的操作，也可以是感知到的环境，例如，虚拟环境或者物理世界中环境的变化，还可以是外部信息输入而引发的变化，在此不进行一一列举。
通过属性状态信息同步机制的实现，将使得虚拟环境中角色与物理硬件处于同一世界，打通了角色与物理硬件之间存在的通信困难等诸多不便，使得角色和物理硬件之间能够相互通信，进而对于角色控制的编程以及物理硬件控制的编程而言，由于不再需要考虑角色和物理硬件之间连通的障碍，能够以直觉的方式完成编程逻辑，尽可能的降低了编程的门槛，非专业开发的用户甚至于适龄儿童都能够完成。
图4是根据另一示例性实施例示出的一种虚拟环境与物理硬件的交互方法的流程图。 步骤350之后，该虚拟环境与物理硬件的交互方法，还包括以下步骤。
在步骤410中，接收角色和物理硬件二者任一方被施加的外部变化，响应外部变化执行对应属性状态信息的修改操作，获得变化的属性状态信息。
其中，在实现角色和物理硬件二者之间属性状态信息的共享之后，对于存在于虚拟环境中的角色，以及存在于物理世界中的物理硬件，都有被施加外部变化的可能性。任何一方，例如角色，或物理硬件被施加外部变化都将导致所对应属性状态信息的变化，即触发对应属性状态信息的修改操作，由此修改操作即可获得被施加外部变化的一方所对应变化的属性状态信息。
角色和物理硬件二者任一方被施加的外部变化，如前所述的，包括用户的操作，所在环境变化等由外部所引入的变化，将由此而触发所存储属性状态信息的修改操作。修改操作包括了属性状态信息的修改以及新增、删除，修改操作是使得原本所存在属性状态信息发生变化的操作。
应当理解，被施加外部变化的一方，所对应存储的属性状态信息被触发修改操作，将自身所存储属性状态信息修改为对应于外部变化的新属性状态信息，这是被施加外部变化的一方自身对外部变化的响应，在一个示例性实施例中，随着自身所对应属性状态信息的变化，被施加外部变化的一方还将执行相应的动作，例如，包括对未被施加外部变化的一方的控制动作。
例如，对虚拟环境中的角色触发触碰操作，此时，其所对应属性状态信息被相应触发修改操作，使得角色所对应属性状态信息发生变化，随着此变化的发生，也将使得角色在虚拟环境中进行响应触碰操作的动态显示，并且变化的属性状态信息也将被同步至物理硬件。
在步骤430中，将变化的属性状态信息在角色和物理硬件之间同步。
其中，虚拟环境中的角色和物理硬件二者，在任一方被施加外部变化而导致所对应属性状态信息发生变化时，由于未被施加外部变化的一方，也存在了此属性状态信息，因此，需将变化的属性状态信息同步，以保证二者之间信息的准确性以及共享的及时性。
在步骤450中，根据同步的属性状态信息控制角色和物理硬件二者中未施加外部变化的一方响应外部变化。
其中，随着发生变化的属性状态信息同步的进行，将使得未施加外部变化的一方感知到被施加外部变化的一方由所施加的外部变化而发生的属性状态变化，此变化将驱使未施加外部变化的一方由于二者之时的关联性而执行一定的动作，以此来响应外部变化。
如前所述的，对应于物理硬件和对应于所关联角色的属性状态信息，这两类属性状态信息之间也相应存在着关联性。因此，未施加外部变化的一方在获得同步更新的属性状态信息之后，自身所对应的属性状态信息也随之会发生变化，随之发生变化的属性状态信息将控制或者驱使未施加外部变化的一方通过指定动作的执行而进行响应。
通过此示例性实施例，由于物理硬件和所关联角色之间属性状态信息同步机制的引入， 使得物理硬件和角色能够处于相同运行环境，也就是说，可以一并实现物理硬件和角色中程序控制的编程，不再需要分别基于角色和物理硬件编程，进而必然也不再需要解决二者之间通信的实现，在用户层面，将使得用户能够随意实现角色和物理硬件之间的交互。
图5是根据图3对应实施例示出的对步骤310的细节进行描述的流程图。该步骤310，如图5所示，至少包括以下步骤。
在步骤311中，通过对应于角色的配置文件进行虚拟环境中角色的加载和渲染，获得角色在虚拟环境中的图形显示。
其中，对应于角色的配置文件，用于定义并描述角色的显示样式以及所能够执行的动作。例如，关联于物理硬件的角色，其配置文件除了定义并描述角色在虚拟环境中的显示样式，和在虚拟环境执行各种可视的动作之外，还定义了对物理硬件的控制动作，以及对物理硬件被施加的外部变化而执行的响应动作。
也就是说，配置文件包括资源文件和属性状态信息，资源文件与角色在虚拟环境中的显示样式相关，属性状态信息则与角色所能够执行的动作相关。
因此，关联于物理硬件的角色，通过被定义生成的配置文件，即可加载至虚拟环境中，在此虚拟环境中渲染显示，获得角色在虚拟环境中的图形显示。
在步骤313中，控制角色所关联物理硬件创建自身归属的进程，并将创建的硬件进程与角色归属的虚拟环境主进程建立连接，使得物理硬件接入虚拟环境。
其中，应当说明的是，虚拟环境构建显示之初便为此而创建了虚拟环境主进程，通过虚拟环境主进程而实现虚拟环境所相关程序控制的执行。在一个示例性实施例的，在虚拟环境所相关程序控制的执行中，对于所产生的任务，例如一角色所触发动作的控制，可通过创建线程的形式实现，即在虚拟环境主进程下采用多线程的模式。
随着物理硬件所关联角色在虚拟环境中的加载，将在虚拟环境主进程下为此角色所触发动作创建相应的线程；而对于所连接的物理硬件，将控制其创建进程，即硬件进程，并建立硬件进程和虚拟环境主进程之间的连接，此时，便使得物理硬件是接入虚拟环境的。
物理硬件在虚拟环境中的接入，使得物理硬件和虚拟环境中关联角色的通信，是通过硬件进程和虚拟环境主进程进行的，在此基础上再经由相应的线程直连至关联角色，通过多线程模式保证虚拟环境中各种角色所触发动作被并发执行的同时，也优化了物理硬件和所关联角色之间的联动性。
例如，对于关联角色受到外部变化的影响被触发执行一物理硬件的控制动作而言，由于此控制动作是关联角色预先定义的，故存在着相应的线程，此时，只需在相应线程的作用下生成此控制动作对应的属性状态信息，线程将属性状态信息传送至虚拟环境主线程，进而通过虚拟环境主进程与硬件进程之间的连接传送至物理硬件，使得动态变化的属性状态信息被同步至物理硬件，在所同步的属性状态信息控制下驱使物理硬件执行指定动作，至此，对于所关联角色而言，便也完成了其控制动作的执行。
通过此示例性实施例，便使得角色和物理环境之间的交互能够直接、顺畅的进行，在为用户所拥有物理硬件自由实现所关联角色在虚拟环境中载入的同时，也为角色和物理硬件之间的相互控制，相互联动奠定了基础。
进一步的，对于所关联角色在虚拟环境中的加载，进而使得物理硬件所关联角色能够渲染显示于虚拟环境中，在此过程的实现中，还包括了角色所执行动作的配置。
相对于虚拟角色，物理硬件所关联角色的加载是虚拟环境中的扩展实现，在使得虚拟环境被载入物理硬件所关联角色之后，此角色所相关的程序控制，将通过触发进行动作块的配置过程实现，即通过动作块的配置，而实现角色所执行动作的配置。
应当说明的是，动作块是角色所相关程序控制的一条或者几条代码信息所对应的图形存在形式，动作块映射了代码信息。通过动作块以及动作块之间的拼接关系而形成代码逻辑。每一角色都有其可用的若干动作块，例如，其可分类显示于虚拟环境所对应的工具栏中。用户可为所拥有物理硬件而自由加载至虚拟环境中的角色根据控制需要配置动作块。
通过动作块的配置，形成所需要执行动作的代码逻辑，进而即可实现虚拟环境中角色的控制，进而由此角色进一步实现物理硬件的控制，反之，亦可由物理硬件反向控制虚拟环境中的角色，也就是说，为此角色通过动作块的配置而部署了响应物理硬件的代码逻辑。
随着动作块被配置于角色上，将随之为此动作块创建相应的线程，通过所创建的线程控制角色实现动作块所映射代码逻辑的执行。
由此，对于角色的动作执行以及物理硬件的动作执行而言，都得以通过动作块的配置实现相应的代码逻辑，在为用户实现图形化编程的同时，也使得用户能够在所进行的图形化编程过程中根据自己的期望直观的完成编程，实现的难度非常低，并且能够为用户提供即时的控制效果，即一旦完成了动作块的拼接，即可直接进行角色的控制，甚至于物理硬件的控制。
图6是根据图3对应实施例示出的对步骤350的细节进行描述的流程图。该步骤350，如图6所示，至少包括以下步骤。
在步骤351中，根据属性状态信息被触发进行配置而关联的进程，将对角色进行属性配置而获得的属性状态信息创建至角色归属的虚拟环境主进程，将对物理硬件进行属性配置而获得的属性状态信息创建至物理硬件归属的硬件进程。
其中，如前所述的，无论是虚拟环境中的角色，还是物理硬件，都有其所归属的进程。虚拟环境中的角色，归属于虚拟环境主进程，而物理硬件则是归属于硬件进程的。
应当理解的，对于每一进程，都其所映射的内存空间，进程所执行程度控制中涉及的变量以及变量的赋值等，即属性状态信息，都被存放于进程所映射的内存空间。
在触发进行角色和物理硬件的属性配置中，分别对角色和物理硬件进行属性配置，以此来获得携带所需要变量以及变量的赋值的属性状态信息。变量的配置，包括变量的声明、变量的修改，当然对于变量的修改而言，一方面可以是对原有变量的修改，另一方面也可 以是新增变量的实现。
随着虚拟环境中物理硬件所关联角色的加载进入，此时对于角色和物理硬件而言，均未存在对应的属性状态信息，需要对此进行配置，因此，所配置的属性状态信息将被创建至所属进程映射的内存空间。
在一个示例性实施例中，对于属性状态信息在内存空间中的存储地址，可以通过哈希分派的方式分配，在完成了存在地址的分配之后，再将属性状态信息存入。
进一步的，对属性状态信息所携带的变量名称进行哈希分派，以根据变量名称索引到内存空间中对应的存储地址，在找到对应的存储地址之后即可执行写操作，将属性状态信息写入。
在步骤353中，进行角色和物理硬件所归属进程之间属性状态信息的相互同步，角色归属的虚拟环境主进程和物理硬件归属的硬件进程共享属性状态信息。
其中，在完成了所配置属性状态信息的写入之后，即可对写入的属性状态信息执行同步。
在一个示例性实施例中，所写入属性状态信息的同步可以通过进程之间广播的进行实现。也就是说，在完成属性状态信息的写入之后，即可进行进程之间的广播，以使得其它进程均能够同步到属性状态信息，进而实现所有进程之间属性状态信息的共享，方便了进程之间的通信和控制的实现效率。
由此，便得以实现了全局变量，由于其是跨进程实现的，因此也是通信全局变量，从变量作用域来看，实现了跨进程和跨物理实体，将能够最大限度的降低实现连接、状态维护和异步调度等的复杂度，也使得用户的逻辑在不同物理实体和应用程序上透明化，对于用户而言，角色和物理硬件的交互是通过同一环境下的代码逻辑实现的。
图7是根据图4对应实施例示出的对步骤430的细节进行描述的流程图。该步骤430，如图7所示，至少包括以下步骤。
在步骤431中，在外部变化被施加的一方，为所归属进程更新变化的属性状态信息。
其中，如前所述的，构建完成的虚拟环境已经进行了物理硬件所关联角色的加载，物理硬件也由此而接入虚拟环境，此时，可进行虚拟环境中角色以及物理硬件任意一方的外部变化施加。
在物理硬件或者所关联角色感知到外部变化时，所归属进程使在映射的内存空间中触发进行属性状态信息的修改操作。
在一个示例性实施例中，对于修改操作的触发，也可根据所作用的变量名称定位存储地址，此存储地址即为触发修改操作的属性状态信息被写入的地址，将在此存储地址上对写入的属性状态信息执行修改操作。
在步骤433中，将变化的属性状态信息由外部变化被施加的一方同步至未施加外部变化的一方所归属进程。
其中，通过进程之间的通信实现变化的属性状态信息在其它进程的同步。在一个示例性实施例中，所指的进程之间的通信，可以是广播通信的执行。
通过同步的方式，使得进程之间能够共享属性状态信息，进而对于通信的实现，以及角色和物理硬件之间的交互而言，方能够较低难度的实现，避免了数据处理上的复杂性。
通过如上所述的示例性实施例，将使得用户，甚至于低龄用户，例如儿童，也能够通过编程实现自身与虚拟环境中角色的互运算，以及与物理硬件的互动，所期望角色和物理硬件实现的动作，都可以通过自己所进行的快速配置实现，例如，在物理硬件被开启时，虚拟环境中关联的角色输出指定的语音，在物理硬件被关闭时，虚拟环境中关联的角色则进入睡眠状态。
又例如，在虚拟环境的状态发生改变时，例如，用户操控物理硬件关联的角色在对局游戏中成功闯关，则物理硬件会闪灯并播放音乐。
再例如，物理硬件感知到外部温度降低，则其在虚拟环境中关联的角色将控制实现下雪等事件。
物理硬件也可接受语音，使得其在虚拟环境中关联的角色将语音转换成文字。
以上，都可通过用户对虚拟环境中角色和物理硬件的自由配置快速实现，不需要花费大多的学习成本。
下面以一物理硬件为例，结合一具体场景来描述上述实现虚拟环境与物理硬件的交互过程。
图8是根据一示例性实施例在作用层面对属性状态信息进行阐述的简要示意图。如图8所示的，属性状态信息，将是作为全局属性存在的，即跨进程，跨物理实体，用户、角色以及物理硬件三者之间的差异将不复存在，进而使得三者之间的交互对于用户而言是透明的，用户、角色和物理硬件处于同一世界中。
图9是根据一示例性实施例示出的用户、角色和物理硬件三者之间交互的时序图。应当进一步强调的，在此所指的角色是物理硬件的关联角色。用户则构建虚拟环境，使得角色加载至虚拟环境，并进行角色和物理硬件的属性配置。
除此之外，用户也可进行角色或者物理硬件的操控。
在将物理硬件所关联角色加载至虚拟环境之后，如图9所示的，用户将进行角色和物理硬件的属性配置，即对角色创建属性状态信息，亦对物理硬件创建属性状态信息。
此时，如步骤510所示的，角色所对应属性状态信息被修改之后，便执行步骤520，使得变化的属性状态信息被同步至物理硬件。
又如步骤530所示的，在对物理硬件发生修改之后，随即执行步骤540，向角色进行相应的同步。
而对于用户对角色或者物理硬件所进行的交互而言，物理硬件或角色都将对此进行感知和响应，如步骤550至步骤560所示的，以及步骤570至步骤580所示的。
由于属性状态信息不但在不同程序控制中保持一致，在跨物理实体上仍然保持一致，因此能够自动维护连接同步过程，简化了编程中的代码实现，也增强了角色和物理硬件之间的联动性，对于用户而言，甚至能够简单快速的通过虚拟环境实现物理硬件的状态面板、遥控端和控制台等功能。
下述为本公开装置实施例，可以用于执行本公开上述实现虚拟环境与物理硬件的交互方法实施例。对于本公开装置实施例中未披露的细节，请参照本公开虚拟环境与物理硬件的交互方法实施例。
图10是根据一示例性实施例示出的一种虚拟环境与物理硬件的交互装置的框图。该虚拟环境与物理硬件的交互装置，如图10所示，至少包括：加载模块610、配置模块630和同步存储模块650。
加载模块610，配置为进行虚拟环境中物理硬件所关联角色的加载，物理硬件通过与角色的关联接入虚拟环境。
配置模块630，配置为对角色和物理进行属性配置，以获得属性配置后的属性状态信息，属性状态信息分别对应于角色和物理硬件。
同步存储模块650，配置为在角色和物理硬件之间进行属性状态信息的同步存储。
其中，当角色和物理硬件二者任一方被施加外部变化时，同步存储的属性状态信息进行同步更新，通过同步更新使得未施加外部变化的一方响应外部变化。
图11是根据另一示例性实施例示出的一种虚拟环境与物理硬件的交互装置的框图。该虚拟环境与物理硬件的交互装置，如图11所示，还包括：变化感知模块710、变化同步模块730和响应控制模块750。
变化感知模块710，配置为接收角色和物理硬件二者任一方被施加的外部变化，响应外部变化执行对应属性状态信息的修改操作，获得变化的属性状态信息。
变化同步模块730，配置为将变化的属性状态信息在角色和物理硬件之间同步。
响应控制模块750，配置为根据同步的属性状态停放控制角色和物理硬件二者中未施加外部变化的一方响应外部变化。
图12是根据图10对应实施例示出的对加载模块的细节进行描述的框图。该加载模块610，如图12所示，至少包括：加载渲染单元611和属性创建单元613。
加载渲染单元611，配置为通过对应于角色的配置文件进行虚拟环境中角色的加载和渲染，获得角色在虚拟环境中的图形显示。
属性创建单元613，配置为控制角色所关联物理硬件创建自身归属的进程，并将创建的硬件进程与角色归属的虚拟环境主进程建立连接，使得物理硬件接入虚拟环境。
可选的，本公开还提供一种虚拟环境与物理硬件的交互装置，该虚拟环境与物理硬件的交互装置可以前述所示实施环境中，执行图2、图3、图4和图5任一所示的虚拟环境与物理硬件的交互方法的全部或者部分步骤。所述装置包括：
处理器；
配置为存储处理器可执行指令的存储器；
其中，所述处理器被配置为执行：
进行虚拟环境中物理硬件所关联角色的加载，所述物理硬件通过与所述角色的关联接入所述虚拟环境；
触发进行所述角色和物理硬件的属性配置获得配置的属性状态信息，所述属性状态信息分别对应于所述角色和物理硬件；
在所述角色和物理硬件之间进行所述属性状态信息的同步存储；
其中，同步存储的所述属性状态信息根据角色和物理硬件二者任一方被施加的外部变化得到同步更新，未施加所述外部变化的一方响应所述外部变化。
该实施例中的装置的处理器执行操作的具体方式已经在有关该虚拟环境与物理硬件的交互方法的实施例中执行了详细描述，此处将不做详细阐述说明。
在示例性实施例中，还提供了一种存储介质，该存储介质为计算机可读存储介质，例如可以为包括指令的临时性和非临时性计算机可读存储介质。该存储介质例如包括指令的存储器204，上述指令可由装置200的处理器218执行以完成上述方法。
应当理解的是，本公开并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围执行各种修改和改变。本公开的范围仅由所附的权利要求来限制。

Claims (13)

  1. 一种虚拟环境与物理硬件的交互方法，所述方法包括：
    控制端进行虚拟环境中物理硬件所关联角色的加载，所述物理硬件通过与所述角色的关联接入所述虚拟环境；
    对所述角色和所述物理硬件进行属性配置，以获得所述属性配置后的属性状态信息，所述属性状态信息分别对应于所述角色和所述物理硬件；
    在所述角色和所述物理硬件之间进行所述属性状态信息的同步存储；
    其中，当所述角色和所述物理硬件二者任一方被施加外部变化时，同步存储的所述属性状态信息进行同步更新，通过所述同步更新使得未施加所述外部变化的一方响应所述外部变化。
  2. 根据权利要求1所述的方法，所述控制端是唯一存在的，所述物理硬件是一个或者两个以上的，并且两个以上的所述物理硬件是单一种类或多种种类的。
  3. 根据权利要求1所述的方法，其特征在于，所述在所述角色和所述物理硬件之间进行所述属性状态信息的同步存储之后，所述方法包括：
    接收所述角色和所述物理硬件二者任一方被施加的外部变化，响应所述外部变化执行对应属性状态信息的修改操作，获得变化的所述属性状态信息；
    将变化的所述属性状态信息在所述角色和所述物理硬件之间同步；
    根据同步的所述属性状态信息控制所述角色和物理硬件二者中未施加所述外部变化的一方响应所述外部变化。
  4. 根据权利要求1所述的方法，其特征在于，所述控制端进行虚拟环境中物理硬件所关联角色的加载，所述物理硬件通过与所述角色的关联接入所述虚拟环境，包括：
    通过对应于所述角色的配置文件进行所述虚拟环境中所述角色的加载和渲染，获得所述角色在所述虚拟环境中的图形显示；
    控制所述角色所关联物理硬件创建自身归属的进程，并将创建的硬件进程与所述角色归属的虚拟环境主进程建立连接，使得所述物理硬件接入所述虚拟环境。
  5. 根据权利要求4所述的方法，其特征在于，所述通过对应于所述角色的配置文件进行所述虚拟环境中所述角色的加载和渲染，获得所述角色在所述虚拟环境中的图形显示，包括：
    通过触发进行动作块的配置过程进行动作块以及动作块之间的拼接，形成所述虚拟环境中角色所执行动作的代码逻辑，其中所述动作块映射了代码信息，所述动作块的配置用 于控制所述虚拟环境中角色的控制，控制的所述角色相应控制所述物理硬件。
  6. 根据权利要求4所述的方法，其特征在于，所述在所述角色和所述物理硬件之间进行所述属性状态信息的同步存储，包括：
    根据所述属性状态信息被触发进行配置而关联的进程，将对角色进行属性配置而获得的属性状态信息创建至所述角色归属的虚拟环境主进程，将对物理硬件进行属性配置而获得的属性状态信息创建至所述物理硬件归属的硬件进程；
    进行所述角色和物理硬件所归属进程之间属性状态信息的相互同步，所述角色归属的虚拟环境主进程和所述物理硬件归属的硬件进程共享属性状态信息。
  7. 根据权利要求6所述的方法，其特征在于，所述进行所述角色和物理硬件所归属进程之间属性状态信息的相互同步，所述角色归属的虚拟环境主进程和所述物理硬件归属的硬件进程共享属性状态信息，包括：
    在完成所配置属性状态信息创建至进程而写入所述进程映射的内存空间之后，写入所配置属性状态信息的进程进行广播，使其它进程均同步到所述属性状态信息，在所述角色归属的虚拟环境主进程和所述物理硬件归属的硬件进程之间共享所述属性状态信息。
  8. 根据权利要求3所述的方法，其特征在于，变化的所述属性状态信息对应于角色或物理硬件，所述将变化的所述属性状态信息在所述角色和所述物理硬件之间同步，包括：
    在所述外部变化被施加的一方，为所归属进程更新变化的所述属性状态信息；
    将所述变化的所述属性状态信息由所述外部变化被施加的一方同步至未施加所述外部变化的一方所归属进程。
  9. 一种虚拟环境与物理硬件的交互装置，其特征在于，所述装置包括：
    加载模块，配置为进行虚拟环境中物理硬件所关联角色的加载，所述物理硬件通过与所述角色的关联接入所述虚拟环境；
    配置模块，配置为对所述角色和所述物理硬件进行属性配置，以获得属性配置后的属性状态信息，所述属性状态信息分别对应于所述角色和所述物理硬件；
    同步存储模块，配置为在所述角色和所述物理硬件之间进行所述属性状态信息的同步存储；
    其中，当所述角色和所述物理硬件二者任一方被施加外部变化时，同步存储的所述属性状态信息进行同步更新，通过所述同步更新使得未施加所述外部变化的一方响应所述外部变化。
  10. 根据权利要求9所述的装置，其特征在于，所述装置包括：
    变化感知模块，配置为接收所述角色和所述物理硬件二者任一方被施加的外部变化，响应所述外部变化执行对应属性状态信息的修改操作，获得变化的所述属性状态信息；
    变化同步模块，配置为将变化的所述属性状态信息在所述角色和所述物理硬件之间同步；
    响应控制模块，配置为根据同步的所述属性状态信息控制所述角色和物理硬件二者中未施加所述外部变化的一方响应所述外部变化。
  11. 根据权利要求9所述的方法，其特征在于，所述加载模块包括：
    加载渲染单元，配置为通过对应于所述角色的配置文件进行所述虚拟环境中所述角色的加载和渲染，获得所述角色在所述虚拟环境中的图形显示；
    属性创建单元，配置为控制所述角色所关联物理硬件创建自身归属的进程，并将创建的硬件进程与所述角色归属的虚拟环境主进程建立连接，使得所述物理硬件接入所述虚拟环境。
  12. 一种虚拟环境与物理硬件的交互装置，其特征在于，包括：
    处理器；以及
    存储器，所述存储器上存储有计算机可读指令，所述计算机可读指令被所述处理器执行时实现根据权利要求1至8中任一项所述的虚拟环境与物理硬件的交互方法。
  13. 一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现根据权利要求1至8中任一项所述的虚拟环境与物理硬件的交互方法。
PCT/CN2018/114139 2017-11-13 2018-11-06 虚拟环境与物理硬件的交互方法、装置和存储介质 WO2019091369A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711117467.4 2017-11-13
CN201711117467.4A CN109783112A (zh) 2017-11-13 2017-11-13 虚拟环境与物理硬件的交互方法、装置和存储介质

Publications (1)

Publication Number Publication Date
WO2019091369A1 true WO2019091369A1 (zh) 2019-05-16

Family

ID=66438739

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/114139 WO2019091369A1 (zh) 2017-11-13 2018-11-06 虚拟环境与物理硬件的交互方法、装置和存储介质

Country Status (2)

Country Link
CN (1) CN109783112A (zh)
WO (1) WO2019091369A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110471803B (zh) * 2019-07-05 2021-01-29 华为技术有限公司 一种物理硬件操作方法、电子设备、存储介质及芯片

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542174A (zh) * 2012-01-19 2012-07-04 马卡里 真人rpg游戏系统
CN102693091A (zh) * 2012-05-22 2012-09-26 深圳市环球数码创意科技有限公司 一种三维虚拟角色的实现方法及其系统
CN106681479A (zh) * 2015-11-05 2017-05-17 丰唐物联技术（深圳）有限公司 基于虚拟现实的用户交互方法及系统
US20170243433A1 (en) * 2011-10-20 2017-08-24 Robert A. Luciano, Jr. Gesture based gaming controls for an immersive gaming terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10300362B2 (en) * 2015-04-23 2019-05-28 Win Reality, Llc Virtual reality sports training systems and methods
CN106648071B (zh) * 2016-11-21 2019-08-20 捷开通讯科技(上海)有限公司 虚拟现实社交实现系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170243433A1 (en) * 2011-10-20 2017-08-24 Robert A. Luciano, Jr. Gesture based gaming controls for an immersive gaming terminal
CN102542174A (zh) * 2012-01-19 2012-07-04 马卡里 真人rpg游戏系统
CN102693091A (zh) * 2012-05-22 2012-09-26 深圳市环球数码创意科技有限公司 一种三维虚拟角色的实现方法及其系统
CN106681479A (zh) * 2015-11-05 2017-05-17 丰唐物联技术（深圳）有限公司 基于虚拟现实的用户交互方法及系统

Also Published As

Publication number Publication date
CN109783112A (zh) 2019-05-21

Similar Documents

Publication Publication Date Title
US10353661B2 (en) Method for sharing screen between devices and device using the same
KR102220085B1 (ko) 멀티윈도우 운용 방법 및 이를 지원하는 전자 장치
KR102131646B1 (ko) 디스플레이장치 및 그 제어방법
US9697702B2 (en) Display device and method for controlling the same
TWI662475B (zh) 應用程式生成設備、方法和非臨時性電腦可讀媒介及應用程式驅動設備
WO2017101663A1 (zh) 应用的引导方法及装置、终端
WO2016082586A1 (zh) 网页更新方法及装置
US10628121B2 (en) Electronic device and method for controlling the same
US20160274776A1 (en) System and method for modifying a look and feel of a graphical user interface for an application
KR20160003400A (ko) 디스플레이 장치 및 그 제어 방법
US20170242580A1 (en) Device and method of controlling the device
US20150180998A1 (en) User terminal apparatus and control method thereof
TW201826109A (zh) 頁面展示方法及裝置
CN113268212A (zh) 投屏方法、装置、存储介质及电子设备
CN109783144B (zh) 虚拟环境交互实现中变量的处理方法、装置和存储介质
CN110971974B (zh) 配置参数创建方法、装置、终端及存储介质
CN110070592A (zh) 特效包的生成方法、装置和硬件装置
WO2019091369A1 (zh) 虚拟环境与物理硬件的交互方法、装置和存储介质
EP2587359B1 (en) Method and apparatus for making personalized contents
KR20160020724A (ko) 디스플레이 장치 및 그 제어 방법
CN105993025B (zh) 用于创建通信组的方法和装置
CN108132736B (zh) 窗口中的显示控制方法和装置
CN110868471B (zh) 设备构建方法、装置及存储介质
CN110673921A (zh) 信息处理方法、装置及电子设备
JP2009163518A (ja) 情報処理装置及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18877244

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18877244

Country of ref document: EP

Kind code of ref document: A1