WO2019127325A1

WO2019127325A1 - Information processing method and apparatus, cloud processing device, and computer program product

Info

Publication number: WO2019127325A1
Application number: PCT/CN2017/119720
Authority: WO
Inventors: 杨文超; 王恺; 廉士国
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2017-12-29
Filing date: 2017-12-29
Publication date: 2019-07-04
Also published as: CN109643182A; CN109643182B

Abstract

Embodiments of the present application relate to the technical field of data processing, provide an information processing method and apparatus, a cloud processing device, and a computer program product, and achieve that a user can operate the surface of an entity object to complete control to a virtual touch screen so that the tactility and reality are augmented and the detection precision can also be improved by operating the surface of a real object. The information processing method provided by the embodiments of the present application comprises: receiving current environment information sent by a first device, modeling the current environment information to obtain model information, and locating the first device to obtain locating information; generating the virtual touch screen on the surface of a developing body in a model according to the model information and the locating information; and sending the virtual touch screen to the first device.

Description

Information processing method, device, cloud processing device and computer program product

Technical field

The present application relates to the field of data processing technologies, and in particular, to an information processing method, apparatus, cloud processing device, and computer program product.

Background technique

With the rapid development of Internet of Things technology, new data computing modes such as ubiquitous computing, holographic computing, and cloud computing are gradually entering people's daily lives, which can be applied to many fields. Among them, computer vision can be a representative. field of. Computer vision is a science that studies how to make a machine "look". Further, it refers to the use of equipment instead of the human eye to identify, track, and measure the machine vision, and further image processing. It is more suitable for human eyes to observe or transmit images detected by the instrument.

At this stage, some AR (Augmented Reality) glasses such as HoloLens glasses are used for displaying virtual reality scenes, which are representative wearable devices in computer vision. The camera uses the camera to obtain depth maps of different angles in real time, and then accumulates different depth maps, thereby calculating an accurate three-dimensional model of the scene and its internal target objects by means of stereoscopic vision and the like, and presenting the corresponding images to the user. Users can also interact with glasses by clicking on images, clicking and sliding gestures by viewing image information.

However, in the three-dimensional space, the operation of interacting with the device through the gap gesture is liable to cause fatigue of the human arm due to lack of force feedback, and it is difficult to perform operations requiring high precision.

Summary of the invention

The embodiment of the present invention provides an information processing method, a device, a cloud processing device, and a computer program product, so that a user can operate a virtual touch screen on a surface of a real object, thereby enhancing the touch and authenticity and improving the detection precision.

In a first aspect, an embodiment of the present application provides an information processing method, including:

Receiving current environment information sent by the first device, and modeling the model information according to the current environment information, and positioning the first device to obtain positioning information;

Generating a virtual touch screen on the surface of the developer body in the model according to the model information and the positioning information;

Sending the virtual touch screen to the first device.

In a second aspect, the embodiment of the present application further provides an information processing apparatus, including:

The receiving unit is configured to receive current environment information sent by the first device, and perform modeling according to the current environment information to obtain model information, and locate the first device to obtain positioning information.

And a generating unit, configured to generate a virtual touch screen on the surface of the developer body in the model according to the model information and the positioning information.

a sending unit, configured to send the virtual touch screen to the first device.

In a third aspect, the embodiment of the present application further provides a cloud processing device, where the device includes an input and output interface, a processor, and a memory;

The memory is for storing instructions that, when executed by the processor, cause the device to perform any of the methods of the first aspect.

In a fourth aspect, the embodiment of the present application further provides a computer program product, which can be directly loaded into an internal memory of a computer and includes software code. After the computer program is loaded and executed by a computer, the first aspect can be implemented. One such method.

The information processing method, the device, the cloud processing device, and the computer program product provided by the embodiment of the present application, by using a device, such as a cloud computing center, model and locate the current environment information sent by the first device, and according to the model information and Positioning information, a virtual touch screen is generated on the surface of the developing body in the model, and then sent to the first device for display by the first device, and the developing body in the model corresponds to the physical object in the actual scene, so the user can The surface is operated to complete the control of the virtual touch screen, the touch and the authenticity are enhanced, and the operation on the real object surface can also improve the detection precision, and further, the interaction between the first device and the second device, the current environment Modeling and positioning require more complicated operations to be completed by using the second device, which reduces the load on the first device, and solves the problem in the prior art that the arm is fatigued due to lack of force feedback, and it is difficult to complete the accuracy requirement. High operational problems.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present application, and other drawings can be obtained according to the drawings without any creative labor for those skilled in the art.

FIG. 1 is a flowchart of an embodiment of an information processing method according to an embodiment of the present application;

FIG. 2 is another flowchart of an embodiment of an information processing method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a first scenario provided by an embodiment of the present application;

4 is a schematic diagram of a second scenario provided by an embodiment of the present application;

FIG. 5 is another flowchart of an embodiment of an information processing method according to an embodiment of the present disclosure;

FIG. 6 is another flowchart of an embodiment of an information processing method according to an embodiment of the present disclosure;

FIG. 7 is another flowchart of an embodiment of an information processing method according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present disclosure;

FIG. 9 is another schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present disclosure;

FIG. 10 is another schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present disclosure.

Detailed ways

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

The terms used in the embodiments of the present application are for the purpose of describing particular embodiments only, and are not intended to limit the application. The singular forms "a", "the", and "the"

It should be understood that the term "and/or" as used herein is merely an association describing the associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, while A and B, there are three cases of B alone. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship.

Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determining" or "in response to detecting." Similarly, depending on the context, the phrase "if determined" or "if detected (conditions or events stated)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event) "Time" or "in response to a test (condition or event stated)".

A wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are more than just a hardware device. They also implement powerful functions through software support, data interaction, and cloud interaction. For example, smart watches, smart shoes, smart bracelets, glasses, helmets, etc. Among them, eye-related devices such as smart glasses and helmets are devices that can directly interact with the user by using vision. When smart glasses and helmets are worn on the user's head, they can create virtual scenes in three-dimensional space in front of the user's eyes. It allows users to view not only the scene, but also interact with the scene, such as clicking, dragging, sliding, and so on. However, since the user interacts with the scene while interacting with the scene, the operation of interacting with the device through the gesture of the space is easy to cause fatigue of the arm due to lack of force feedback, and since the human body is unstable, the hand and the body change position at any time. Therefore, it is difficult to perform operations requiring high precision. In addition, since a virtual scene is generated in a three-dimensional space, a large number of operations are required, and the hardware and software requirements are high, and the design of the wearable device limits the size and weight of the device, so the processing speed is slow, and therefore, In the application embodiment, the calculation speed is increased by adopting the device separation method, and the virtual scene is generated on the surface of the real object, so that the user can enhance the touch and the authenticity by operating the surface of the real object. Specifically, FIG. 1 is a flowchart of an embodiment of an information processing method according to an embodiment of the present disclosure, which is applied to a third device. As shown in FIG. 1 , the information processing method provided by the embodiment of the present application may specifically include the following steps:

101. The first device acquires current environment information, and sends current environment information to the third device.

In the embodiment of the present application, the first device refers to the wearable device, and the first device includes at least a display unit, a basic operation unit, a wireless transmission unit, an environment sensing unit, an interaction detecting unit, and a power unit. For example, smart glasses, helmets, etc. The third device refers to a device having strong computing power, and the third device includes at least an arithmetic unit, a wireless transmission unit, for example, a local computer, a cloud processing center, or the like. The first device and the third device can communicate with each other, and the communication mode can use wireless communication methods such as 2G, 3G, 4G, and WiFi.

The first device obtains the current environment information through the environment sensing unit. Specifically, the environment sensing unit needs to include at least an IMU (Inertial Measurement Unit) and an image capturing module (preferably using a binocular camera), and the SLAM is utilized in practical applications. (simultaneous localization and mapping, real-time positioning and map construction) technology to calculate, to achieve the acquisition of current environmental information, specifically, the current environmental information includes the first device itself positioning, surrounding environment image acquisition and object surface three-dimensional information Get and so on.

After the first device obtains the current environment information, the current environment information is sent to the third device by using the wireless transmission unit, so that the third device can perform subsequent processing on the current environment information. In a specific implementation process, in order to speed up the processing and increase the transmission speed, it is preferable to use 4G, WiFi or even faster wireless communication.

102. The third device receives the current environment information sent by the first device, and performs modeling according to the current environment information to obtain model information, and locates the first device to obtain positioning information.

After receiving the current environment information sent by the first device, the third device parses the current environment information to construct a virtual scenario. Specifically, the process may include: first, acquiring the horizontal direction of each physical object in the pre-environment information, and the zenith Parameters such as distance, slant range and reflection intensity are automatically stored and calculated to obtain point cloud data; then, editing of point cloud data, splicing and merging of scanned data, three-dimensional measurement of image data points, visualization of point cloud images, and spatial data 3D modeling, texture analysis processing and data conversion processing, constructing virtual scenes, and obtaining model information.

And the third device parses the current environment information, extracts the positioning information of the first device, and performs positioning on the first device to obtain positioning information.

103. The third device generates a virtual touch screen on the surface of the developer body in the model according to the model information and the positioning information.

In the embodiment of the present application, the developing body refers to any thing that can generate a virtual touch screen on the surface thereof, because the things in the model are virtual images of real objects in the real scene, so in the real scene All real objects can be used as developing bodies in the model, such as tables, walls, water dispensers, water heaters, windows, and the like. Therefore, the third device can generate a virtual touch screen on any developer surface in the model according to the model information and the positioning information.

In the embodiment of the present application, the virtual touch screen can be automatically generated on the surface of the developing body or generated after interacting with the user.

Correspondingly, when the user operates the virtual touch, the user performs the same operation on the real object corresponding to the real scene.

104. The third device sends the virtual touch screen to the first device.

In the embodiment of the present application, after the third device generates the virtual touch screen, the virtual touch screen is sent to the first device by using the wireless transmission unit.

105. The first device receives and displays a virtual touch screen.

It should be noted that, in the embodiment of the present application, the virtual touch screen fits the surface of the developing body in the model. For example, the virtual touch screen is attached to the surface of the water bucket, that is, the curved curvature of the virtual touch screen is consistent with the curvature of the water tub. As another example, a virtual touch screen fits over the surface of the table. The purpose is that the user can operate on the surface of a real object in a real scene to obtain a real touch.

The information processing method provided by the embodiment of the present application uses a device, such as a cloud computing center, to model and locate current environment information sent by the first device, and based on the model information and the positioning information, the surface of the developer in the model. The virtual touch screen is generated and then sent to the first device for display by the first device, and the developing body in the model corresponds to the physical object in the actual scene, so the user can operate on the surface of the solid object to complete the virtual touch screen. The control enhances the tactile sensation and authenticity, and the operation on the surface of the real object can also improve the detection accuracy. In addition, through the interaction between the first device and the second device, the current environment for modeling and positioning requires more complicated operations. The second device is used to reduce the load of the first device, which solves the problem in the prior art that the arm is easily fatigued due to lack of force feedback, and the operation with high precision is difficult to complete.

In the foregoing content, the third device may automatically generate a virtual touch screen. In an actual application, optionally, in order to enhance user operability and participation, the user may determine when to generate a virtual touch screen according to needs, specifically FIG. 2 is another flowchart of an embodiment of an information processing method according to an embodiment of the present disclosure, which is applied to a third device. As shown in FIG. 2, the information processing method provided by the embodiment of the present application is further It can include the following steps:

106. The first device receives a startup instruction of the first user.

107. The first device sends a startup command to the third device.

108. The third device receives a startup command sent by the first device.

Correspondingly, step 103 is executed as "the third device generates a virtual touch screen on the surface of the developer in the model according to the startup command, the model information, and the positioning information."

Specifically, in the embodiment of the present application, the user's startup instruction includes two cases: the first type is that the first device has a physical button, and the function is to automatically generate a button, and the user operates the automatically generated button. The second is that the user selects the display area.

FIG. 3 is a schematic diagram of a first scenario according to an embodiment of the present disclosure. As shown in FIG. 3, in a first case, when a user operates an automatically generated button, the first device receives an operation of the user automatically generating a button, and the trigger is Start the instruction and send the start command to the third device. The third device starts to generate the virtual touch screen when receiving the startup instruction. First, the third device determines the location of the marker information in the current environment information according to the startup instruction. Then, the third device marks the information according to the model information and the location information. The location generates a virtual touchscreen with a specified size. Specifically, in the embodiment of the present application, since the user wears the first device on the head and blocks at least part of the line of sight, in order to facilitate the user operation, the physical button is set on the first device, so that the user touches the physical When the button is pressed, the first device can be operated. In a specific implementation process, the user's operation of automatically generating a button may be a click, a double click, or the like. Moreover, in the embodiment of the present application, at least one tag information is preset in the current environment in which the user is located, and the location of the tag information is on the surface of the specified object. Therefore, when the user operates the automatically generated button, the third device first acquires the location of the tag information in the current environment, and then the third device generates the tag information according to the user's operation on the automatically generated button, the model information, and the positioning information. A virtual touch screen of a specified size. In a specific implementation process, after acquiring the image of the tag information, the third device calculates the three-dimensional coordinate information (the three-dimensional coordinate information includes three dimensions of x, y, and z), and then uses the three-dimensional coordinate information of the tag information, After the current environment is modeled, the position of each object and the current positioning information of the first device are generated, and a virtual touch screen having a specified size is generated at the position of the marker information. For example, if the user needs to generate a tablet screen on the wall, when the user clicks the auto-generate button, first obtain the location of the mark information on the wall, and then generate a virtual touch screen of the same size as the tablet at the mark information.

FIG. 4 is a schematic diagram of a second scenario according to an embodiment of the present disclosure. As shown in FIG. 4, in the second case, the first device acquires a display area selected by the first user frame; The display area is converted into a startup command, and the startup command is sent to the third device, and the third device generates a virtual touch screen in the display area selected by the first user according to the model information and the positioning information. Specifically, in the embodiment of the present application, in order to improve interactivity and personalization, the user may generate a virtual touch screen at any position according to his own needs, and the user selects the display area by using a finger on the surface of an object in the current environment. For example, after drawing a rectangle, the first device collects the display area selected by the first user on the surface of the specified object, converts it into a startup command, and sends it to the third device, so that the third device can be according to the first instruction, etc. The content generates a virtual touch screen within the display area.

Moreover, in the embodiment of the present application, the tag information includes at least one of a two-dimensional code, a graphic, a pattern, a picture, a text, a letter, or a number.

As users become more and more demanding for personalization, different users have different usage habits, different historical data, and different software installed in the device when using the device. Therefore, in order to achieve individualized requirements, And improving the user experience. Based on the foregoing content, the embodiment of the present application further provides the following implementation manner. Specifically, FIG. 5 is another flowchart of the information processing method according to the embodiment of the present application. As shown in FIG. 5, the information processing method provided by the embodiment of the present application may further include the following steps:

108. The first device acquires account information of the first user.

Since the virtual touch screen is generated in step 103, in the embodiment of the present application, the first user can input his/her account name and password in the virtual touch screen to log in, so that the first device can acquire the first user. account information.

109. The first device sends the account information of the first user to the third device.

In the embodiment of the present application, after the first device acquires the account information of the first user, the account information of the first user is sent to the third device by using the wireless transmission unit.

110. The third device updates the display content of the virtual touch screen according to the account information of the first user and the current environment information.

In the embodiment of the present application, the third device stores a large amount of user information, where the account information of the first user and the account content corresponding to the account information of the first user are included, and the account content may include the account information of the first user. Device information for all associated devices (for example, tablets, washing machines, air conditioners, water dispensers, water purifiers, etc.). For example, if the first user associates the tablet with the account information, the third device stores the system desktop information of the tablet. For another example, if the first user associates the water purifier with the account information, the third device stores information such as the current water storage capacity of the water purifier, the cleanliness level of the water, and whether the filter cartridge needs to be replaced.

In a specific implementation process, when the first user generates a virtual touch screen on a non-electrical surface such as a wall or a desktop, the third device may provide the first user with at least one display content for the user to select, A user can drag and slide left and right to replace the content in the current virtual touch screen.

In a specific implementation process, when the first user generates a virtual touch screen on a certain electrical surface, the third device may provide the first user with electrical information corresponding to the electrical device, so that the first user can view the current electrical device. status.

111. The third device sends the updated virtual touch screen to the first device. In the embodiment of the present application, after the third device updates the display content of the virtual touch screen, the updated virtual touch screen is sent to the first device by using the wireless transmission unit.

112. The first device receives the updated virtual touch screen and displays the same.

Through the introduction of the foregoing content, the information processing method provided by the embodiment of the present application further provides a manner, which can improve operability, so that the user can use the first device according to his own usage habits, thereby improving the use efficiency.

On the basis of the foregoing, the information processing method provided by the embodiment of the present application is performed in the following manner when collecting the interaction operation of the user. Specifically, FIG. 6 is another flow of the embodiment of the information processing method provided by the embodiment of the present application. As shown in FIG. 6, the information processing method provided by the embodiment of the present application may further include the following steps:

113. The first device detects an action of the first user on the virtual touch screen.

In the embodiment of the present application, the first device has an interaction detecting unit, and the interaction detecting unit detects the user action based on the computer vision, and specifically uses the binocular camera in the first device to detect the fingertip of the user on the virtual touch screen. The location or action. In a specific implementation process, the detection process of the interaction detection unit may include: first, selecting a key point of the hand to establish a skeleton model of the hand; then tracking the opponent to obtain the coordinates of the key point of the hand, the skeleton of the hand The model is optimized; the skeletal model of the opponent is extracted to obtain the position of the fingertip; the position change information of the fingertip from the initial point to the end point is tracked, and the action is determined according to the position change information.

114. The first device matches the corresponding operation instruction to the action and sends the operation instruction to the third device.

In the embodiment of the present application, the corresponding relationship between the action and the operation instruction is preset in the first device, and after the interaction detecting unit determines the action of the first user, according to the corresponding relationship between the preset action and the operation instruction, the first relationship is The action of the user matches the corresponding operation instruction. For example, when the image of the tablet is presented in the virtual touch screen, and the first user clicks an icon in the virtual touch screen, the action of the first user is detected as a click. And there is an application icon at the fingertip position of the first user, and the operation instruction for opening the application is matched for the click action. For example, when the image of the tablet is presented in the virtual touch screen, the first user slides from the left side of the virtual touch screen to the right side, and detects that the action of the first user is sliding, and the switching page is matched for the sliding action. Operation instructions.

After the first device determines the operation instruction, the operation command is transmitted to the third device by using the wireless transmission unit.

In the embodiment of the present application, in order to further improve the efficiency and accuracy of determining the motion of the first user, an auxiliary detecting device may be set in advance on the surface of the object in the current environment, for example, an infrared laser emitting device and a radar are installed near the marking information. The scanning device or the like determines the position of the finger by the interaction between the auxiliary detecting device and the finger, for example, installing an infrared laser emitting device near the mark, and when the virtual touch screen is generated at the mark, the first user clicks on the virtual touch When the screen is controlled, the infrared rays are blocked by the fingers, and a bright spot is formed at the fingertips, so that the interactive detecting unit can quickly position the fingertips according to the position of the bright spots.

115. The third device processes the operation instruction and updates the display content of the virtual touch screen according to the current environment information.

After receiving the operation instruction sent by the first device, the third device determines the content corresponding to the operation instruction in response to the content of the operation instruction, and further, since the position of the first user is uncontrollable, the movement may occur at any time. The third device further updates the display content of the virtual touch screen according to the current environment information combined with the content of the operation instruction.

116. The third device sends the updated virtual touch screen to the first device.

In the embodiment of the present application, after the third device updates the virtual touch screen, the updated virtual touch screen is sent to the first device by using the wireless transmission unit.

117. The first device receives the updated virtual touch screen and displays the same.

In the information processing method provided by the embodiment of the present application, the user can perform operations on the surface of a real object, for example, clicking, sliding, etc., the touch is real and the user can feel the feedback of the force, and the detection accuracy can be improved and the detection can be improved in detecting the user action. effectiveness.

In the foregoing content, a user uses one device to log in to an account for viewing, interaction, and the like. In an actual life scenario, there are situations in which multiple people view and operate the same terminal. For example, two people use one at the same time. A tablet computer plays games, and two people use a tablet computer to watch movies at the same time. Therefore, in order to enhance the interactivity between the users, the embodiment of the present application further provides an information processing method, and implements multi-person interaction on the basis of the foregoing content. Specifically, FIG. 7 is an implementation of the information processing method provided by the embodiment of the present application. Another flowchart of the example, as shown in FIG. 7, the information processing method provided by the embodiment of the present application may further include the following steps:

118. The second device is connected to the third device.

In the embodiment of the present application, the second device is the same as the first device, and refers to the wearable device, and the second device is used by the second user, and the first device is used by the first user.

In the foregoing, the first user logs in the account information of the first user by using the first device, and the first display content of the first device is sent by the third device, if the second user wants to obtain the same as the first user. The content first needs to connect to the third device using the second device.

In the embodiment of the present application, the manner in which the second device is connected to the third device is the same as the manner in which the first device is connected to the third device.

119. After the second device is connected to the third device, the third device sends the virtual touch screen to the second device.

In the embodiment of the present application, after the second device determines that the third device is connected, the third device sends the virtual touch screen to the second device by using the wireless transmission unit.

120. The second device receives the virtual touch screen and displays the same.

In addition, in order to further improve the interaction, in the embodiment of the present application, the second user may also operate the content displayed in the display screen in the same manner as the first user. Specifically, first, the second device detects an action of the second user on the virtual touch screen; the second device matches the corresponding operation instruction with the action and sends the operation instruction to the third device; then, the third device processes the operation instruction and combines the current The environment information is used to update the display content of the virtual touch screen; the third device sends the updated virtual touch screen to the first device and the second device; so that the first device and the second device can respectively receive the updated virtual touch Control the screen and display it separately.

Since the first user and the second user see the same virtual touch screen, and the first user and the second user can operate on the same, when the first user and the second user are simultaneously or in a specified time range When the same instruction is issued in succession, the third device de-reprocesses the instruction and selects the instruction received first.

FIG. 8 is a schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 8, the information processing apparatus provided by the embodiment of the present application may include: a receiving unit 11, a generating unit 12, and a sending unit 13.

The receiving unit 11 is configured to receive current environment information sent by the first device, and perform modeling to obtain model information according to current environment information, and locate the first device to obtain positioning information.

The generating unit 12 is configured to generate a virtual touch screen on the surface of the developing body in the model according to the model information and the positioning information.

The sending unit 13 is configured to send the virtual touch screen to the first device.

FIG. 9 is another schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 9, the information processing apparatus provided by the embodiment of the present application may further include: an updating unit 14.

In the embodiment of the present application, the receiving unit 11 is further configured to:

Receiving account information of the first user sent by the first device;

The updating unit 14 is configured to update the display content of the virtual touch screen according to the account information of the first user and the current environment information;

The sending unit 13 is further configured to:

Send the updated virtual touch screen to the first device.

The receiving unit 11 is further configured to:

Receiving an operation instruction sent by the first device;

The updating unit 14 is further configured to:

Processing the operation instruction, and updating the display content of the virtual touch screen in combination with the current environment information;

The sending unit 13 is further configured to:

Send the updated virtual touch screen to the first device.

In a specific implementation process, the receiving unit 11 is further configured to:

Receiving a startup instruction sent by the first device;

The generating unit 12 is specifically configured to:

A virtual touch screen is generated on the surface of the developer in the model according to the startup command, the model information, and the positioning information.

In a specific implementation process, the generating unit 12 is specifically configured to:

Determining the location of the tag information in the current environment information according to the startup command;

Based on the model information and the positioning information, a virtual touch screen having a specified size is generated at the position of the marker information.

Determining, according to the startup instruction, a display area selected by the first user;

According to the model information and the positioning information, a virtual touch screen is generated in the display area selected by the first user.

In a specific implementation process, the updating unit 14 is specifically configured to:

Determining an action of the first user on the virtual touch screen according to the operation instruction;

The display content of the virtual touch screen is updated according to the action and the current environment information.

In the embodiment of the present application, the virtual touch screen fits the surface of the developing body in the model.

In the embodiment of the present application, the marking information includes:

At least one of a QR code, a graphic, a pattern, a picture, a text, a letter, or a number.

FIG. 10 is another schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 10, the information processing apparatus provided by the embodiment of the present application may further include: a connection unit 15.

In the embodiment of the present application, the receiving unit 11 is further configured to: receive a connection request sent by the second device.

The connecting unit 15 is configured to connect the second device and send the virtual touch screen to the second device.

The information processing apparatus of this embodiment may be used to implement the technical solution of the method embodiment shown in FIG. 1 to FIG. 7. The implementation principle and technical effects are similar, and details are not described herein again.

The embodiment of the present application further provides a cloud processing device, where the device includes an input and output interface, a processor, and a memory;

The memory is for storing instructions that, when executed by the processor, cause the device to perform the method of any of Figures 1-7.

The cloud processing device provided by the embodiment of the present application may be used to implement the technical solution of the method embodiment shown in FIG. 1 to FIG. 7. The implementation principle and technical effects are similar, and details are not described herein again.

The embodiment of the present application further provides a computer program product, which can be directly loaded into an internal memory of a computer and contains software code. After the computer program is loaded and executed by the computer, the method of any one of FIG. 1 to FIG. 7 can be implemented. .

The computer program product of this embodiment can be used to implement the technical solution of the method embodiment shown in FIG. 1 to FIG. 7. The implementation principle and technical effects are similar, and details are not described herein again.

The device embodiments described above are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located in one place. Or it can be distributed to at least two network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present application. range.

Claims

An information processing method, comprising:

Receiving current environment information sent by the first device, and modeling the model information according to the current environment information, and positioning the first device to obtain positioning information;

Generating a virtual touch screen on the surface of the developer body in the model according to the model information and the positioning information;

Sending the virtual touch screen to the first device.
The method of claim 1 further comprising:

Receiving account information of the first user sent by the first device;

Updating the display content of the virtual touch screen according to the account information of the first user and the current environment information;

Sending the updated virtual touch screen to the first device.
The method according to claim 1 or 2, wherein the method further comprises:

Receiving an operation instruction sent by the first device;

Processing the operation instruction, and updating display content of the virtual touch screen in combination with current environment information;

Sending the updated virtual touch screen to the first device.
The method according to claim 1, wherein before the generating a virtual touch screen on the surface of the developer in the model according to the model information and the positioning information, the method further comprises:

Receiving a startup instruction sent by the first device;

And generating, according to the model information and the positioning information, a virtual touch screen on a surface of the developer body in the model, including:

A virtual touch screen is generated on the surface of the developer in the model according to the startup command, the model information, and the positioning information.
The method according to claim 4, wherein the generating a virtual touch screen on the surface of the developer body in the model according to the startup instruction, the model information, and the positioning information comprises:

Determining a location of the tag information in the current environment information according to the startup instruction;

And generating, according to the model information and the positioning information, a virtual touch screen having a specified size at a position of the mark information.
The method according to claim 4, wherein the generating a virtual touch screen on the surface of the developer body in the model according to the startup instruction, the model information, and the positioning information comprises:

Determining, according to the startup instruction, a display area selected by the first user;

And generating, according to the model information and the positioning information, a virtual touch screen in a display area selected by the first user.
The method according to claim 3, wherein the processing the operation instruction and updating the display content of the virtual touch screen in combination with the current environment information comprises:

Determining, according to the operation instruction, an action of the first user on the virtual touch screen;

Updating the display content of the virtual touch screen according to the action and in combination with the current environment information.
The method of claim 1 wherein said virtual touch screen conforms to a surface of said developer within said mold.
The method of claim 5 wherein said tag information comprises:

At least one of a QR code, a graphic, a pattern, a picture, a text, a letter, or a number.
The method of claim 1 further comprising:

Receiving a connection request sent by the second device;

Connecting the second device and transmitting the virtual touch screen to the second device.
An information processing apparatus, comprising:

The receiving unit is configured to receive current environment information sent by the first device, and perform modeling according to the current environment information to obtain model information, and locate the first device to obtain positioning information.

And a generating unit, configured to generate a virtual touch screen on the surface of the developer body in the model according to the model information and the positioning information.

a sending unit, configured to send the virtual touch screen to the first device.
The device of claim 11 wherein:

The receiving unit is further configured to:

Receiving account information of the first user sent by the first device;

The device also includes:

An update unit, configured to update display content of the virtual touch screen according to account information of the first user and current environment information;

The sending unit is further configured to:

Sending the updated virtual touch screen to the first device.
Device according to claim 11 or 12, characterized in that

The receiving unit is further configured to:

Receiving an operation instruction sent by the first device;

The update unit is further configured to:

Processing the operation instruction, and updating display content of the virtual touch screen in combination with current environment information;

The sending unit is further configured to:

Sending the updated virtual touch screen to the first device.
The device of claim 11 wherein:

The receiving unit is further configured to:

Receiving a startup instruction sent by the first device;

The generating unit is specifically configured to:

A virtual touch screen is generated on the surface of the developer in the model according to the startup command, the model information, and the positioning information.
The device according to claim 14, wherein the generating unit is specifically configured to:

Determining a location of the tag information in the current environment information according to the startup instruction;

And generating, according to the model information and the positioning information, a virtual touch screen having a specified size at a position of the mark information.
The device according to claim 14, wherein the generating unit is specifically configured to:

Determining, according to the startup instruction, a display area selected by the first user;

And generating, according to the model information and the positioning information, a virtual touch screen in a display area selected by the first user.
The device according to claim 13, wherein the updating unit is specifically configured to:

Determining, according to the operation instruction, an action of the first user on the virtual touch screen;

Updating the display content of the virtual touch screen according to the action and in combination with the current environment information.
The apparatus according to claim 11, wherein said virtual touch screen is attached to a surface of said developing body in said mold.
The device according to claim 15, wherein said tag information comprises:

At least one of a QR code, a graphic, a pattern, a picture, a text, a letter, or a number.
The device of claim 11 wherein:

The receiving unit is further configured to: receive a connection request sent by the second device;

The device also includes:

a connecting unit, configured to connect the second device, and send the virtual touch screen to the second device.
A cloud processing device, characterized in that the device comprises an input and output interface, a processor and a memory;

The memory is for storing instructions that, when executed by the processor, cause the apparatus to perform the method of any one of claims 1 to 10.
A computer program product, which can be directly loaded into an internal memory of a computer and containing software code, which can be implemented by any one of claims 1 to 10 after being loaded and executed by a computer Methods.