TWI713327B - Message sending method and device and electronic equipment - Google Patents

Abstract

The embodiments of this specification provide a message sending method and device, and an electronic device. The method includes: displaying a preset virtual object in a real scene image based on augmented reality technology; acquiring at least one determined by the sender The recipient; the virtual object is sent to the recipient in the form of augmented virtual reality messages; wherein the sender and the recipient are users in a social platform.

Description

Message sending method and device and electronic equipment

The embodiments of this specification relate to the field of Internet technology, and in particular to a method and device for sending a message, and electronic equipment.

With the continuous development of social networks, network activities through social networks have become more frequent. However, the information display form in the existing social networks is relatively single, and how to improve the interactivity and interest of social information is of great significance for improving user experience.

A message sending method, device, and electronic equipment provided in the embodiments of this specification: According to the first aspect of the embodiments of this specification, a message sending method is provided, which is applied to augmented virtual reality clients. The method includes: The augmented virtual reality technology displays a preset virtual object in the real scene image; obtains at least one recipient determined by the sender; sends the virtual object to the recipient in the form of an augmented virtual reality message; wherein, The sender and receiver are users in the social platform Household.

According to a second aspect of the embodiment of the present specification, a message sending device is provided, which is applied to an augmented virtual reality client. The device includes: a display unit, based on the augmented virtual reality technology, to display presets in real scene images The acquiring unit, which acquires at least one receiver determined by the sender; the sending unit, which sends the virtual object to the receiver in the form of augmented virtual reality information; wherein, the sender and the receiver For users in social platforms.

According to a fifth aspect of the embodiments of the present specification, there is provided an electronic device, including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured as any of the foregoing message sending methods.

The embodiment of this specification provides a message sending solution, by combining AR technology with social messages, so that social messages can be displayed in the form of AR messages, thereby enhancing the interest of social messages. On the other hand, it also provides a new way to interact with business content, that is, through the reach of the AR message, the receiver can quickly enter the corresponding business content based on the AR message, thereby participating in the interaction of the business content.

100: System architecture conceptual diagram

112: Network

106: Expanding the virtual reality client

105: Operation Server

115: database

103: computer device

101: System architecture conceptual diagram

107: Operation Server

109: Operation Server

117: Database

118: Database

410: display unit

420: Get Unit

430: sending unit

Fig. 1a is an exemplary system rack applicable to an embodiment of this specification Figure 1b is a conceptual diagram of an exemplary system architecture applicable to an embodiment of this specification; Figure 2 is a flow chart of a message sending method provided by an embodiment of this specification; Figure 3 is an embodiment of this specification. Figure 4 is a schematic diagram of various virtual objects provided in an embodiment of this specification; Figure 5 is a schematic diagram of a business application provided by an embodiment of this specification; Figure 6 is an embodiment of this specification The hardware structure diagram of the message sending device provided; FIG. 7 is a schematic diagram of the module of the message sending device provided in an embodiment of this specification.

Here, exemplary embodiments will be described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with this specification. On the contrary, they are only examples of devices and methods consistent with some aspects of this specification as detailed in the scope of the appended application.

The terms used in this specification are only for describing specific embodiments Purpose, not to limit this description. The singular forms of "a", "the" and "the" used in this specification and the scope of the appended application are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and/or" as used herein refers to and includes any or all possible combinations of one or more associated listed items.

It should be understood that although the terms first, second, and third may be used in this specification to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this specification, the first information can also be referred to as second information, and similarly, the second information can also be referred to as first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to certainty".

This manual aims to propose an AR message based on AR (Augmented Reality, augmented virtual reality technology) and apply the AR message to social networks. For example, it can be applied to IM (Instant Messaging). By combining the augmented virtual reality technology and social information, the social information can be displayed in the form of augmented virtual reality information, thereby enhancing the interest of the social information. On the other hand, it also provides a new interactive way of business content, that is, through the access of augmented virtual reality information, so that the receiver can quickly enter the corresponding business content based on the augmented virtual reality information, thereby participating in the business content. interactive.

The following describes the message sending scheme provided in this manual.

Figure 1a shows an exemplary system architecture concept that can be applied in this article.

In the conceptual diagram of the system architecture 100, various network nodes can communicate information through the network, and then complete the interaction and data processing. The system architecture conceptual diagram 100 may include an operating server 105 that communicates data with one or more augmented virtual reality clients 106 via a network 112, and data that can be integrated in the operating server 105 or independent of the operating server 105 Library 115. The operation server 105 can correspond to the service platform of a social network or a service platform of a payment network. In some cases, such as a network that completes payment through the integration of social networks, such social networks can be integrated. Platform and payment network platform.

Each network 112 may include a wired or wireless telecommunication device, and the network device on which the augmented virtual reality client 106 is based may exchange data via the wired or wireless telecommunication device. For example, each network 112 may include a local area network ("LAN"), wide area network ("WAN"), intranet, internet, mobile phone network, virtual private network (VPN), cellular or Other mobile communication networks, Bluetooth, NFC or any combination thereof. In the discussion of the exemplary embodiments, it should be understood that the terms "data" and "information" can be used interchangeably herein to refer to text, images, audio, video, or any other form that can exist in a computer-based environment. News.

The network device on which each augmented virtual reality client 106 is based may include a device having a communication module capable of sending and receiving data via the network 112. For example, the network devices on which each augmented virtual reality client 106 is based can include servers, desktop computers, laptops, tablets, smartphones, palmtop computers, personal digital assistants ("PDAs "), or any other wired or wireless processor-driven device. In the exemplary embodiment depicted in FIG. 1a, the network device on which the augmented virtual reality client 106 is based can be respectively an end user or consumer, a possible counterparty user, and a publisher of a social network system, And the operator who is waiting for payment performs the operation.

Users (including individuals or organizations) can use applications such as web browser applications or stand-alone applications to view, download, upload or otherwise access files or web pages via the network 112. The network includes wired or wireless telecommunication systems or devices, and network devices (including the devices 105 and 106) can exchange data through the wired or wireless telecommunication devices. For example, the network 112 may include a local area network ("LAN"), a wide area network ("WAN"), an intranet, the Internet, a storage area network (SAN), a personal area network (PAN), and a metropolitan area network. MAN, wireless local area network (WLAN), virtual private network (VPN), cellular or other mobile communication network, Bluetooth, NFC, or any combination thereof, or those that contribute to signal, data and/or information Any other appropriate architecture or system for communication. In the discussion of the exemplary embodiments, it should be understood that the terms "data" and "information" can be used interchangeably herein to refer to text, images, audio, video, or any other form that can exist in a computer-based environment. News.

A web browser application or a standalone application can interact with a web server (or other servers, such as social platforms, payment platforms, etc.) connected to the network 112.

The network device on which each augmented virtual reality client 106 is based can be incorporated into the digital wallet application module through software or hardware or even a combination of software and hardware. Digital wallet can cover augmented virtual reality client 106 Any application, hardware, software or process used to help augment the virtual reality client to complete the purchase transaction. The digital wallet can be separated from the web browser application, can interact with it, or can be implemented as a companion application. As a companion application, the digital wallet is executed within the web browser application. In other words, a digital wallet can be an application embedded in a web browser application. If the digital wallet is separate from the web browser application, the digital wallet can access the network 112 via any available communication technology.

The augmented virtual reality client 106 can provide or obtain one or more contact applications according to the carried user information. The contact application can be any program or application on the augmented virtual reality client 106 that maintains a list of user contacts accessible to the social network. Examples of contact applications can include, but are not limited to, email applications, text messaging applications, instant messaging, calendar invitation lists, or contact databases such as OUTLOOK or ACT, or social software friends (or classified friends, strangers) , Pull black, etc.) Provide programs/interfaces/lists/lists, which can include online, offline, invisible, busy, and even managed status. The contacts in the contact application can be prioritized by various factors, such as the communication frequency with the augmented virtual reality client 106 carrying the user, the social relationship, and the contact application with a specific contact. The number of programs, or any other priority ranking factors that can be extracted from the application.

In the system architecture conceptual diagram 100, for example, in a network that completes payment through the integration of social networks, such social network platforms and support can be integrated. Pay online platform. Then the server 105 can have the function of a server in a social network. The social network server 105 at this time may represent a computer-implemented system, and the social network system uses the system to host social networking sites and all profiles and communities that use the social networking sites. A social networking site can represent any web-based community that allows users to interact via the Internet with other users who usually have common interests or relationships. The augmented virtual reality client 106 can join or interact with instances of social networking sites.

The social network server 105 may provide the augmented virtual reality client 106 with a list of members of the online community of the user. The social network system may prioritize the relationship between each community member and the user to which the augmented virtual reality client 106 belongs. This can be determined by factors that can be applied to the structure of each particular social network system. For example, a social network system such as FACEBOOK can classify members of a community as "friends" or "friends of friends", and LINKEDIN can classify members as first-level contacts, second-level contacts, or third-level contacts people.

The social networking system server 105 can communicate with the augmented virtual reality client 106 via any available technology. These technologies may include, but are not limited to, Internet connection via the network 112, e-mail, text messaging, instant messaging, or other appropriate communication technologies. The social network system may include a data storage unit 115 accessible by the social network server 105. The data storage unit 115 may include one or more tangible computer-readable storage devices.

In the system architecture conceptual diagram 100, for example, in a network that completes payment through the integration of social networks, such social network platforms and support can be integrated. Pay online platform. Then the server 105 can have the function of a server in the payment network. The payment network server 105 at this time may represent a computer-implemented system, and the payment network system uses the system to host the payment platform and the storage of all configuration files and relationship data and payment data of the payment platform. A payment website can represent any web-based community that allows users to interact via the Internet with users that usually have common payment/purchase/follow/favorites.

Different AR clients can be counterparties to each other. Any one of the counterparties can represent an individual or an organization. The data/relationships involved in the transaction/payment process at this time or the processing performed may need to be obtained from the connected database 115, the data/relationships involved in the transaction/payment process that need to be written or the data connected by the processing result Library 115.

In Figure 1a, the operating server 105 can be an integrated or separate computer device 103, especially in the latter case, it can generally be connected via an internal network or a private network, or can also be connected via an encrypted public network connection. In particular, when it is an integrated relationship, it is possible to adopt a more efficient and faster transmission rate internal bus connection. The computer device 103 can access the database 115 directly (not shown in the figure) or through the operating server 105 when it is in an integrated relationship or a separate relationship.

By appropriately programming the computer device 103, the implementation of the method in this application can be controlled by such instructions. In particular, when it is an integration relationship, the transaction processed by the computer device 103 can be regarded as the processing of the operating server 105 without any special distinction.

Figure 1b shows the system architecture in separate social networks and payment networks Structure. The conceptual diagram of the system architecture 101 can include operational servers 107 and 109 that communicate with one or more augmented virtual reality clients 106 via the network 112, and can be integrated into the operational server 107 or independent of the operational server 107 The computing environment 108, and the computing environment 110 that can be integrated in the operating server 109 or independent of the operating server 109. In one example, the operation server 107 may correspond to a service platform of a social network, and the operation server 109 may correspond to a service platform of a payment network. The corresponding database 117 can provide or store required social network data and computing data; the corresponding database 118 can provide or store required payment network data and computing data. Other attributes are similar to the above description corresponding to FIG. 1a, and will not be repeated.

With reference to the example shown in Figure 2, Figure 2 is a message sending method provided in this specification. This method can be applied to augmented virtual reality clients. The method can include the following steps:

Step 210: Based on the augmented virtual reality technology, display a preset virtual object in the real scene image.

Step 220: Obtain at least one receiver determined by the sender.

Step 230: Send the virtual object to the receiver in the form of augmented virtual reality messages; wherein the sender and receiver are users on a social platform.

The aforementioned augmented virtual reality technology is a technology that calculates the position and angle of a real image and adds the corresponding virtual image. The virtual image may include images, movies, 3D models, and so on.

The aforementioned augmented virtual reality client refers to client software developed based on augmented virtual reality technology or integrated with augmented virtual reality functions; For example, the above-mentioned augmented virtual reality client may be a social app that integrates augmented virtual reality service functions; the above-mentioned augmented virtual reality client is used to scan images of real scenes in an offline environment, and The scanned image data is transmitted to the augmented virtual reality server in real time; and, through the augmented virtual reality engine at the front end of the augmented virtual reality client, the virtual data pushed by the augmented virtual reality server in the background Perform visual rendering and superimpose and merge it with the scanned image data of the real scene (such as real-life images).

In one embodiment, the step 210 specifically includes: when the controller that sends the augmented virtual reality message under the current application is triggered, based on the augmented virtual reality technology, displaying the corresponding current application in the real scene image The default virtual object.

Wherein, the controller may include a button, a specific voice, a specific biometric identification, etc.

Take a button as an example to illustrate. The schematic diagram of sending an augmented virtual reality message shown in Fig. 3 is taken as an example. The user can click the "AR message" button to trigger the process of sending the augmented virtual reality message. The process may include: the augmented virtual reality client activates a photographing device (such as a lens) to display the real scene image captured by the photographing device; and displaying a preset virtual object in the real scene image.

Explain with a specific voice, for example, the voice that triggers the sending of the augmented virtual reality message is "I want to send an AR message"; when the user says "I want to send an AR message", it can trigger the sending of the augmented virtual reality message Process.

The specific biometric identification may include a fingerprint, and the virtual The terminal where the virtual reality client is located needs to have fingerprint recognition hardware. When the user presses the fingerprint on the fingerprint module, the process of sending the augmented virtual reality message can be triggered.

In one embodiment, the virtual object may be cached locally by the augmented virtual reality client in advance, that is, the virtual object may be obtained locally and displayed in the real scene image.

In an embodiment, the virtual object may be temporarily obtained by the augmented virtual reality client from the augmented virtual reality server. Specifically, it may include: sending a virtual object acquisition request to the augmented virtual reality server; displaying the virtual object returned by the augmented virtual reality server in the real scene image.

The aforementioned augmented virtual reality server includes a server, a server cluster, or a cloud platform based on the server cluster that provides services to the aforementioned augmented virtual reality client; for example, the aforementioned augmented virtual reality The server side can be a social platform that provides docking services to social apps that integrate augmented virtual reality service functions. The above-mentioned augmented virtual reality server is used for the augmented virtual reality engine based on the background, and responds to the virtual object acquisition request sent by the above-mentioned augmented virtual reality client, which will conform to the current application of the augmented virtual reality client. Returns the virtual object to the augmented virtual reality client.

In one embodiment, when there are a plurality of preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes: displaying at least one preset virtual object confirmed by the user in the real scene image.

Please refer to the schematic diagram of various virtual objects shown in FIG. 4. When there are multiple preset virtual objects, the augmented virtual reality client can display these virtual objects at the same time for the user to select. The user can select at least one desired virtual object from them. As shown in FIG. 4, the user selects the virtual object 4 as the virtual object that needs to be displayed finally; in this way, the augmented virtual reality client can finally display the virtual object 4 in the real scene image.

In an embodiment, the augmented virtual reality technology is a native augmented virtual reality technology of the terminal operating system.

The operating system (OS for short, or computer management control program) can be a computer program that manages and controls terminal hardware and software resources, and is the most basic system software that runs directly on the terminal, any other Both software and applications must be allowed under the support of the operating system. Typical operating systems are: Android phones (such as Huawei phones, Xiaomi phones, Samsung phones, etc.), the IOS system of Apple phones, and the Windows Phone system of Microsoft phones.

Generally, the native augmented virtual reality functions of the operating system are more abundant than those provided by third-party vendors. For example, WebAR (Web Augmented Reality) can also be used as a carrier of information display. When the experience of WebAR is not as good as native AR (NativeAR), including WebAR does not have the recognition and tracking mode of native AR.

Based on the native augmented virtual reality technology, the interaction between users and AR objects can be realized.

Specifically, based on the identification and tracking technology provided by the native enhanced display technology, when the user’s interactive operation is obtained, the corresponding Dynamic model to adjust the shape of the virtual object.

The user can swipe left and right to rotate the virtual object by touching it. Virtual objects can be rotated 360 degrees dynamically.

The embodiments of this specification can be applied in different applications. Take Alipay’s Ant Forest as an example. As shown in Figure 5, users can invite friends to help water in the form of AR messages in the Ant Forest. Interact with friends through such AR messages.

In an embodiment, the augmented virtual reality message also carries an application identifier and a status identifier; the application identifier indicates the application currently opened by the augmented virtual reality client, and the status identifier It is used to control the interface state displayed after the recipient enters the application program corresponding to the application program identifier.

In this embodiment, parameters can be transferred by augmenting the virtual reality message, that is, the application ID and the status ID. Through the application identifier, the receiver can enter the same application as the sender. Generally speaking, after a user enters an application, the home page is displayed by default. According to the status indicator, the receiver can have a different interface state when entering the same application as the sender. Still taking the ant forest application in Alipay as an example, when the sender invites the receiver to water, an AR message can be sent, and the AR message can carry the application identifier representing the ant forest and the watering status identifier; so, receive After clicking on the AR message sent by the sender, the party can also enter the Ant Forest application, and the display interface can be the interface of the sender's sapling, which can water the sender's sapling.

The embodiment of this specification provides a message sending scheme, by combining The combination of AR technology and social messages enables social messages to be displayed in the form of AR messages, which can enhance the interest of social messages. On the other hand, it also provides a new way to interact with business content, that is, through the reach of AR messages, so that the receiver can quickly enter the corresponding business content based on the AR message, thereby participating in the interaction of the business content.

Corresponding to the foregoing message sending method embodiment, this specification also provides an embodiment of a message sending device. The device embodiments can be implemented by software, or can be implemented by hardware or a combination of software and hardware. Taking software implementation as an example, as a logical device, it is formed by reading the corresponding computer business program instructions in the non-volatile memory into the memory through the processor of the device where it is located. From the perspective of hardware, as shown in Figure 6, it is a hardware structure diagram of the device where the message sending device is located in this manual, except for the processor, network interface, memory, and non-volatile memory shown in Figure 6. In addition, the device where the device is located in the embodiment usually sends the actual function according to the message, and may also include other hardware, which will not be repeated here.

Please refer to FIG. 7, which is a module diagram of a message sending device provided in an embodiment of this specification. The device corresponds to the embodiment shown in FIG. 2. The device includes a display unit 410, based on augmented virtual reality technology, Display a preset virtual object in the real scene image; the acquiring unit 420 acquires at least one recipient determined by the sender; the sending unit 430 sends the virtual object to the recipient in the form of augmented virtual reality messages; Wherein, the sender and receiver are users on a social platform.

Optionally, the display unit 410 specifically includes: when the controller that sends the augmented virtual reality message under the current application is triggered, based on the augmented virtual reality technology, display the corresponding preview of the current application in the real scene image. Set virtual objects.

Optionally, the display unit 410 specifically includes: an acquisition subunit, which sends a virtual object acquisition request to the augmented virtual reality server; and a display subunit, which displays the augmented virtual reality server in the real scene image The returned virtual object.

Optionally, when there are multiple preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes: displaying at least one preset virtual object confirmed by the user in the real scene image.

Optionally, the augmented virtual reality technology is a native augmented virtual reality function of the terminal operating system.

Optionally, the device includes: an interactive sub-unit, based on the recognition and tracking technology provided by the native enhanced display technology, when the user's interactive operation is obtained, the virtual object is adjusted according to the dynamic model corresponding to the interactive operation form.

Optionally, the augmented virtual reality message also carries an application program identifier and a status identifier; the application program identifier indicates the application program currently opened by the augmented virtual reality client, and the status identifier is used for control The interface state displayed after the recipient enters the application program corresponding to the application program identifier.

The systems, devices, modules, or units explained in the above embodiments may be implemented by computer chips or entities, or implemented by products with certain functions. A typical implementation device is a computer. The specific form of the computer can be a personal computer, a laptop computer, a mobile phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email receiving and sending device, and a game control A console, a tablet, a wearable device, or a combination of any of these devices.

For the implementation process of the functions and roles of each unit in the above-mentioned device, refer to the implementation process of the corresponding steps in the above-mentioned method for details, which will not be repeated here.

For the device embodiment, since it basically corresponds to the method embodiment, the relevant part can refer to the part of the description of the method embodiment. The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution in this specification. Those of ordinary skill in the art can understand and implement it without creative work.

Figure 7 above depicts the internal functional modules and structural diagrams of the data aggregation device. Its substantial execution body may be an electronic device, including: a processor; a memory used to store executable instructions for the processor; wherein the The processor is configured to display a preset virtual reality in the real image based on the augmented virtual reality technology. Pseudo-object; obtain at least one recipient determined by the sender; send the virtual object to the recipient in the form of augmented virtual reality messages; wherein the sender and the recipient are users in a social platform.

Optionally, based on the augmented virtual reality technology, display the preset virtual objects under the current application, specifically including: when the controller that sends the augmented virtual reality message under the current application is triggered, based on the augmented virtual reality technology , Displaying the preset virtual object corresponding to the current application in the real scene image.

Optionally, the displaying the preset virtual object in the real scene image based on the augmented virtual reality technology specifically includes: sending an acquisition request of the virtual object to the augmented virtual reality server; and displaying the virtual object in the real scene image Amplify the virtual objects returned by the virtual reality server.

Optionally, when there are multiple preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes: displaying at least one preset virtual object confirmed by the user in the real scene image.

Optionally, the augmented virtual reality technology is a native augmented virtual reality function of the terminal operating system.

Optionally, it further includes: based on the recognition and tracking technology provided by the native enhanced display technology, when the user's interactive operation is obtained, the dynamic mode corresponding to the interactive operation is obtained. Type to adjust the shape of the virtual object.

Optionally, the augmented virtual reality message also carries an application program identifier and a status identifier; the application program identifier indicates the application program currently opened by the augmented virtual reality client, and the status identifier is used for control The interface state displayed after the recipient enters the application program corresponding to the application program identifier.

In the above embodiment of the electronic device, it should be understood that the processor may be a central processing unit (English: Central Processing Unit, CPU for short), other general-purpose processors, or digital signal processors (English: Digital Signal Processor). , Referred to as: DSP), special integrated circuit (English: Application Specific Integrated Circuit, referred to as ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc., and the aforementioned memory can be read-only memory (English: read-only memory, abbreviation: ROM), random access memory Body (English: random access memory, abbreviated as: RAM), flash memory, hard disk or solid state drive. The steps of the method disclosed in the embodiments of the present invention can be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the electronic device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment.

Those skilled in the art will easily think of other embodiments of this specification after considering the specification and practicing the invention disclosed herein. This specification is intended to cover any variations, uses, or adaptive changes of this specification, which follow the general principles of this specification and include common knowledge or customary technical means in the technical field that are not disclosed in this specification . The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the specification are pointed out by the following patent scope.

It should be understood that this specification is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of this specification is only limited by the scope of the attached patent application.

Claims (13)

A message sending method applied to an augmented virtual reality client, the method comprising: displaying a preset virtual object in a real scene image based on the augmented virtual reality technology; acquiring at least two receivers determined by the sender; The virtual object is sent to the at least two receivers in the form of an augmented virtual reality message; wherein the sender and the receiver are users on a social platform; the augmented virtual reality message also carries There are application identifiers and status identifiers; the application identifier represents the application currently opened by the augmented virtual reality client, and the status identifier is used to control each recipient to enter the application corresponding to the application identifier and then display The interface status; so that after clicking on the augmented virtual reality message, each recipient enters the same application as the sender according to the application identifier and then displays the corresponding interface status according to the status identifier, And based on the augmented virtual reality technology, the virtual object determined by the sender is displayed in the real scene image of each receiver. For example, the method described in item 1 of the scope of patent application, based on the augmented virtual reality technology, displays the preset virtual objects under the current application, specifically including: the controller that sends the augmented virtual reality message under the current application is When triggered, based on the augmented virtual reality technology, the preset virtual object corresponding to the current application program is displayed in the real scene image. For example, the method described in item 1 of the scope of patent application, based on the augmented virtual reality technology, displaying a preset virtual object in the real scene image specifically includes: sending a virtual object acquisition request to the augmented virtual reality server ; Display the virtual object returned by the augmented virtual reality server in the real scene image. As in the method described in item 1 of the scope of patent application, when there are multiple preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes: displaying in the real scene image at least one preset confirmed by the user Set virtual objects. According to the method described in item 1 of the scope of patent application, the augmented virtual reality technology is a native augmented virtual reality function of the terminal operating system. As the method described in item 5 of the scope of patent application, the method further includes: based on the recognition tracking technology provided by the native enhanced display technology, when the user's interactive operation is obtained, the adjustment is adjusted according to the dynamic model corresponding to the interactive operation The form of the virtual object. A message sending device, the device comprising: a display unit that displays a preset virtual object in a real scene image based on augmented virtual reality technology; an acquisition unit that acquires at least two receivers determined by the sender; and a sending unit The virtual object is sent to the at least two recipients in the form of an augmented virtual reality message; so that after each recipient clicks on the augmented virtual reality message, the augmented virtual reality technology is used in each The virtual objects determined by the sender are displayed in the real scene images of the receivers; wherein, the sender and the receiver are users in a social platform; the augmented virtual reality message also carries an application program identifier and a status identifier The application program identifier represents the currently opened application program of the augmented virtual reality client, and the state identifier is used to control the interface state displayed after each recipient enters the application program corresponding to the application program identifier; After the receiver clicks on the augmented virtual reality message, enters the same application as the sender according to the application identifier, and then displays the corresponding interface state according to the status identifier, and based on the augmented virtual reality The technology displays the virtual object determined by the sender in the real scene image of the receiver. For the device described in item 7 of the scope of patent application, the display unit specifically includes: when the controller that sends the augmented virtual reality message under the current application is triggered, based on the augmented virtual reality technology, the display unit The default virtual object corresponding to the current application is displayed in. For the device described in item 7 of the scope of patent application, the display unit specifically includes: an acquisition subunit, which sends a virtual object acquisition request to the augmented virtual reality server; and a display subunit, which displays the Amplify the virtual objects returned by the virtual reality server. For the device described in item 7 of the scope of patent application, when there are multiple preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes: displaying at least one preset confirmed by the user in the real scene image Set virtual objects. For the device described in item 7 of the scope of patent application, the augmented virtual reality technology is a native augmented virtual reality function of the terminal operating system. As the device described in item 11 of the scope of patent application, the device further includes: an interactive subunit, based on the identification and tracking technology provided by the native enhanced display technology, when the user's interactive operation is obtained, the corresponding interactive operation The dynamic model adjusts the shape of the virtual object. An electronic device including: A processor; a memory used to store executable instructions for the processor; wherein the processor is configured as the method described in any one of items 1-6 in the scope of the aforementioned patent application.

Images