WO2023241093A1 - 一种富媒体消息交互的方法、客户端、云设备及通信系统 - Google Patents

一种富媒体消息交互的方法、客户端、云设备及通信系统 Download PDF

Info

Publication number
WO2023241093A1
WO2023241093A1 PCT/CN2023/078333 CN2023078333W WO2023241093A1 WO 2023241093 A1 WO2023241093 A1 WO 2023241093A1 CN 2023078333 W CN2023078333 W CN 2023078333W WO 2023241093 A1 WO2023241093 A1 WO 2023241093A1
Authority
WO
WIPO (PCT)
Prior art keywords
target applet
information
rich media
applet
media message
Prior art date
Application number
PCT/CN2023/078333
Other languages
English (en)
French (fr)
Inventor
高亮
张萌
孟丽娜
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023241093A1 publication Critical patent/WO2023241093A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]

Definitions

  • This application relates to the field of communication technology, and specifically relates to a rich media message interaction method, client, cloud device and communication system.
  • service providers can interact with users in the form of chatbots through message centers and Messaging as a Platform (MaaP).
  • the service provider's Chatbot can send messages to users in a point-to-point manner or in a group manner. Users can directly reply to messages to the Chatbot, or users can also actively send messages to the Chatbot.
  • This application provides a method for rich media message interaction, which is used to obtain mini program services in a rich media message interaction application with simple operations.
  • This application also provides corresponding clients, cloud equipment, communication systems, computer-readable storage media, and computer program products.
  • a first aspect of this application provides a method for interacting with rich media messages, including: a client sending a first rich media message to a cloud device, where the first rich media message includes the user's intention information; and the client receiving a second message from the cloud device.
  • Rich media message the second rich media message includes the information of the target applet.
  • the information of the target applet is determined by the cloud device based on the intention information.
  • the target applet is used by the user to execute the intention indicated by the intention information; the client determines the target applet based on the intention information.
  • the information is displayed on the description page of the target applet.
  • the client can be an information application installed on the terminal device, such as a short message application. When the client is running, it can complete message interaction with the cloud device through the hardware of the terminal device.
  • the client can also be a terminal device, such as a mobile phone, a phone watch, a tablet, a computer, and other devices that can interact with rich media messages.
  • the first rich media message and the second rich media message may be short messages or other instant messaging rich media messages.
  • the user's intention information refers to the user's intention or purpose that triggers the client to send the first rich media message, such as: purchasing tickets, participating in surveys, user registration, payment, etc.
  • a small program is usually a rich communications service (RCS) program in which a service provider provides one or more services to users.
  • RCS rich communications service
  • the chatbots of these mini programs interact with users through rich media messages.
  • the rich media messages that users interact with the chatbots of these service providers can also be called industry messages.
  • the target applet can be any kind of applet. The user determines the corresponding category when preparing to send the first rich media message to determine the recipient. type of applet.
  • the target applet can be any of the applets provided by the recipient's background cloud device.
  • the client after the client obtains the information of the target applet from the second rich media message, it can display the target applet.
  • the target applet will contain a lot of content, and the description of the target applet will usually be displayed. page, users can use the target applet by clicking on the description page.
  • the client only needs to interact with the cloud device once for rich media messages to obtain the target applet that can execute the user's intention, and then operate the target applet to complete the corresponding intention.
  • the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • the second rich media message also includes rich media message type information, and the rich media message type information is used to indicate that the second rich media message is an applet message; the method also includes: client The terminal parses the information of the target applet from the target field in the second rich media message according to the rich media message type information.
  • the rich media message type information in the second rich media message may be an identifier such as "miniapp" or other identifiers that can indicate that the second rich media message is a mini program message.
  • the client After the client recognizes the rich media message type information, it can determine that the second rich media message is an applet message.
  • Each type of rich media message can carry the information to be parsed by the client in the corresponding field.
  • the client can The information of the target applet is parsed on the target field corresponding to the applet type, thereby improving the speed of obtaining the information of the target applet.
  • the information of the target applet includes page display information; the description page of the target applet includes page display information, as well as the operation entrance of the target applet, the operation entrance of the target applet and the target The applet engine interface association of the applet.
  • the information of the target applet can include page display information and non-page display information.
  • the page display information refers to the information that will be displayed by the client.
  • the page display information can be configured in advance for the target applet. Copywriting, among others, may include at least one of text, pictures, audio or video.
  • the client will display the description page of the target applet.
  • the description page can contain all the content of the page display information, or it can only contain part of the page display information.
  • the description page can also contain the content determined by the client.
  • Other information that needs to be displayed on the description page such as the operation entrance of the target applet.
  • the operation entrance of the target applet can also be understood as the access link of the target applet. Through the operation entrance, the target applet can be used to execute the corresponding user intention.
  • the description page of the target applet may be in the form of a rich media card.
  • the rich media card refers to displaying the access link of the target applet in the form of a card, as well as at least one type of text, picture, audio or video. information.
  • non-page display information refers to information that the client does not need to display. This information can be used by the client to run the target applet.
  • the mini program engine interface refers to the interface used to call the engine of the mini program.
  • the engine of the mini program can be a plug-in (code package). The plug-in can be automatically configured to the client when the client version is upgraded.
  • the operation entrance of the target applet is displayed on the description page of the target applet, which can facilitate the user to use the target applet to complete the corresponding intention.
  • the information about the target applet also includes an identifier of the target applet.
  • the information about the target applet also includes the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, the application package of the target applet , or at least one of the latest version number of the target applet.
  • the non-page display information will include the identifier of the target applet, and the identifier of the target applet can be used as an index for other information of the target applet.
  • the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, the application package of the target applet, or the latest version number of the target applet can be sent by the cloud device in the second rich media message Sent to the client, it can also be found by the client through the identifier of the target applet. If the information of the target applet includes one or more of the above information, the client can quickly run the application package of the target applet.
  • the method further includes: in response to the user's operation on the operation entrance of the target applet, the client obtains the application package of the target applet; the client calls the applet engine interface to Run the application package of the target applet; the client displays the operation page of the target applet.
  • the client obtains the application package of the target applet, including: the client obtains the application package of the target applet from the information of the target applet.
  • the client can call the applet engine interface to run the applet after receiving the user's operation on the operation entrance of the target applet.
  • the application package of the target applet displays the operation page of the target applet.
  • the operation page of the target applet refers to the page where the user can input information to complete the corresponding intention.
  • This method can directly run the application package of the target applet included in the information of the target applet, thereby saving the time of searching for the application package of the target applet.
  • the client obtains the application package of the target applet, including: the client obtains the application package of the target applet according to the identification of the target applet in the information of the target applet.
  • the client can use the identification of the target applet in the information of the target applet to obtain the application package of the target applet. In this way, there is no need to carry the application package of the target applet in the second rich media message. Reduce the byte length of the second rich media message and improve the transmission efficiency of the second rich media message.
  • the client obtains the application package of the target applet, including: the client obtains the application package of the target applet according to the download address included in the information of the target applet.
  • the client can directly use the download address to download the application package of the target applet. There is no need to search for the download address through the target applet's identification, thus speeding up the downloading speed of the target applet's application package.
  • the client obtains the application package of the target applet according to the identification of the target applet, including: the client queries the local storage space according to the identification of the target applet; if the target applet The application package of the program is stored in the local storage space, and the client obtains the application package of the target applet from the local storage space.
  • the client can use the identifier of the target applet to directly find the application package of the target applet from the local storage space. Search the local storage space to quickly obtain the application package of the target applet.
  • the above steps if the application package of the target applet is stored in the local storage space, the client obtains the application package of the target applet from the local storage space, including: if the local storage space The version number of the application package of the target applet stored in is the same as the latest version number, then the client obtains the application package of the target applet from the local storage space.
  • the client can determine whether the application package of the target applet is the latest version stored in the local storage space by comparing the version number. If it is the latest version, the client can obtain the application package of the target applet from the local storage space. In this way, the client can be run to the latest version of the application package of the target applet.
  • the client obtains the application package of the target applet according to the identification of the target applet, including: the client determines the application package of the target applet according to the identification of the target applet. Download address; the client obtains the application package of the target applet based on the download address.
  • the client can determine the corresponding download address according to the identification of the target applet, and download the application package of the target applet from the download address.
  • the description page of the target applet also includes a first prompt button and a second prompt button.
  • the first prompt button is used to instruct to obtain the application package of the target applet.
  • the second prompt button It is used to indicate not to obtain the application package of the target applet, where the first prompt button is the operation entrance of the target applet.
  • the client does not allow the application package of the target applet to be downloaded by default, then when the description page of the target applet is displayed, the first prompt button and the second prompt button will be displayed on the description page. If the user clicks the first prompt button, the client can obtain and run the application package of the target applet, and then display the operation page of the target applet.
  • a second aspect of the present application provides a method for interacting with rich media messages, including: a cloud device receiving a first rich media message sent by a client, where the first rich media message includes the user's intention information; and the cloud device determines a target message corresponding to the intention information. information of the program; the cloud device sends a second rich media message to the client, the second rich media message includes information of the target applet, and the target applet is used by the user to execute the intention indicated by the intention information.
  • the cloud device determines the corresponding target applet after identifying the intent information, and then sends a second rich media message to the client.
  • the client obtains the information of the target applet from the second rich media message and can display the target applet.
  • Mini program, the target mini program will contain more content, and the description page of the target mini program will usually be displayed.
  • the user can use the target mini program by clicking on the description page.
  • the client only needs to interact with the cloud device once for rich media messages to obtain the target applet that can execute the user's intention, and then operate the target applet to complete the corresponding intention.
  • the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • the cloud device determines the information of the target applet corresponding to the intention information, including: the cloud device performs semantic recognition on the intention information to obtain target key information used to represent the intention information; the cloud device The device determines the information of the target applet corresponding to the target key information based on the correspondence between the key information and the information of the applet.
  • the cloud device can perform semantic recognition on the intent information in the first rich media message through text recognition technology or semantic recognition technology, thereby obtaining the target key information in the intent information.
  • the key information may be keywords, or information summarized by one or more keywords, which may be words or phrases.
  • the target key information refers to the keywords extracted from the intended information through semantic recognition, or words or phrases that can express the intended information summarized by one or more keywords.
  • the cloud device or other mini program management device can maintain the correspondence between the key information and the mini program's information. In this way, after the cloud device identifies the target key information, it can determine the target key from the correspondence between the key information and the mini program's information. Information about the target applet corresponding to the information. If after identifying the intent information, it is determined that different keywords in the intent information can correspond to different mini programs, you can compare the weights The most important way is to determine the keywords that best match the intent information, thereby determining the information of the target applet.
  • the second rich media message further includes rich media message type information, and the rich media message type information is used to indicate that the second rich media message is an applet message.
  • the information of the target applet includes page display information.
  • the information about the target applet also includes an identifier of the target applet.
  • the information about the target applet also includes the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, the application package of the target applet , or at least one of the latest version number of the target applet.
  • the third aspect of this application provides a method for rich media message interaction, including: the client sends a first rich media message to the cloud device, where the first rich media message includes the user's intention information; the cloud device determines the target applet corresponding to the intention information information; the cloud device sends a second rich media message to the client.
  • the second rich media message includes the information of the target applet.
  • the target applet is used by the user to execute the intention indicated by the intention information.
  • the client displays the information according to the information of the target applet. The description page of the target applet.
  • the second rich media message also includes rich media message type information, and the rich media message type information is used to indicate that the second rich media message is an applet message; the method also includes: client The terminal parses the information of the target applet from the target field in the second rich media message according to the rich media message type information.
  • the information of the target applet includes page display information; the description page of the target applet includes page display information, as well as the operation entrance of the target applet, the operation entrance of the target applet and the target The applet engine interface association of the applet.
  • the information about the target applet also includes an identifier of the target applet.
  • the information about the target applet also includes the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, the application package of the target applet , or at least one of the latest version number of the target applet.
  • the method also includes: in response to the user's operation on the operation entrance of the target applet, the client obtains the application package of the target applet; the client calls the applet engine interface to Run the application package of the target applet; the client displays the operation page of the target applet.
  • the client obtains the application package of the target applet, including: the client obtains the application package of the target applet from the information of the target applet.
  • the client obtains the application package of the target applet, including: the client obtains the application package of the target applet according to the identification of the target applet in the information of the target applet.
  • the client obtains the application package of the target applet, including: the client obtains the application package of the target applet according to the download address included in the information of the target applet.
  • the client obtains the application package of the target applet according to the identification of the target applet, including: the client queries the local storage space according to the identification of the target applet; if the target applet The application package of the program is stored in the local storage space, and the client obtains the application package of the target applet from the local storage space.
  • the above steps if the application package of the target applet is stored in the local storage space, obtain the application package of the target applet from the local storage space, including: if the application package of the target applet is stored in the local storage space If the version number of the application package of the target applet is the same as the latest version number, the application package of the target applet is obtained from the local storage space.
  • the client obtains the application package of the target applet according to the identification of the target applet, including: the client determines the application package of the target applet according to the identification of the target applet. Download address; the client obtains the application package of the target applet based on the download address.
  • the description page of the target applet also includes a first prompt button and a second prompt button.
  • the first prompt button is used to instruct to obtain the application package of the target applet.
  • the second prompt button It is used to indicate not to obtain the application package of the target applet, where the first prompt button is the operation entrance of the target applet.
  • the first rich media message and the second rich media message are short messages.
  • a fourth aspect of this application provides a client for executing the method in the above first aspect or any possible implementation of the first aspect.
  • the client includes modules or units for performing the method in the above-mentioned first aspect or any possible implementation of the first aspect, such as: a display unit, a sending unit and a receiving unit.
  • a fifth aspect of this application provides a cloud device for executing the method in the above second aspect or any possible implementation of the second aspect.
  • the cloud device includes modules or units for performing the method in the above-mentioned second aspect or any possible implementation of the second aspect, such as: a receiving unit, a processing unit, and a sending unit.
  • the sixth aspect of this application provides a client, including a transceiver, a processor and a memory.
  • the transceiver and the processor are coupled to the memory.
  • the memory is used to store programs or instructions.
  • the client executes the method in the foregoing first aspect or any possible implementation of the first aspect.
  • a seventh aspect of this application provides a cloud device.
  • the cloud device may include at least one processor, memory, and communication interface.
  • the processor is coupled to memory and communication interfaces.
  • the memory is used to store instructions
  • the processor is used to execute the instructions
  • the communication interface is used to communicate with other network elements under the control of the processor.
  • the instruction causes the processor to execute the method of the second aspect or any possible implementation of the second aspect.
  • the eighth aspect of this application provides a chip system, which includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through lines; the interface circuit is used to receive signals from the memory of the terminal device , and sends a signal to the processor, and the signal includes computer instructions stored in the memory; when the processor executes the computer instructions, the client executes the method in the aforementioned first aspect or any possible implementation of the first aspect.
  • a ninth aspect of this application provides a chip system, which includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through lines; the interface circuit is used to receive signals from the memory of the cloud device , and sends a signal to the processor, where the signal includes computer instructions stored in the memory; when the processor executes the computer instructions, the cloud device executes the method in the aforementioned second aspect or any possible implementation of the second aspect.
  • a tenth aspect of the present application provides a computer-readable storage medium on which a computer program or instructions are stored.
  • the computer program or instructions When the computer program or instructions are run on a computer, the computer is caused to execute the aforementioned first aspect or any possible method of the first aspect. Methods in the implementation.
  • An eleventh aspect of the present application provides a computer-readable storage medium on which a computer program or instructions are stored.
  • the computer program or instructions When the computer program or instructions are run on a computer, the computer can perform the aforementioned second aspect or any possibility of the second aspect. method in the implementation.
  • a twelfth aspect of the present application provides a computer program product.
  • the computer program product includes a computer program code.
  • the computer program code When executed on a computer, it causes the computer to execute the foregoing first aspect or any possible implementation of the first aspect. method in.
  • a thirteenth aspect of the present application provides a computer program product.
  • the computer program product includes a computer program code.
  • the computer program code When executed on a computer, it causes the computer to execute the aforementioned second aspect or any possible implementation of the second aspect. method in.
  • a fourteenth aspect of the present application provides a communication system.
  • the communication system includes a client and a cloud device.
  • the client is configured to execute the method in the foregoing first aspect or any possible implementation of the first aspect.
  • the cloud device uses To perform the method in the aforementioned second aspect or any possible implementation of the second aspect.
  • FIGS. 1A to 1F are schematic structural diagrams of various possible structures of the communication system provided by embodiments of the present application.
  • Figure 2A is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • Figure 2B is a schematic structural diagram of a cloud device provided by an embodiment of the present application.
  • Figure 3 is a schematic diagram of an embodiment of a rich media message interaction method provided by an embodiment of the present application.
  • Figures 4A to 4F are a series of schematic diagrams of a rich media message interaction scenario provided by embodiments of the present application.
  • FIGS. 5A to 5I are a series of schematic diagrams of another rich media message interaction scenario provided by embodiments of the present application.
  • Figure 6 is another schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • Figure 7 is another schematic structural diagram of a cloud device provided by an embodiment of the present application.
  • the embodiment of the present application provides a method for rich media message interaction, which is used to interact with rich media messages through simple operations. Obtain mini program services in your application.
  • This application also provides corresponding clients, cloud equipment, communication systems, computer-readable storage media, and computer program products. Each is explained in detail below.
  • the communication system of the embodiment of the present application includes, but is not limited to, global system for mobile communications (GSM), code division multiple access (code division multiple access, CDMA) system, wideband code division multiple access (wideband code division multiple access (WCDMA) system, general packet radio service (GPRS) system, long term evolution (LTE) system, frequency division duplex long term evolution (frequency division duplex LTE, LTE-FDD) system , time division duplex long-term evolution (time division duplex LTE, LTE-TDD) system, universal mobile telecommunications system (UMTS), other wireless applications that apply orthogonal frequency division multiplexing (OFDM) technology Communication system, fifth generation (5th generation, 5G) or new radio (new radio, NR) system.
  • GSM global system for mobile communications
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • GPRS general packet radio service
  • LTE long term evolution
  • LTE-FDD frequency division duplex long term evolution
  • the technical solution provided by this application can also be applied to future communication systems, such as the sixth generation mobile communication system.
  • the technical solution provided by this application can also be applied to device-to-device (D2D) communication, vehicle-to-everything (V2X) communication, machine-to-machine (M2M) communication, machine type Communication (machine type communication, MTC), and Internet of Things (Internet of things, IoT) communication systems or other communication systems.
  • D2D device-to-device
  • V2X vehicle-to-everything
  • M2M machine-to-machine
  • MTC machine type communication
  • IoT Internet of Things
  • Rich communication services (RCS) messages follow the rich communication convergence.07 (RCC.07) launched by the global system for mobile communication association (GSMA) Standard specification and rich media communication convergence.71 (rich communication convergence.71, RCC.71) standard specification.
  • RCS messages are an upgrade to traditional text messages.
  • GSMA RCS and related standards breaking through the traditional short messages for information.
  • MaaP platform
  • RCS messages can provide point-to-point messaging and group chat services.
  • RCS message content can also support pictures, audio, video, location, contacts and other forms.
  • RCS messaging can provide enhanced messaging services between individuals and applications, realize “message as a platform", and introduce a new message interaction mode - chat robot, which connects to the terminal through message dialogue and can be provided in the dialog box Search, discovery, interaction, payment and other services, thereby realizing interactive services between customers and end users in enterprises and other industries.
  • rich media messages may be called RCS messages and 5G messages. Rich media messages can be used between IoT devices, therefore, rich media messages can also be called 5G IoT messages. Rich media messages are messages sent through your phone’s messaging app. It can be understood that the specific naming of the message does not limit the protection scope of the embodiments of the present application. The following is unification, which is described using rich media messages.
  • Chatbot The presentation form of industry messaging applications in rich media messages, simulating human intelligent dialogue and providing users with industry messaging service functions.
  • MiniApp It is a host mobile application (or host client) that is implemented based on web technology (such as JavaScript) and does not need to be installed on the terminal device. applications running in . Among them, the host mobile application (or host client) is an application installed on the terminal device, and the host application can usually run multiple (kinds) of small programs.
  • Rich media messaging applet It is an applet that uses the rich media messaging application (or rich media messaging client) running on the terminal device (or rich media messaging terminal) as the host application (or host client) , that is to say, the rich media messaging applet is downloaded from the network side by the rich media messaging application and run directly without being installed on the terminal device. Users need to run and enter the rich media messaging applet through the rich media messaging client.
  • the applet engine built into the Rich Media Messaging application is decoupled from the Rich Media Messaging applet, such that each can be upgraded independently of the other. After the rich media message applet is run, it can interact with the server corresponding to the rich media applet to implement other business processing (such as bank card balance inquiry) and other services.
  • Rich media messaging client An application or client with rich media messaging business functions. It has a built-in applet engine. It can query the information of the rich media messaging applet from the network side, download the rich media messaging applet, run or interpret it. Execute a rich media messaging applet. For ease of understanding, the rich media messaging client is called the host client of the rich media messaging applet.
  • WebView It can be simply regarded as a browser control that can be nested on the interface. Users usually use a browser to browse web pages. WebView is an embedded browser that is embedded in native applications. Users may not even realize that they are using a browser. Traditional browsers are divided into two parts, UI (address bar, navigation bar) and browser engine. Webview is the browser engine in native applications. Webview is a visual component that serves as the visual part of the native APP. The content displayed using webview does not need to be stored locally and can be obtained directly from the server.
  • a scripting language (Javascript, JS) code running in the webview has the ability to call the native system application programming interface (API) without the limitations of traditional browser sandboxes.
  • API application programming interface
  • the client in the embodiment of the present application may be an information application installed on the terminal device, such as a short message application. When the client is running, it can complete message interaction with the cloud device through the hardware of the terminal device.
  • the client can also be a terminal device. In the following embodiment, the client is a terminal device as an example for introduction.
  • FIG. 1A is an architectural schematic diagram of a communication system provided by an embodiment of the present application.
  • the first rich media message and the second rich media message may be short messages, such as 5G short messages, or short messages of future networks.
  • the user's intention information refers to the user's purpose of triggering the first rich media message, such as: purchasing tickets, participating in surveys, user registration, payment, etc.
  • the mini program (MiniApp) in the embodiment of this application may be the rich media messaging mini program introduced in the previous terminology section.
  • These small programs are usually RCS programs that service providers provide one or more services to users. For example: “10086” mini program, "12306 Railway” mini program or “Dianping” mini program, etc.
  • the chatbot (Chatbot) installed on the background device of these mini programs can interact with users through rich media messages. Users chatbots with these service providers Interactive rich media messages can also be called industry messages.
  • the terminal device represents a digital mobile communication terminal that supports rich media message services. It is usually installed with a rich media message client, that is, the rich media message client supports the rich media message service.
  • terminal equipment is just a name, and it can also be generally called: terminal equipment, user equipment (UE), access terminal, subscriber unit, user station, mobile station, mobile station, remote station , remote terminal, mobile device, user terminal, terminal, wireless communications device, user agent or user device.
  • UE user equipment
  • the terminal device may be a device that provides voice/data to users, for example, a handheld device with wireless connection function, a vehicle-mounted device, etc.
  • some examples of terminal devices are: mobile phones, tablets, laptops, PDAs, mobile internet devices (MID), wearable devices, virtual reality (VR) devices, augmented reality devices Augmented reality (AR) equipment, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, smart grid Wireless terminals in transportation safety (transportation safety), wireless terminals in smart city (smart city), wireless terminals in smart home (smart home), cellular phones, cordless phones, session initiation protocols protocol (SIP) telephones, wireless local loop (WLL) stations, personal digital assistants (personal digital assistants, PDAs), handheld devices with wireless communications capabilities, computing devices or other processing devices connected to wireless modems, Wearable devices, terminal devices in the 5G network or terminal devices in the future evolved public land mobile communication network (public land mobile network, PLMN), etc., are not limited in the embodiment
  • the terminal device may also be a wearable device.
  • Wearable devices can also be called wearable smart devices. It is a general term for applying wearable technology to intelligently design daily wear and develop wearable devices, such as glasses, gloves, watches, clothing and shoes, etc.
  • a wearable device is a portable device that is worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are not just hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction.
  • wearable smart devices include full-featured, large-sized devices that can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses, and those that only focus on a certain type of application function and need to cooperate with other devices such as smartphones.
  • the device used to implement the functions of the terminal device may be a terminal device, or may be a device capable of supporting the terminal device to implement the function, such as a chip system or a chip, and the device may be installed in the terminal device.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the terminal device can also be called a 5G message terminal or RCS client (RCS client).
  • RCS client 5G message terminal
  • the following is unification, which is described using terminal equipment.
  • Cloud equipment can be a platform established by communication operators to connect with industry customers. It is mainly used to implement functions such as access management, authentication, and multimedia content uploading and storage of industry customers’ Chatbots and messages, so that industry customers can provide users with Messaging service in multiple media formats. Cloud devices can also support rich media messaging applet business authority authentication, that is, determining whether the terminal device is allowed to use the rich media messaging applet business. Cloud devices can be physical machines, virtual machines (VMs), or containers.
  • VMs virtual machines
  • the cloud device can be a Messaging as a Platform (MaaP) platform or an IoT message center, etc.
  • the MaaP platform can also be called a chatbot platform (Chatbot platform), and its naming does not limit the scope of protection of the embodiments of this application.
  • the following is unification, which is described using the MaaP platform.
  • the specific introduction of the MaaP platform will be explained in detail later in conjunction with Figure 1C.
  • the terminal device communicates rich media messages with the cloud device through the network.
  • the cloud device can be configured with the applet of the service provider of the cloud device.
  • the cloud device recognizes the user's intention.
  • the target applet can be determined and the information of the target applet is returned to the terminal device.
  • the cloud device can also query the target applet or information about the target applet from the applet management platform.
  • the structure of the communication system can be understood with reference to Figure 1B.
  • the communication system may include: cloud equipment, applet management platform and terminal equipment.
  • the terminal device can send the first rich media message to the cloud device through the network.
  • the cloud device recognizes the user's intention information in the first rich media message, it can obtain the target applet or the information of the target applet from the applet management platform, and then Send a second rich media message to the terminal device.
  • the mini program management platform is mainly responsible for the review, certification, release, summary and storage of rich media message mini program information, providing rich media message mini program query services for terminal devices, and processing rich media message mini program packages. for storage etc.
  • the mini program management platform can also be called a mini program management server, or a rich media mini program management server or a rich media mini program management platform. The following is unified and is described as a mini program management platform. The specific introduction to the mini program management platform will be explained in detail later with reference to Figure 1D.
  • short message server center short message server center
  • SMSC message service center
  • rich media message exchange gateway phone number mapping (E.164Number URI Mapping, ENUM) or domain name system (domain name system, DNS), security management and control system, billing support system, bootstrapping server (bootstrapping server function, BSF) and other docking.
  • phone number mapping E.164Number URI Mapping, ENUM
  • domain name system domain name system, DNS
  • security management and control system billing support system
  • billing support system bootstrapping server (bootstrapping server function, BSF) and other docking.
  • Rich media message processing function mainly processes personal messages, industry messages, enhanced call message sending and receiving, session management, message-related business function processing, etc.
  • Multimedia content storage function mainly used to store multimedia message files sent by individual users.
  • MaaP platform Connected with the rich media message center, providing industry messaging functions and carrying interactive rich media messaging services. As shown in Figure 1C, the MaaP platform can include basic functions and operational management. Among them, operation management is mainly used by operators to manage Chatbot activation, permission configuration, etc.
  • the basic functions may include the following exemplary logical function modules.
  • Chatbot directory Mainly used to summarize Chatbot data information, provide algorithm services such as matching and sorting, process Chatbot discovery requests from users, and return search results to users.
  • Chatbot information Mainly used to store Chatbot related information and process Chatbot information queries from users.
  • the relevant information may include corporate information that provides the Chatbot, such as at least one of name, trademark, business type, contact information, etc.
  • the relevant information may also include information about the Chatbot or the application itself, such as at least one of Chatbot purpose, application purpose, developer information, etc.
  • the logical function modules included in the MaaP platform can be deployed independently or combined, which is not limited by the embodiments of this application.
  • the first rich media message in the embodiment of this application can be forwarded to the Chatbot in the MaaP platform through the above rich media message center.
  • the Chatbot can analyze the user's intention information in the first rich media message to determine the correspondence with the intention information.
  • target applet and then the second rich media message returned carries the information of the target applet, so that the client can display the description page of the target applet based on the information of the target applet so that the user can use the target applet.
  • the applet completes the corresponding intention.
  • FIG. 1D is a schematic diagram of another communication system suitable for embodiments of the present application. As shown in Figure 1D, this communication system takes the architecture of a rich media messaging system as an example. As shown in Figure 1D, compared with Figure 1C, in the system shown in Figure 1D, a small program management platform is added.
  • Operation management It is mainly used to review whether the rich media messaging applet meets the rich media messaging applet development specifications, certify the rich media messaging applet, and publish the rich media messaging applet. Users can only query it after it is released.
  • the rich media message applet information may include basic information of the rich media message applet, such as at least one of an identifier (ID), name, icon, version, etc.
  • the rich media message applet information may also include detailed information of the rich media message applet, such as the provider (industry customer) of the rich media message applet, business type, contact information, website, and the purpose of the rich media message applet, At least one item of developer information, etc.
  • FIG. 1E is a schematic diagram of another communication system suitable for embodiments of the present application.
  • this communication system takes the architecture of a rich media messaging system as an example.
  • the applet management platform can be directly connected to the rich media message center.
  • the description of each device please refer to the previous description and will not be repeated here.
  • Step 1 The sender sends a rich media message, which is sent to the calling party's rich media message processing function through the IMS access function on the calling side.
  • the calling message processing function returns a response that the rich media message has been received.
  • Step 2 The calling rich media message processing function sends a rich media message to the rich media message processing function to which the receiver belongs, and the called rich media message processing function returns a response that the rich media message has been received.
  • Step 3 The called rich media message processing function sends a rich media message to the receiver, and the receiver returns a response of successfully receiving the rich media message.
  • Step 4 The receiving direction sends a delivery report message to the calling rich media message processing function and delivers it hop by hop. Finally, the sending direction returns a response to the calling rich media message processing function for receiving the delivery report.
  • the terminal equipment will communicate with the rich media message center through the 2G/3G/4G/5G network.
  • the terminal equipment in the embodiment of the present application can also communicate through the wireless local area network (wireless local area). network, WLAN) and any applicable future networks to communicate with the rich media message center.
  • the following takes the rich media message center as a short message service center (SMSC) as an example to provide a structure for terminal devices to communicate with the SMSC through networks of different generations.
  • SMSC short message service center
  • the communication system includes terminal equipment, SMSC, and 2G/3G network equipment, 4G network equipment, and 5G network equipment used to realize communication between various generations of terminal equipment and SMSC.
  • the terminal device may be a 2G/3G terminal device, a 4G terminal device, a 5G terminal device or an IoT terminal device.
  • 2G/3G network equipment includes a base transceiver station (BTS) and a mobile switching center (MSC).
  • BTS base transceiver station
  • MSC mobile switching center
  • 4G network equipment includes evolved base station (evolved nodeB, enodeB), serving gateway (serving gateway, SGW), IMS and IP short message gateway (IP-short message-gateway, IP-SM-GW).
  • 5G network equipment includes user panel function (UPF) network elements, access and mobility management function (AMF) network elements, short message service function (short message service function) , SMSF) network element.
  • UPF user panel function
  • AMF access and mobility management function
  • SMSF short
  • SMSC is used to realize functions such as receiving, storing, forwarding and short message status reporting of short messages. SMSC also includes an operation and maintenance module and a gateway module that transmits messages to and from the network and selects sending routes.
  • SMSC short message network element
  • IP-SM-GW has been added to the network.
  • IP-SM-GW is mainly responsible for forwarding uplink and downlink short messages between SMSC and 4G terminal equipment.
  • the original mechanism for sending and receiving text messages by 2G/3G terminals remains unchanged.
  • the IP-SM-GW deployed in 4G can provide 5G short message services for terminal devices connected to the 5G network, which is called the SMS over IP solution.
  • 5G network can be well applied to the Internet of Things, and IoT terminal devices can communicate with SMSC through the 5G network.
  • the solution for IoT terminal equipment to communicate with SMSC belongs to the SMS over network attached storage (NAS) solution.
  • SMSF network elements need to be deployed.
  • the 5G network can provide 5G short message services for user terminal devices and IoT terminal devices, which can meet the needs of large-capacity IoT devices.
  • the terminal device only needs to interact with the cloud device once for rich media messages to obtain a target applet that can execute the user's intention, and then operate the target applet to complete the corresponding intention.
  • the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • the structure of the terminal device provided by the embodiment of the present application can be understood by referring to Figure 2A below, and the structure of the cloud device can be understood by referring to Figure 2B below.
  • the terminal device may include a processor 101, a transceiver 102, a memory 103, and a bus 104.
  • the processor 101, the transceiver 102 and the memory 103 are connected to each other via a bus 104.
  • the processor 101 is used to control and manage the actions of the terminal device 10.
  • the processor 101 is used to perform the process of parsing the second rich media message and triggering the display of the description page of the target applet.
  • the transceiver 102 is used to support the terminal device 10 to communicate.
  • the transceiver 102 can send and receive rich media messages.
  • the memory 103 is used to store program codes and data of the terminal device 10 .
  • the processor 101 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with this disclosure.
  • the processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on.
  • the bus 104 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc.
  • PCI Peripheral Component Interconnect
  • EISA Extended Industry Standard Architecture
  • FIG. 1 introduces the structure of the terminal device.
  • the following describes the structure of the cloud device in conjunction with Figure 2B.
  • FIG. 2B is a schematic diagram of a possible logical structure of a cloud device provided by an embodiment of the present application.
  • the cloud device 20 provided by the embodiment of the present application includes: a processor 201, a communication interface 202, a memory 203, and a bus 204.
  • the processor 201, the communication interface 202 and the memory 203 are connected to each other through a bus 204.
  • the processor 201 is used to control and manage the actions of the cloud device 20.
  • the processor 201 is used to perform a process of analyzing intent information.
  • the communication interface 202 is used to support the cloud device 20 to communicate.
  • the communication interface 202 can perform the steps of sending and receiving rich media messages.
  • Memory 203 is used to store program codes and data of the cloud device 20 .
  • the processor 201 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with this disclosure.
  • the processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on.
  • the bus 204 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc.
  • PCI Peripheral Component Interconnect
  • EISA Extended Industry Standard Architecture
  • the rich media message interaction method provided by the embodiment of the present application is described below.
  • Contents related to execution by the terminal device in the method may be executed by the terminal device or by components of the terminal device (such as a processor, a chip, or a chip system, etc.).
  • an embodiment of a rich media message interaction method provided by an embodiment of the present application includes:
  • the terminal device sends the first rich media message to the cloud device, where the first rich media message includes the user's intention information.
  • the cloud device receives the first rich media message sent by the terminal device.
  • the terminal device can send the first rich media message to the cloud device through various possible networks and rich media message centers.
  • the cloud device can also send the first rich media message to the terminal through the rich media message center and various possible networks.
  • the device sends a message, and the message transmission process between the terminal device and the cloud device can be understood by referring to the structure of the communication system in Figure 1A to Figure 1F. This is not limited in the embodiment of the present application.
  • the user's intention information refers to the user's intention or purpose of triggering the terminal device to send the first rich media message, such as: purchasing a ticket, participating in a survey, user registration, payment, etc.
  • the cloud device determines the information of the target applet corresponding to the intent information.
  • This step 302 may include the cloud device determining the information of the target applet corresponding to the intention information, including: the cloud device performs semantic recognition on the intention information to obtain the target key information used to represent the intention information; the cloud device compares the key information with the information of the applet. The corresponding relationship of information determines the information of the target applet corresponding to the target key information.
  • the cloud device can perform semantic recognition on the intent information in the first rich media message through text recognition technology or semantic recognition technology, thereby obtaining the target key information in the intent information.
  • the key information may be keywords, or information summarized by one or more keywords, and may be words or phrases.
  • Target key information refers to the keywords extracted from the intent information through semantic recognition, or words or phrases that can express the intent information summarized by one or more keywords.
  • the cloud device or other mini program management device can maintain the correspondence between the key information and the mini program's information. In this way, after the cloud device identifies the target key information, it can determine the target key from the correspondence between the key information and the mini program's information. Information about the target applet corresponding to the information. If after identifying the intent information, it is determined that different keywords in the intent information can correspond to different mini programs, the keywords that best match the intent information can be determined by comparing weights, thereby determining the information of the target mini program.
  • An industry merchant may have one or more mini programs to provide different services, and the cloud device can determine the target mini program that matches the intent information based on the intent information.
  • the cloud device is a device used by the "10086" background to interact with users. If the cloud device recognizes the keyword "payment” or "recharge” in the intention information, it can determine that the applet corresponding to the intention information is a payment applet or a recharge applet.
  • the cloud device sends a second rich media message to the terminal device, where the second rich media message includes information about the target applet.
  • the terminal device receives the second rich media message from the cloud device.
  • the target applet is used by the user to perform the intent indicated by the intent information.
  • the first rich media message and the second rich media message may be short messages, such as 5G short messages, or future 6G short messages, etc., and of course may also be other instant messaging rich media messages.
  • the terminal device displays the description page of the target applet based on the information of the target applet.
  • the terminal device after the terminal device obtains the information of the target applet from the second rich media message, it can display the target applet.
  • the target applet will contain a lot of content, and the target applet will usually be displayed. Description page, users can use the target applet by clicking on the description page.
  • the terminal device only needs to interact with the cloud device once for rich media messages to obtain the target applet that can execute the user's intention, and then operate the target applet to complete the corresponding intention. Compared with multiple rich media message interactions to complete user intentions, the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • the second rich media message also includes rich media message type information, and the rich media message type information is used to indicate that the second rich media message is an applet message.
  • step 304a may also be included.
  • the terminal device parses the information of the target applet from the target field in the second rich media message according to the rich media message type information.
  • the rich media message type information in the second rich media message may be an identifier such as "miniapp" or other identifiers that can indicate that the second rich media message is a mini program message.
  • the second rich media message may indicate the type of the second rich media message by carrying different rich media message type information. If the second rich media message carries video information, the video type (such as video) may be used to indicate that the second rich media message is a video type rich media message. If the second rich media message carries audio information, the audio type (eg, audio) may be used to indicate that the second rich media message is an audio type rich media message.
  • video type such as video
  • audio eg, audio
  • Each type of rich media message can carry information to be parsed by the terminal device on the corresponding field, as shown in Table 1 below:
  • Table 1 Correspondence between rich media message types and corresponding information fields
  • S1, S2 and S3 respectively represent the starting byte of the corresponding information
  • O1, O2 and O3 respectively represent the offset of the corresponding information from the starting byte.
  • the second rich media message carries the rich media message type information "miniapp"
  • miniapp it means that the starting position of the target applet information in the second rich media message is the S1 byte and the target of the following offset O1
  • the fields all carry information about the target applet.
  • the target fields corresponding to different rich media message types in Table 1 are generally It is often pre-configured in the terminal device, or the cloud device and the terminal device are pre-negotiated.
  • the terminal device After the terminal device recognizes the rich media message type information, it can determine that the second rich media message is an applet message, and then the terminal device can parse the target applet information on the target field corresponding to the applet type, so that it can Improve the speed of obtaining information about the target applet.
  • the method of carrying the rich media message type information for indicating the applet type in the rich media message may be: it may be in a single rich media (Single Rich Card) message or a multi-card rich media (Carousel) message.
  • the miniApp data type is added to the content data type of the Rich Cards message, which contains information-related fields of the mini program. You can also extend the media data type in the content data type of the Single Rich Card or Carousel of Rich Cards rich media message, and add the mediaContentType data type value to the media data type (for example: app/miniapp).
  • the information of the target applet includes page display information.
  • the page display information refers to the information that will be displayed by the terminal device.
  • the page display information can be pre-configured copy for the target applet, which can include at least one of text, pictures, audio, or video.
  • the information of the target applet may also include non-page display information.
  • Non-page display information refers to information that does not need to be displayed on the terminal device. This information terminal device can be used to run the target applet.
  • the terminal device will display the description page of the target applet.
  • the description page will not only contain page display information, but also other information that the terminal device determines needs to be displayed on the description page, such as the operation entrance of the target applet.
  • the operation entrance of the target applet can also be understood as the access link of the target applet. Through the operation entrance, the target applet can be used to execute the corresponding user intention.
  • the operation entrance of the target applet is associated with the applet engine interface.
  • the applet engine interface refers to the interface used to call the engine of the applet.
  • the engine of the applet can be a plug-in (code package).
  • the plug-in can be automatically configured to the terminal device when the version of the terminal device is upgraded.
  • the description page of the target applet may be in the form of a rich media card.
  • the rich media card refers to displaying the access link of the target applet and at least one type of information in text, picture, audio or video in the form of a card.
  • Non-page display information may include the identification of the target applet.
  • the target applet's identification can be used as an index to other information about the target applet.
  • the non-page display information may also include at least one of the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, the application package of the target applet, or the latest version number of the target applet. .
  • the identification (appId) of the above-mentioned applet is usually necessary.
  • the information of the target applet will contain the appId, and the terminal device can find the application package or download address of the applet through the appId.
  • Others such as: the name of the mini program (appName), the download address of the mini program (appUrl), the content description information of the mini program (contentDescription), and the application package of the mini program (appPackage) are all optional. This is optional for these information, the information of the target applet can contain one or more of them, or none of them.
  • the terminal device When the terminal device receives the user's operation on the operation portal, it can obtain the application package of the target applet based on the non-page display information, call the applet engine interface to run the application package of the target applet, and display the operation page of the target applet. .
  • the information of the target applet includes the application package of the target applet.
  • the terminal device can call the applet engine interface to run the application package of the target applet and display The operation page of the target applet.
  • the operation page of the target applet refers to the page where the user can input information to complete the corresponding intention. This method can directly run the application package of the target applet included in the information of the target applet, thereby saving the time of searching for the application package of the target applet.
  • the terminal device can use the identifier of the target applet to obtain the application package of the target applet.
  • the second rich media message does not need to carry the application package of the target applet, which can reduce the byte length of the second rich media message and improve the second rich media message. Transmission efficiency of media messages.
  • the terminal device queries the local storage space according to the identification of the target applet; if the application package of the target applet is stored in the local storage space, the terminal device obtains the application package of the target applet from the local storage space.
  • the terminal device can determine whether the application package of the target applet is the latest version stored in the local storage space by comparing the version number. , and then obtain the application package of the target applet from the local storage space. In this way, the terminal device can be made to run the latest version of the application package of the target applet.
  • the terminal device can determine the corresponding download address according to the identification of the target applet, and download the application package of the target applet from the download address.
  • the download address can be stored in a table of the terminal device.
  • the table can store a corresponding relationship between the identification of the target applet and the download address of the application package of the target applet.
  • the terminal device can obtain the identification of the target applet and the target applet. In the corresponding relationship between the download address of the application package, find the download address corresponding to the identifier of the target applet.
  • the target applet information includes the download address of the target applet.
  • the terminal device can directly use the download. Address to download the application package of the target applet. There is no need to search for the download address through the target applet's identification, thus speeding up the downloading speed of the target applet's application package.
  • the description page of the target applet also includes a first prompt button and a second prompt button.
  • the first prompt button is used to instruct to obtain the application package of the target applet.
  • the second prompt button The button is used to indicate not to obtain the application package of the target applet, where the first prompt button is the operation entrance of the target applet.
  • the terminal device can obtain the application package of the target applet. In this case, please refer to the previous options 1 to 3 to understand how to obtain the application package of the target applet.
  • the above introduces the scheme of the terminal device and the cloud device interacting with rich media messages to display the description page of the target applet, and the solution that the terminal device can display the operation interface of the target applet after running the application package of the target applet.
  • the terminal device is a mobile phone.
  • the terminal device is a mobile phone.
  • the user uses the mobile phone to operate the information application 401, which is a short message application.
  • the mobile phone displays an interface as shown in Figure 4B.
  • the user sends a rich media message to the recipient "Industry Merchant A" 402, where "Industry Merchant A” 402 can be the receiving number of Industry Merchant A or the industry stored in the user's address book Merchant A’s remark name.
  • the mobile phone can respond to the user's selection operation of the recipient "Industry Merchant A” and display the interface shown in Figure 4C.
  • the interface shown in Figure 4C is a short message input interface, which includes a recipient information window and an information input window.
  • the user uses the mobile phone to operate the information application 501.
  • the mobile phone displays the interface shown in Figure 5B.
  • the user sends a rich media message to the recipient "12306" 502.
  • the mobile phone can respond to the user's selection operation of the recipient "12306" 502 and display the interface shown in Figure 5C.
  • the user enters the intention information in the input box as "ticket purchase”, and then clicks the send button 503.
  • the mobile phone responds to the user's send operation of "ticket purchase” and sends the first rich media to the cloud device.
  • the description page includes the display information of the 12306 ticket purchase applet, such as: “starting place”, “destination” in Figure 5D, the words “June 07, today” indicating the time, "high-speed rail/motor train”, “Student tickets”, as well as pictures of trains, these information can be the page display information in the information of the target applet in the second rich media message. This information can be pre-configured in the cloud device by industry merchants.
  • the client receives the second rich media message, parses out the page display information, and then encapsulates the operation entry such as "Buy Ticket” 504 in Figure 5D. Displayed on the description page together with the page display information.
  • the operation entry "Purchase Ticket” 504 is associated with the mini program engine interface. After the user clicks the operation entry "Purchase Ticket” 504, the mini program engine interface can be called.
  • the user can not only click on the operation entry "Purchase Ticket” 504, but also click on the "Start Point", “Destination”, the words “June 07, Today” indicating the time, and "High Speed Rail/EMU” , "Student Ticket", these buttons can be used to select information. If the user clicks "Start Place”, the interface shown in Figure 5E will be displayed, and the user can select the departure station. In Figure 5E, the departure station selected by the user is "Nanjing" 505, then the "Start Place” Information updated to Nanjing. The user continues to select "Destination”.
  • the mobile phone supports downloading the application package of the mini program by default. If the mobile phone does not support downloading the application package of the mini program by default, you need to add the first prompt button and the second prompt button to the description page of the target mini program, as shown in Figure 5I.
  • "Use the mini program to purchase tickets" 509 can be the first prompt button
  • "Purchase tickets without using the mini program” 510 can be the second prompt button. If the user clicks "Purchase tickets using the mini program" 509, the above-mentioned ticket purchasing process can be realized.
  • both the terminal device and the cloud device can obtain the target applet that can execute the user's intention through one rich media message interaction, and then operate the target applet to complete the corresponding intention.
  • the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • an embodiment of the client 60 provided by the embodiment of this application includes:
  • the sending unit 601 is configured to send a first rich media message to the cloud device, where the first rich media message includes the user's intention information. Perform step 301 in the above method embodiment.
  • the display unit 603 is configured to display the description page of the target applet according to the information of the target applet. Perform step 304 in the above method embodiment.
  • both the client and the cloud device can obtain the target applet that can execute the user's intention through one rich media message interaction, and then operate the target applet to complete the corresponding intention.
  • the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • the client further includes a processing unit 604, and the second rich media message further includes rich media message type information, and the rich media message type information is used to indicate that the second rich media message is an applet message.
  • the processing unit 604 is configured to parse the information of the target applet from the target field in the second rich media message according to the rich media message type information. Perform step 304a in the above method embodiment.
  • the information of the target applet includes page display information; the description page of the target applet includes page display information, and an operation entrance of the target applet, and the operation entrance of the target applet is associated with the applet engine interface of the target applet.
  • the information about the target applet also includes the identification of the target applet.
  • the information about the target applet also includes the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, the application package of the target applet, or the latest version number of the target applet. at least one of them.
  • processing unit 604 is also configured to obtain the application package of the target applet in response to the user's operation on the operation portal of the target applet; and call the applet engine interface to run the application package of the target applet.
  • the display unit 603 is also used to display the operation page of the target applet.
  • processing unit 604 is specifically configured to obtain the application package of the target applet from the information of the target applet.
  • the processing unit 604 is specifically configured to obtain the application package of the target applet according to the identification of the target applet in the information of the target applet.
  • the processing unit 604 is specifically configured to obtain the application package of the target applet according to the download address contained in the information of the target applet.
  • the processing unit 604 is specifically configured to query the local storage space according to the identification of the target applet; if the application package of the target applet is stored in the local storage space, obtain the application package of the target applet from the local storage space.
  • the processing unit 604 is specifically configured to obtain the application package of the target applet from the local storage space if the version number of the application package of the target applet stored in the local storage space is the same as the latest version number.
  • the processing unit 604 is specifically configured to determine the download address of the application package of the target applet based on the identification of the target applet; and obtain the application package of the target applet based on the download address.
  • the description page of the target applet also includes a first prompt button and a second prompt button.
  • the first prompt button is used to indicate obtaining the application package of the target applet
  • the second prompt button is used to indicate not to obtain the application package of the target applet.
  • the first prompt button is the operation entrance of the target applet.
  • the first rich media message and the second rich media message are short messages.
  • each module in the client introduced above can be understood by referring to the steps performed by the terminal device in the above method embodiment.
  • an embodiment of the cloud device 70 provided by the embodiment of this application includes:
  • the receiving unit 701 is configured to receive the first rich media message sent by the client, where the first rich media message includes the user's intention information. Perform step 301 in the above method embodiment.
  • the processing unit 702 is used to determine the information of the target applet corresponding to the intention information; for example, step 302 in the above method embodiment is executed.
  • the sending unit 703 is configured to send a second rich media message to the client.
  • the second rich media message includes information about the target applet.
  • the target applet is used by the user to execute the intention indicated by the intention information. Perform step 303 in the above method embodiment.
  • the cloud device determines the corresponding target applet after identifying the intent information, and then sends a second rich media message to the client.
  • the client obtains the information of the target applet from the second rich media message and can display the target applet.
  • Mini program, the target mini program will contain more content, and the description page of the target mini program will usually be displayed.
  • the user can use the target mini program by clicking on the description page.
  • the client only needs to interact with the cloud device once for rich media messages to obtain the target applet that can execute the user's intention, and then operate the target applet to complete the corresponding intention.
  • the operation complexity is reduced and the efficiency of rich media message interaction is improved.
  • the processing unit 702 is specifically configured to perform semantic recognition on the intention information to obtain the target key information used to represent the intention information; and determine the target corresponding to the target key information based on the correspondence between the key information and the information of the applet. Mini program information.
  • the second rich media message also includes rich media message type information, and the rich media message type information is used to indicate that the second rich media message is an applet message.
  • the target applet information includes page display information.
  • the information about the target applet also includes the identification of the target applet, or the information about the target applet also includes the name of the target applet, the content description information of the target applet, the download address of the application package of the target applet, At least one of the application package of the target applet or the latest version number of the target applet.
  • each module in the cloud device introduced above can be understood by referring to the steps performed by the cloud device in the above method embodiment.
  • the above-mentioned sending unit 601 and receiving unit 602 of the client can be implemented by a transceiver.
  • the receiving unit 701 and the sending unit 703 in the cloud device can be implemented through a communication interface.
  • a computer-readable storage medium is also provided.
  • Computer-executable instructions are stored in the computer-readable storage medium.
  • the terminal device executes the above-mentioned Figure 3 to the steps performed by the terminal device in Figure 5I.
  • a computer-readable storage medium is also provided.
  • Computer-executable instructions are stored in the computer-readable storage medium.
  • the cloud device executes the above Figure 3 to the steps performed by the cloud device in Figure 5I.
  • a computer program product is also provided.
  • the computer program product includes a computer program code.
  • the computer program code is executed on a computer, the computer device executes what the terminal in FIGS. 3 to 5I above executes. A step of.
  • a chip system in another embodiment, is also provided.
  • the chip system includes one or more interface circuits and one or more processors; the interface circuits and the processors are interconnected through lines; the interface circuit is used to slave the terminal.
  • the memory receives the signal and sends the signal to the processor, and the signal includes the computer instruction stored in the memory; when the processor executes the computer instruction, the terminal performs the aforementioned steps performed by the terminal device in Figures 3 to 5I.
  • the chip system may also include a memory, which is used to save necessary program instructions and data for controlling the device.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or integrated. to another system, or some features can be ignored, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above-mentioned integrated units can be implemented in whole or in part through software, hardware, firmware, or any combination thereof.
  • the integrated unit When the integrated unit is implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated.
  • the available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk (SSD)), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请公开了一种富媒体消息交互的方法，该方法多应用于富媒体消息系统。该方法包括客户端向云设备发送第一富媒体消息，第一富媒体消息包括用户的意图信息；云设备确定意图信息对应的目标小程序的信息；云设备向客户端发送第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序用于用户执行意图信息所指示的意图，客户端根据目标小程序的信息显示目标小程序的描述页面。用户可以通过点击该描述页面使用该目标小程序。这样客户端只需要与云设备进行一次富媒体消息交互，就可以操作该目标小程序完成相应意图，降低了操作复杂度，提高了富媒体消息交互的效率。

Description

一种富媒体消息交互的方法、客户端、云设备及通信系统
本申请要求于2022年6月15日提交中国专利局、申请号为202210675109.X、发明名称为“一种富媒体消息交互的方法、客户端、云设备及通信系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域，具体涉及一种富媒体消息交互的方法、客户端、云设备及通信系统。
背景技术
消息系统中，服务商可以以聊天机器人(Chatbot)的形式与用户通过消息中心和消息即平台(Messaging as a Platform，MaaP)进行消息交互。服务商的Chatbot可以以点对点方式或群发方式向用户发送消息，用户可以直接向Chatbot回复消息，用户也可以主动向Chatbot发送消息。
消息系统中人机交互采用会话型交互，用户在和Chatbot的交互过程中获得“请求-应答”方式服务，这种服务方式用户操作繁琐，交互过程长，效率低下。
发明内容
本申请提供一种富媒体消息交互的方法，用于以简单的操作在富媒体消息交互的应用中获得小程序的服务。本申请还提供了相应的客户端、云设备、通信系统、计算机可读存储介质以及计算机程序产品等。
本申请第一方面提供一种富媒体消息交互的方法，包括：客户端向云设备发送第一富媒体消息，第一富媒体消息包括用户的意图信息；客户端接收来自于云设备的第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序的信息是云设备根据意图信息确定的，目标小程序用于用户执行意图信息所指示的意图；客户端根据目标小程序的信息显示目标小程序的描述页面。
本申请中，客户端可以为安装在终端设备上的信息应用程序，如：短消息应用程序。该客户端运行时可以通过终端设备的硬件完成与云设备的消息交互。客户端也可以为终端设备，如：手机、电话手表、平板电脑、计算机等可以进行富媒体消息交互的设备。
本申请中，第一富媒体消息和第二富媒体消息可以是短消息，也可以是其他即时通信富媒体消息。用户的意图信息指的是用户触发客户端发送第一富媒体消息的意图或目的，如：购买车票、参加调研、用户注册、缴费等。
本申请中，小程序通常是服务提供商为用户提供一种或多种服务的富媒体通信业务(rich communications services，RCS)程序。如：“10086”小程序、“12306铁路”小程序或“大众点评”小程序等，这些小程序的聊天机器人(Chatbot)与用户进行富媒体消息交互。用户与这些服务提供商的Chatbot交互的富媒体消息也可以称为行业消息。目标小程序可以是任意一种小程序，用户在准备发送第一富媒体消息确定收件方时即确定了相应类 型的小程序，该目标小程序可以是该收件方的后台云设备所能提供的小程序中的任意一个。
本申请中，客户端从第二富媒体消息中获取到了目标小程序的信息，就可以显示该目标小程序，该目标小程序所包含的内容会比较多，通常会显示该目标小程序的描述页面，用户可以通过点击该描述页面使用该目标小程序。这样客户端只需要与云设备进行一次富媒体消息交互，就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
在第一方面的一种可能的实现方式中，第二富媒体消息还包括富媒体消息类型信息，富媒体消息类型信息用于指示第二富媒体消息为小程序消息；该方法还包括：客户端根据富媒体消息类型信息从第二富媒体消息中的目标字段解析目标小程序的信息。
该种可能的实现方式中，第二富媒体消息中的富媒体消息类型信息可以是“miniapp”这样的标识，也可以是其他能表示该第二富媒体消息是小程序消息的标识。客户端识别到该富媒体消息类型信息后，就可以确定该第二富媒体消息是小程序消息，每种类型的富媒体消息都可以在相应字段上承载客户端要解析的信息，客户端可以在该小程序类型所对应的目标字段上解析目标小程序的信息，从而可以提高获取目标小程序的信息的速度。
在第一方面的一种可能的实现方式中，目标小程序的信息包括页面展示信息；目标小程序的描述页面包括页面展示信息，以及目标小程序的操作入口，目标小程序的操作入口与目标小程序的小程序引擎接口关联。
本申请中，目标小程序的信息可以包括页面展示信息和非页面展示信息，其中，页面展示信息指的是客户端会显示出来的信息，页面展示信息可以是预先为该目标小程序配置好的文案，其中，可以包括文字、图片、音频或视频中的至少一种。客户端会显示目标小程序的描述页面，该描述页面上可以包含页面展示信息的中的全部内容,也可以只包含页面展示信息中的部分内容，另外,该描述页面上还可以包含客户端确定需要在该描述页面上显示的其他信息，如：目标小程序的操作入口。目标小程序的操作入口也可以理解为是目标小程序的访问链接，通过该操作入口就可以使用该目标小程序执行相应的用户意图。
本申请中，目标小程序的描述页面可以是富媒体卡片的形式，富媒体卡片指的是以卡片形式显示目标小程序的访问链接，以及文字、图片、音频或视频中的至少一种类型的信息。
本申请中，非页面展示信息指的是客户端不需要展示出来的信息，这些信息客户端可以用来运行目标小程序。小程序引擎接口指的是用于调用小程序的引擎的接口，小程序的引擎可以是一个插件(代码包)，该插件可以在客户端的版本升级时自动配置到客户端。
该种可能的实现方式中，目标小程序的描述页面上展示目标小程序的操作入口，可以方便用户使用该目标小程序完成相应意图。
在第一方面的一种可能的实现方式中，目标小程序的信息还包括目标小程序的标识。
在第一方面的一种可能的实现方式中，目标小程序的信息还包括目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号中的至少一个。
该种可能的实现方式中，非页面展示信息会包括目标小程序的标识，目标小程序的标识可以用作目标小程序其他信息的索引。目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号可以由云设备在第二富媒体消息中发送给客户端，也可以由客户端通过目标小程序的标识查找到。目标小程序的信息中包括上述信息中的一个或多个，客户端就可以快速的运行目标小程序的应用包。
在第一方面的一种可能的实现方式中，该方法还包括：响应于用户对目标小程序的操作入口的操作，客户端获取目标小程序的应用包；客户端调用小程序引擎接口，以运行目标小程序的应用包；客户端显示目标小程序的操作页面。
在第一方面的一种可能的实现方式中，客户端获取目标小程序的应用包，包括：客户端从目标小程序的信息中获取目标小程序的应用包。
该种可能的实现方式中，若目标小程序的信息中包括目标小程序的应用包，则客户端在接收到用户对目标小程序的操作入口的操作后，就可以调用小程序引擎接口运行该目标小程序的应用包，显示目标小程序的操作页面。目标小程序的操作页面指的是用户可以输入信息完成相应意图的页面。该种方式可以直接运行目标小程序的信息中包含的目标小程序的应用包，从而节省了查找目标小程序的应用包的时间。
在第一方面的一种可能的实现方式中，客户端获取目标小程序的应用包，包括：客户端根据目标小程序的信息中的目标小程序的标识获取目标小程序的应用包。
该种可能的实现方式中，客户端可以使用目标小程序的信息中的目标小程序的标识获取目标小程序的应用包，这样不需要第二富媒体消息中携带目标小程序的应用包，可以减少第二富媒体消息的字节长度，提高第二富媒体消息的传输效率。
在第一方面的一种可能的实现方式中，客户端获取目标小程序的应用包，包括：客户端根据目标小程序的信息中包含的下载地址获取目标小程序的应用包。
该种可能的实现方式中，若目标小程序的信息中包含目标小程序的下载地址，则客户端可以直接使用该下载地址下载目标小程序的应用包。不需要再通过目标小程序的标识查找下载地址，从而加快了目标小程序的应用包的下载速度。
在第一方面的一种可能的实现方式中，上述步骤：客户端根据目标小程序的标识获取目标小程序的应用包，包括：客户端根据目标小程序的标识查询本地存储空间；若目标小程序的应用包存储在本地存储空间，则客户端从本地存储空间获取目标小程序的应用包。
该种可能的实现方式中，若目标小程序的应用包应经存储在本地存储空间中，客户端可以使用目标小程序的标识从本地存储空间直接查找到该目标小程序的应用包。从本地存储空间中查找可以快速获得目标小程序的应用包。
在第一方面的一种可能的实现方式中，上述步骤：若目标小程序的应用包存储在本地存储空间，则客户端从本地存储空间获取目标小程序的应用包，包括：若本地存储空间中存储的目标小程序的应用包的版本号与最新版本号相同，则客户端从本地存储空间获取目标小程序的应用包。
该种可能的实现方式中，若目标小程序的信息中包括目标小程序的应用包的最新版本 号，则客户端可以通过比较版本号确定本地存储空间中存储的是否是最新版本的目标小程序的应用包，若是最新版本的，再从本地存储空间获取目标小程序的应用包。这样，可以使客户端运行到最新版本的目标小程序的应用包。
在第一方面的一种可能的实现方式中，上述步骤：客户端根据目标小程序的标识获取目标小程序的应用包，包括：客户端根据目标小程序的标识确定目标小程序的应用包的下载地址；客户端根据下载地址获取目标小程序的应用包。
该种可能的实现方式中，若本地存储空间没有存储目标小程序的应用包，则客户端可以根据目标小程序的标识确定对应的下载地址，从该下载地址下载目标小程序的应用包。
在第一方面的一种可能的实现方式中，目标小程序的描述页面还包括第一提示按钮和第二提示按钮，第一提示按钮用于指示获取目标小程序的应用包，第二提示按钮用于指示不获取目标小程序的应用包，其中，第一提示按钮为目标小程序的操作入口。
该种可能的实现方式中，若客户端不允许默认下载目标小程序的应用包，则在显示目标小程序的描述页面时，会再描述页面中显示第一提示按钮和第二提示按钮。如果用户点击了第一提示按钮，则客户端可以获取并运行目标小程序的应用包，然后显示目标小程序的操作页面。
本申请第二方面提供一种富媒体消息交互的方法，包括：云设备接收客户端发送的第一富媒体消息，第一富媒体消息包括用户的意图信息；云设备确定意图信息对应的目标小程序的信息；云设备向客户端发送第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序用于用户执行意图信息所指示的意图。
本申请中，云设备识别意图信息后确定对应的目标小程序，然后向客户端发送第二富媒体消息，客户端从第二富媒体消息中获取到了目标小程序的信息，就可以显示该目标小程序，该目标小程序所包含的内容会比较多，通常会显示该目标小程序的描述页面，用户可以通过点击该描述页面使用该目标小程序。这样客户端只需要与云设备进行一次富媒体消息交互，就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
在第一方面的一种可能的实现方式中，云设备确定意图信息对应的目标小程序的信息，包括：云设备对意图信息进行语义识别，以得到用于表示意图信息的目标关键信息；云设备从关键信息与小程序的信息的对应关系，确定与目标关键信息对应的目标小程序的信息。
本申请中，云设备可以通过文本识别技术或语义识别技术对第一富媒体消息中的意图信息进行语义识别，从而获取意图信息中的目标关键信息。本申请中，关键信息可以为关键词，或者通过一个或多个关键词概括出来的信息，可以是词，也可以是短语。目标关键信息指的是通过对意图信息进行语义识别，从中提取出的关键词，或者通过一个或多个关键词概括出来的能表示意图信息的词或短语。云设备或者其他小程序管理设备可以维护关键信息与小程序的信息的对应关系，这样，云设备在识别出目标关键信息后，就可以从关键信息与小程序的信息的对应关系中确定目标关键信息对应的目标小程序的信息。若识别意图信息后确定该意图信息中的不同关键词可以对应到不同的小程序上，可以通过比较权 重的方式确定与该意图信息最匹配的关键词，从而确定目标小程序的信息。
在第二方面的一种可能的实现方式中，第二富媒体消息还包括富媒体消息类型信息，富媒体消息类型信息用于指示第二富媒体消息为小程序消息。
在第二方面的一种可能的实现方式中，目标小程序的信息包括页面展示信息。
在第二方面的一种可能的实现方式中，目标小程序的信息还包括目标小程序的标识。
在第二方面的一种可能的实现方式中，目标小程序的信息还包括目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号中的至少一个。第二方面或第二方面的任一种可能的实现方式中的特征及效果可以参阅前面第一方面或第一方面的任一种可能的实现方式中的相应内容进行理解。
本申请第三方面提供一种富媒体消息交互的方法，包括：客户端向云设备发送第一富媒体消息，第一富媒体消息包括用户的意图信息；云设备确定意图信息对应的目标小程序的信息；云设备向客户端发送第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序用于用户执行意图信息所指示的意图，客户端根据目标小程序的信息显示目标小程序的描述页面。
在第三方面的一种可能的实现方式中，第二富媒体消息还包括富媒体消息类型信息，富媒体消息类型信息用于指示第二富媒体消息为小程序消息；该方法还包括：客户端根据富媒体消息类型信息从第二富媒体消息中的目标字段解析目标小程序的信息。
在第三方面的一种可能的实现方式中，目标小程序的信息包括页面展示信息；目标小程序的描述页面包括页面展示信息，以及目标小程序的操作入口，目标小程序的操作入口与目标小程序的小程序引擎接口关联。
在第三方面的一种可能的实现方式中，目标小程序的信息还包括目标小程序的标识。
在第三方面的一种可能的实现方式中，目标小程序的信息还包括目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号中的至少一个。
在第三方面的一种可能的实现方式中，该方法还包括：响应于用户对目标小程序的操作入口的操作，客户端获取目标小程序的应用包；客户端调用小程序引擎接口，以运行目标小程序的应用包；客户端显示目标小程序的操作页面。
在第三方面的一种可能的实现方式中，客户端获取目标小程序的应用包，包括：客户端从目标小程序的信息中获取目标小程序的应用包。
在第三方面的一种可能的实现方式中，客户端获取目标小程序的应用包，包括：客户端根据目标小程序的信息中的目标小程序的标识获取目标小程序的应用包。
在第三方面的一种可能的实现方式中，客户端获取目标小程序的应用包，包括：客户端根据目标小程序的信息中包含的下载地址获取目标小程序的应用包。
在第三方面的一种可能的实现方式中，上述步骤：客户端根据目标小程序的标识获取目标小程序的应用包，包括：客户端根据目标小程序的标识查询本地存储空间；若目标小程序的应用包存储在本地存储空间，则客户端从本地存储空间获取目标小程序的应用包。
在第三方面的一种可能的实现方式中，上述步骤：若目标小程序的应用包存储在本地存储空间，则从本地存储空间获取目标小程序的应用包，包括：若本地存储空间中存储的目标小程序的应用包的版本号与最新版本号相同，则从本地存储空间获取目标小程序的应用包。
在第三方面的一种可能的实现方式中，上述步骤：客户端根据目标小程序的标识获取目标小程序的应用包，包括：客户端根据目标小程序的标识确定目标小程序的应用包的下载地址；客户端根据下载地址获取目标小程序的应用包。
在第三方面的一种可能的实现方式中，目标小程序的描述页面还包括第一提示按钮和第二提示按钮，第一提示按钮用于指示获取目标小程序的应用包，第二提示按钮用于指示不获取目标小程序的应用包，其中，第一提示按钮为目标小程序的操作入口。
在第三方面的一种可能的实现方式中，第一富媒体消息和第二富媒体消息为短消息。
第三方面或第三方面的任一种可能的实现方式中的特征及效果可以参阅前面第一方面或第一方面的任一种可能的实现方式中的相应内容进行理解。
本申请第四方面，提供了一种客户端，用于执行上述第一方面或第一方面的任意可能的实现方式中的方法。具体地，该客户端包括用于执行上述第一方面或第一方面的任意可能的实现方式中的方法的模块或单元，如：显示单元、发送单元和接收单元。
本申请第五方面，提供了一种云设备，用于执行上述第二方面或第二方面的任意可能的实现方式中的方法。具体地，该云设备包括用于执行上述第二方面或第二方面的任意可能的实现方式中的方法的模块或单元，如：接收单元、处理单元和发送单元。
本申请第六方面提供了一种客户端，包括收发器、处理器和存储器，收发器和处理器与存储器耦合，存储器用于存储程序或指令，当程序或指令被处理器执行时，使得客户端执行前述第一方面或第一方面的任意可能的实现方式中的方法。
本申请第七方面，提供了一种云设备。该云设备可以包括至少一个处理器、存储器和通信接口。处理器与存储器和通信接口耦合。存储器用于存储指令，处理器用于执行该指令，通信接口用于在处理器的控制下与其他网元进行通信。该指令在被处理器执行时，使处理器执行第二方面或第二方面的任意可能的实现方式中的方法。
本申请第八方面提供了一种芯片系统，该芯片系统包括一个或多个接口电路和一个或多个处理器；接口电路和处理器通过线路互联；接口电路用于从终端设备的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行计算机指令时，客户端执行前述第一方面或第一方面的任意可能的实现方式中的方法。
本申请第九方面提供了一种芯片系统，该芯片系统包括一个或多个接口电路和一个或多个处理器；接口电路和处理器通过线路互联；接口电路用于从云设备的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行计算机指令时，云设备执行前述第二方面或第二方面的任意可能的实现方式中的方法。
本申请第十方面提供了一种计算机可读存储介质，其上存储有计算机程序或指令，当计算机程序或指令在计算机上运行时，使得计算机执行前述第一方面或第一方面的任意可能的实现方式中的方法。
本申请第十一方面提供了一种计算机可读存储介质，其上存储有计算机程序或指令，当计算机程序或指令在计算机上运行时，使得计算机执行前述第二方面或第二方面的任意可能的实现方式中的方法。
本申请第十二方面提供了一种计算机程序产品，该计算机程序产品包括计算机程序代码，当计算机程序代码在计算机上执行时，使得计算机执行前述第一方面或第一方面的任意可能的实现方式中的方法。
本申请第十三方面提供了一种计算机程序产品，该计算机程序产品包括计算机程序代码，当计算机程序代码在计算机上执行时，使得计算机执行前述第二方面或第二方面的任意可能的实现方式中的方法。
本申请第十四方面提供一种通信系统，该通信系统包括客户端和云设备，该客户端用于执行前述第一方面或第一方面的任意可能的实现方式中的方法，该云设备用于执行前述第二方面或第二方面的任意可能的实现方式中的方法。
其中，第二方面至第十三方面或者其中任一种可能实现方式所带来的技术效果可参见第一方面或第一方面不同可能实现方式所带来的技术效果，此处不再赘述。
附图说明
图1A至图1F是本申请实施例提供的通信系统的多种可能的结构示意图；
图2A是本申请实施例提供的终端设备的一结构示意图；
图2B是本申请实施例提供的云设备的一结构示意图；
图3是本申请实施例提供的富媒体消息交互的方法的一实施例示意图；
图4A至图4F是本申请实施例提供的一富媒体消息交互场景的一系列示意图；
图5A至图5I是本申请实施例提供的另一富媒体消息交互场景的一系列示意图；
图6是本申请实施例提供的终端设备的另一结构示意图；
图7是本申请实施例提供的云设备的另一结构示意图。
具体实施方式
下面结合附图，对本申请的实施例进行描述，显然，所描述的实施例仅仅是本申请一部分的实施例，而不是全部的实施例。本领域普通技术人员可知，随着技术发展和新场景的出现，本申请实施例提供的技术方案对于类似的技术问题，同样适用。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本申请实施例提供一种富媒体消息交互的方法，用于以简单的操作在富媒体消息交互 的应用中获得小程序的服务。本申请还提供了相应的客户端、云设备、通信系统、计算机可读存储介质以及计算机程序产品等。以下分别进行详细说明。
本申请实施例的通信系统，包括但不限于全球移动通信系统(global system for mobile communications，GSM)，码分多址接入(code division multiple access，CDMA)系统,宽带码分多址(wideband code division multiple access，WCDMA)系统,通用分组无线业务(general packet radio service，GPRS)系统,长期演进(long term evolution，LTE)系统,频分双工长期演进(frequency division duplex LTE，LTE-FDD)系统,时分双工长期演进(time division duplex LTE，LTE-TDD)系统,通用移动通讯系统(universal mobile telecommunications system，UMTS),其他应用正交频分复用(orthogonal frequency division multiplexing，OFDM)技术的无线通信系统，第五代(5th generation，5G)或新无线(new radio，NR)系统。本申请提供的技术方案还可以应用于未来的通信系统，如第六代移动通信系统。本申请提供的技术方案还可以应用于设备到设备(device to device，D2D)通信，车到万物(vehicle-to-everything，V2X)通信，机器到机器(machine to machine，M2M)通信，机器类型通信(machine type communication，MTC)，以及物联网(internet of things，IoT)通信系统或者其他通信系统。
为便于理解本申请实施例，首先对本申请中涉及到的术语做简单说明。
1.富媒体通信业务(rich communications services，RCS)消息：遵循全球移动通信系统协会(global system for mobile communication association，GSMA)推出的富媒体通信融合.07(rich communication convergence.07，RCC.07)标准规范和富媒体通信融合.71(rich communication convergence.71，RCC.71)标准规范。RCS消息是对传统短信的升级，RCS消息在继承经典消息服务号码体系、电信级验证、覆盖广、触达率高等优势的基础上，基于GSMA RCS及相关标准实现，突破了传统短消息对信息长度和内容格式的限制，支持文本、图片、音频、视频、位置、联系人和文档等多种媒体格式，引入了消息即平台(messaging as a platform，MaaP)平台，促进信息通信行业垂直行业的融合。
对于终端用户，RCS消息可提供点到点消息和群聊服务，RCS消息的内容形式除文本外，还可以支持图片、音频、视频、位置、联系人等多种形式。对于行业客户，RCS消息可提供增强的个人与应用间消息服务，实现“消息即平台”，并且引入了新的消息交互模式—聊天机器人，以消息对话的方式连接终端，在对话框即可提供搜索、发现、交互、支付等服务，从而实现企业等行业客户与终端用户的交互服务。
作为示例，富媒体消息可称为RCS消息、5G消息。富媒体消息可用于物联网设备之间，因此，富媒体消息也可称为5G物联网消息。富媒体消息是通过手机的信息应用发送的消息。可以理解，消息的具体命名不对本申请实施例的保护范围造成限定。下文为统一，用富媒体消息进行描述。
2.聊天机器人(Chatbot)：富媒体消息中行业消息应用的呈现形式，模拟人类智能对话，向用户提供行业消息服务功能。
3.小程序(MiniApp)：是一种基于web技术(web technology)(如JavaScript)实现的、不需要在终端设备安装即可在终端设备上的宿主移动应用程序(或宿主客户端) 中运行的应用程序。其中，宿主移动应用程序(或宿主客户端)是安装在终端设备上的应用程序，宿主应用程序通常可以运行多个(种)小程序。
4.富媒体消息小程序：是以终端设备(或称为富媒体消息终端)上运行的富媒体消息应用程序(或富媒体消息客户端)为宿主应用程序(或宿主客户端)的小程序，也就是说，富媒体消息小程序由富媒体消息应用程序从网络侧下载后直接运行，无需被安装到终端设备上。用户需要通过富媒体消息客户端运行和进入富媒体消息小程序。富媒体消息应用程序中内置的小程序引擎和富媒体消息小程序解耦，例如，二者均可独立于对方升级。富媒体消息小程序运行后，可与富媒体小程序对应的服务器进行交互，实现其他业务办理(如银行卡余额查询)等业务。
5.富媒体消息客户端：具有富媒体消息业务功能的应用程序或客户端，内置有小程序引擎，可从网络侧查询富媒体消息小程序的信息、下载富媒体消息小程序、运行或者解释执行富媒体消息小程序。为便于理解，将富媒体消息客户端称为富媒体消息小程序的宿主客户端。
6.网页视图(WebView)：可以简单的看作一个可以嵌套到界面上的一个浏览器控件。用户通常是用浏览器来浏览网页，webview是一个嵌入式的浏览器，是嵌入在原生应用中的，用户可能都意识不到在使用浏览器。传统浏览器分为两个部分，UI(地址栏、导航栏)和浏览器引擎。webview就是原生应用中的浏览器引擎。webview是一个可视化的组件，是作为原生APP的视觉部分。用webview展示的内容可以不需要存储在本地，可以直接从服务器获取。运行在webview中的一种脚本语言(Javascript，JS)代码有能力调用原生的系统的应用程序接口(application programming interface，API)，没有传统浏览器沙箱的限制。
本申请实施例中的客户端可以为安装在终端设备上的信息应用程序，如：短消息应用程序。该客户端运行时可以通过终端设备的硬件完成与云设备的消息交互。客户端也可以为终端设备。下面实施例中以客户端是终端设备为例进行介绍。
图1A是本申请实施例提供的通信系统的一架构示意图。
如图1A所示，本申请实施例提供的通信系统包括云设备和终端设备，该云设备可以与终端设备通过网络进行通信。终端设备可以响应于用户的操作，向云设备发送第一富媒体消息，第一富媒体消息包括用户的意图信息，云设备可以根据意图信息确定第二富媒体消息，并向终端设备发送第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序用于用户执行意图信息所指示的意图；然后，终端设备可以根据目标小程序的信息显示目标小程序的描述页面。
本申请实施例中，第一富媒体消息和第二富媒体消息可以是短消息，如：5G短消息，或者未来网络的短消息。用户的意图信息指的是用户触发第一富媒体消息的目的，如：购买车票、参加调研、用户注册、缴费等。
本申请实施例中的小程序(MiniApp)可以是前面术语部分所介绍的富媒体消息小程序。这些小程序通常是服务提供商为用户提供一种或多种服务的RCS程序。如：“10086”小程序、“12306铁路”小程序或“大众点评”小程序等，这些小程序的后台设备上安装的聊天机器人(Chatbot)可以与用户进行富媒体消息交互。用户与这些服务提供商的Chatbot 交互的富媒体消息也可以称为行业消息。
本申请实施例中，终端设备表示支持富媒体消息业务的数字移动通信终端，通常安装有富媒体消息客户端，也就是通过富媒体消息客户端支持富媒体消息业务。
可以理解，终端设备仅是一种命名，其也可以一般性地称为：终端设备、用户设备(user equipment，UE)、接入终端、用户单元、用户站、移动站、移动台、远方站、远程终端、移动设备、用户终端、终端、无线通信设备、用户代理或用户装置。
终端设备可以是一种向用户提供语音/数据的设备，例如，具有无线连接功能的手持式设备、车载设备等。目前，一些终端设备的举例为：手机(mobile phone)、平板电脑、笔记本电脑、掌上电脑、移动互联网设备(mobile internet device，MID)、可穿戴设备，虚拟现实(virtual reality，VR)设备、增强现实(augmented reality，AR)设备、工业控制(industrial control)中的无线终端、无人驾驶(self driving)中的无线终端、远程手术(remote medical surgery)中的无线终端、智能电网(smart grid)中的无线终端、运输安全(transportation safety)中的无线终端、智慧城市(smart city)中的无线终端、智慧家庭(smart home)中的无线终端、蜂窝电话、无绳电话、会话启动协议(session initiation protocol，SIP)电话、无线本地环路(wireless local loop，WLL)站、个人数字助理(personal digital assistant，PDA)、具有无线通信功能的手持设备、计算设备或连接到无线调制解调器的其它处理设备、可穿戴设备，5G网络中的终端设备或者未来演进的公用陆地移动通信网络(public land mobile network，PLMN)中的终端设备等，本申请实施例对此并不限定。
作为示例而非限定，在本申请实施例中，该终端设备还可以是可穿戴设备。可穿戴设备也可以称为穿戴式智能设备，是应用穿戴式技术对日常穿戴进行智能化设计、开发出可以穿戴的设备的总称，如眼镜、手套、手表、服饰及鞋等。可穿戴设备即直接穿在身上，或是整合到用户的衣服或配件的一种便携式设备。可穿戴设备不仅仅是一种硬件设备，更是通过软件支持以及数据交互、云端交互来实现强大的功能。广义穿戴式智能设备包括功能全、尺寸大、可不依赖智能手机实现完整或者部分的功能，例如：智能手表或智能眼镜等，以及只专注于某一类应用功能，需要和其它设备如智能手机配合使用，如各类进行体征监测的智能手环、智能首饰等。
本申请实施例中，用于实现终端设备的功能的装置可以是终端设备，也可以是能够支持终端设备实现该功能的装置，例如芯片系统或芯片，该装置可以被安装在终端设备中。本申请实施例中，芯片系统可以由芯片构成，也可以包括芯片和其他分立器件。
此外，终端设备也可以称为5G消息终端或者RCS客户端(RCS client)。下文为统一，用终端设备进行描述。
云设备可以是通信运营商建立的对接行业客户的平台，主要用于实现行业客户Chatbot和消息的接入管理、鉴权、行业消息中多媒体内容上传与存储等功能，使行业客户可以为用户提供多种媒体格式的消息服务。云设备还可支持富媒体消息小程序业务权限认证，也即确定是否允许终端设备使用富媒体消息小程序业务。云设备可以是物理机也可以是虚拟机(virtual machine，VM)或容器(container)。
作为示例，云设备可以为消息即服务(Messaging as a Platform，MaaP)平台或物联网消息中心等。其中，MaaP平台还可称为聊天机器人平台(Chatbot platform)，其命名不对本申请实施例的保护范围造成限定。下文为统一，用MaaP平台进行描述。关于MaaP平台的具体介绍，后面结合图1C详细说明。
以上图1A所介绍的通信系统的结构中，终端设备通过网络与云设备进行富媒体消息的通信，云设备上可以配置有该云设备的服务提供商的小程序，云设备在识别用户的意图信息后就可以确定目标小程序，并向终端设备返回目标小程序的信息。例如，云设备也可以从小程序管理平台查询该目标小程序或目标小程序的信息，这种情况该通信系统的结构可以参阅图1B进行理解。
如图1B所示，该通信系统可以包括：云设备、小程序管理平台和终端设备。其中，终端设备可以通过网络向云设备发送第一富媒体消息，云设备识别第一富媒体消息中的用户的意图信息后，可以从小程序管理平台获取目标小程序或目标小程序的信息，然后向终端设备发送第二富媒体消息。
小程序管理平台，主要用于负责富媒体消息小程序的审核、认证、发布、汇总与存储富媒体消息小程序信息、为终端设备提供富媒体消息小程序查询服务、对富媒体消息小程序包进行存储等。小程序管理平台也可称为小程序管理服务器，或者称为或富媒体小程序管理服务器或富媒体小程序管理平台，下文为统一，用小程序管理平台描述。关于小程序管理平台的具体介绍，后面结合图1D详细说明。
图1C是适用于本申请实施例的另一通信系统的示意图。如图1C所示，该通信系统以富媒体消息系统的架构为例。该通信系统可以包括富媒体消息中心、MaaP平台、以及终端设备。富媒体消息中心可以与用户数据管理网元(如归属用户服务器(home subscriber server，HSS)，又如统一数据管理(unified data management，UDM)网元)、短信中心(即短消息服务器中心(short message service center，SMSC))、富媒体消息互通网关、电话号码映射(E.164Number URI Mapping，ENUM)或域名系统(domain name system，DNS)、安全管控系统、计费撑系统、引导服务器(bootstrapping server function，BSF)等对接。关于终端设备可能的形式，可以参考图1A中关于终端设备的描述，此处不再赘述。下面简单介绍其余设备。
1.富媒体消息中心：具备处理富媒体消息的能力，与MaaP平台对接，提供行业消息功能。如图1C所示，富媒体消息中心包括多个逻辑功能模块。作为示例，富媒体消息中心包括：IP多媒体子系统(IP multimedia subsystem，IMS)接入功能、多媒体内容存储功能、配置服务器和富媒体消息处理功能。富媒体消息中心包括的各个逻辑功能模块可以独立部署(即这些逻辑功能模块可以部署在不同的物理设备上)，或者也可以合并部署(即这些功能模块都部署在同一个物理设备上，或者说都内置于富媒体消息中心)，本申请实施例不予限制。富媒体消息中心包括的各个示例性的逻辑功能模块的功能如下。
1)IMS接入功能：主要负责用户富媒体消息信令接入和媒体接入和转发。
2)富媒体消息处理功能：主要处理个人消息、行业消息、增强通话消息的收发，进行会话管理、消息相关业务功能处理等。
3)多媒体内容存储功能：主要用于存储个人用户发送的多媒体消息文件。
4)配置服务器：或者称为设备管理(device management，DM)，主要用于存储用户业务相关数据，如协议参数、业务参数等中的至少一项。终端设备可通过访问配置服务器获取相关数据对终端设备进行业务配置。
富媒体消息中心，也可称为5G消息中心(5G message center，5G MC)，或者也可称为RCS服务提供商网络(RCS service provider network)，下文为统一，用富媒体消息中心描述。
2.MaaP平台：与富媒体消息中心对接，提供行业消息功能，承载交互式富媒体消息业务。如图1C所示，MaaP平台可包括基础功能和运营管理。其中，运营管理，主要用于运营商对Chatbot进行开通、权限配置等管理，基础功能可包括如下示例性逻辑功能模块。
1)Chatbot目录：主要用于汇总Chatbot数据信息，提供匹配、排序等算法服务，处理来自用户的Chatbot发现请求，向用户返回搜索结果。
2)Chatbot信息：主要用于存储Chatbot的相关信息，处理来自用户的Chatbot信息查询。该相关信息可包括提供该Chatbot的企业信息，如名称、商标、业务类型、联系方式等中的至少一项。该相关信息还可包括Chatbot或应用本身的信息，如Chatbot用途、应用用途、开发方信息等中的至少一项。
3)多媒体文件存储功能：主用于存储Chatbot下发的多媒体消息文件。
4)Chatbot能力开放：主要用于将富媒体消息能力进行统一抽象封装，对Chatbot提供消息接入能力。
类似地，MaaP平台所包含的逻辑功能模块可以独立部署，也可以合并部署，本申请实施例不予限制。
本申请实施例中的第一富媒体消息可以通过上述富媒体消息中心转发给MaaP平台中的Chatbot，该Chatbot可以对第一富媒体消息中用户的意图信息进行分析，以确定与该意图信息对应的目标小程序，然后再返回的第二富媒体消息中携带该目标小程序的信息，从而使客户端可以根据该目标小程序的信息显示目标小程序的描述页面，以供用户可以使用该目标小程序完成相应的意图。
图1D是适用于本申请实施例的另一通信系统的示意图。如图1D所示，该通信系统以富媒体消息系统的架构为例。如图1D所示，与图1C相比，在图1D所示的系统中，增加了小程序管理平台。
小程序管理平台可以为安全的小程序管理平台，也可以为非安全的小程序管理平台。其中，安全的小程序管理平台是由运营商或者第三方安全实体等提供，非安全的小程序管理平台是由行业客户或非安全第三方实体等提供，小程序管理平台可独立部署，或者也可内置在5G MC或者独立于5G MC部署(如部署在MaaP，或者独立部署，可与5G MC互通)，不予限制。下面介绍小程序管理平台可包括逻辑功能模块。
1)运营管理：主要用于审核富媒体消息小程序是否符合富媒体消息小程序开发规范、认证富媒体消息小程序、发布富媒体消息小程序，发布后用户才能查询到。
2)小程序包存储(即富媒体消息小程序包存储)：主要用于存储富媒体消息小程序包。
3)小程序目录(即富媒体消息小程序目录)：主要用于汇总与存储富媒体消息小程序信息。该富媒体消息小程序信息可包括该富媒体消息小程序的基本信息，如包括标识(identifier，ID)、名称、图标、版本等中的至少一项。该富媒体消息小程序信息还可包括富媒体消息小程序的详细信息，如包括富媒体消息小程序的提供商(行业客户)、业务类型、联系方式、网站，以及富媒体消息小程序用途、开发方信息等中的至少一项。
可以理解，小程序目录和Chatbot目录可以相同，也可以不同，不予限制。以小程序目录和Chatbot相同为例，一种可能的情况，在富媒体消息系统的架构中，包括一目录，该目录可以用于汇总Chatbot数据信息，即实现图1C中所述的Chatbot目录的功能，还可以用于汇总与存储富媒体消息小程序信息，即实现图1D中所述的小程序目录的功能。
4)小程序查询服务(即富媒体消息小程序查询服务)：主要用于处理终端设备的富媒体消息小程序查询请求，提供匹配、排序等算法服务，向用户返回查询结果。该查询结果可包括根据富媒体消息小程序关键字查询到的富媒体消息小程序信息，如：ID、名称、图标、版本等中的至少一项。
图1E是适用于本申请实施例的另一通信系统的示意图。如图1E所示，该通信系统以富媒体消息系统的架构为例。如图1E所示，与图1D相比，在图1E所示的系统中，小程序管理平台可直接与富媒体消息中心对接。关于各设备的描述，可参考前面的描述，此处不再赘述。
目前，在富媒体消息系统中，发送方不需要接收方同意即可向接收方发送消息。具体流程如下：
步骤1：发送方发送富媒体消息，经过主叫侧IMS接入功能发送到主叫所归属的富媒体消息处理功能，主叫消息处理功能返回已收到富媒体消息的应答。
步骤2：主叫富媒体消息处理功能向接收方所归属的富媒体消息处理功能发送富媒体消息，被叫富媒体消息处理功能返回已收到富媒体消息的应答。
步骤3：被叫富媒体消息处理功能向接收方发送富媒体消息，接收方返回成功收到富媒体消息的应答。
步骤4：接收方向主叫富媒体消息处理功能发送递送报告消息，逐跳传递，最终发送方向主叫富媒体消息处理功能返回收到递送报告的应答。
上述图1C至图1E的通信系统的结构中，终端设备都会通过2G/3G/4G/5G网络与富媒体消息中心通信，当然，本申请实施例的终端设备还可以通过无线局域网(wireless local area network，WLAN)以及任何可应用的未来网络与富媒体消息中心通信。下面以该富媒体消息中心是短消息服务器中心(short message service center，SMSC)为例，提供一种终端设备通过不同代的网络与SMSC通信的结构。
如图1F所示，该通信系统包括终端设备、SMSC，以及用于实现各种不同代的终端设备与SMSC通信的2G/3G网络设备、4G网络设备和5G网络设备。其中，终端设备可以是2G/3G终端设备、4G终端设备、5G终端设备或者IoT终端设备。在2G/3G网络中，2G/3G网络设备包括基站收发台(base transceiver station，BTS)和移动交换中心(mobile switching center，MSC)。在4G网络中，4G网络设备包括演进基站(evolved nodeB，enodeB)、服务网关(serving  gateway，SGW)，IMS和IP短消息网关(IP-short message-gateway，IP-SM-GW)。在5G网络中，5G网络设备包括用户面功能(user panel function，UPF)网元、接入和移动性管理功能(access and mobility management function，AMF)网元，短消息服务功能(short message service function，SMSF)网元。
SMSC用于实现短消息的接收、存储、转发和短消息状态报告等功能，SMSC还包括操作维护模块和与网络间传递消息、选择发送路由的网关模块。
2G/3G时代，短信网元叫做SMSC，主要用于短信的存储和转发。
4G时代，网络中新增了IP-SM-GW，IP-SM-GW主要负责转发SMSC与4G终端设备之间的上下行短消息，原有的2G/3G终端收发短信的机制不变。
5G时代，利用了4G部署的IP-SM-GW，能够为接入5G网络的终端设备提供5G短消息业务，称为SMS over IP方案。
5G网络可以很好得应用于物联网，IoT终端设备可以通过5G网络与SMSC通信。IoT终端设备与SMSC通信的方案属于SMS over网络附属存储(network attached storage，NAS)方案，为了便于IoT终端设备与SMSC通信，需要部署SMSF网元。这样，5G网络就可以为用户的终端设备和物联网的IoT终端设备提供5G短消息业务，可以满足大容量的物联网设备。
本申请实施例中，终端设备只需要与云设备进行一次富媒体消息交互，就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
本申请实施例提供的终端设备的结构可以参阅如下图2A进行理解，云设备的结构可以参阅如下图2B进行理解。
请参考图2A，为本申请实施例提供的一种终端设备的结构示意图。如图2A所示，终端设备可以包括处理器101、收发器102、存储器103以及总线104。处理器101、收发器102以及存储器103通过总线104相互连接。在本申请的实施例中，处理器101用于对终端设备10的动作进行控制管理，例如，处理器101用于执行第二富媒体消息解析以及触发显示目标小程序的描述页面的过程。收发器102用于支持终端设备10进行通信，例如：收发器102可以富媒体消息发送和接收的步骤。存储器103，用于存储终端设备10的程序代码和数据。
其中，处理器101可以是中央处理器单元，通用处理器，数字信号处理器，专用集成电路，现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框，模块和电路。处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，数字信号处理器和微处理器的组合等等。总线104可以是外设部件互连标准(Peripheral Component Interconnect，PCI)总线或扩展工业标准结构(Extended Industry Standard Architecture，EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示，图2A中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。
以上图2A介绍了终端设备的结构，下面结合图2B介绍云设备的结构。
图2B为本申请的实施例提供的云设备的一种可能的逻辑结构示意图。如图2B所示，本申请实施例提供的云设备20包括：处理器201、通信接口202、存储器203以及总线204。处 理器201、通信接口202以及存储器203通过总线204相互连接。在本申请的实施例中，处理器201用于对云设备20的动作进行控制管理，例如，处理器201用于执行意图信息解析的过程。通信接口202用于支持云设备20进行通信，例如：通信接口202可以执行富媒体消息发送和接收的步骤。存储器203，用于存储云设备20的程序代码和数据。
其中，处理器201可以是中央处理器单元，通用处理器，数字信号处理器，专用集成电路，现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框，模块和电路。处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，数字信号处理器和微处理器的组合等等。总线204可以是外设部件互连标准(Peripheral Component Interconnect，PCI)总线或扩展工业标准结构(Extended Industry Standard Architecture，EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示，图2B中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。
下面对本申请实施例提供的富媒体消息交互的方法进行描述。该方法中涉及到终端设备执行的内容可以由终端设备执行，也可以由终端设备的部件(例如处理器、芯片、或芯片系统等)执行。
如图3所示，本申请实施例提供的富媒体消息交互的方法的一实施例包括：
301.终端设备向云设备发送第一富媒体消息，第一富媒体消息包括用户的意图信息。相应地，云设备接收终端设备发送的第一富媒体消息。
本申请实施例中，终端设备可以通过各种可能的网络，以及富媒体消息中心向云设备发送第一富媒体消息，当然，云设备也可以通过富媒体消息中心和各种可能的网络向终端设备发送消息，终端设备与云设备之间消息的传递过程可以参阅前面图1A至图1F的通信系统的结构进行理解，本申请实施例中对此不作限定。
本申请实施例中，用户的意图信息指的是用户触发终端设备发送第一富媒体消息的意图或目的，如：购买车票、参加调研、用户注册、缴费等。
302.云设备确定与意图信息对应的目标小程序的信息。
该步骤302可以包括云设备确定意图信息对应的目标小程序的信息，包括：云设备对意图信息进行语义识别，以得到用于表示意图信息的目标关键信息；云设备从关键信息与小程序的信息的对应关系，确定与目标关键信息对应的目标小程序的信息。
其中，云设备可以通过文本识别技术或语义识别技术对第一富媒体消息中的意图信息进行语义识别，从而获取意图信息中的目标关键信息。本申请中，关键信息可以为关键词，或者通过一个或多个关键词概括出来的信息，可以是词，也可以是短语。目标关键信息指的是通过对意图信息进行语义识别，从中提取出的关键词，或者通过一个或多个关键词概括出来的能表示意图信息的词或短语。云设备或者其他小程序管理设备可以维护关键信息与小程序的信息的对应关系，这样，云设备在识别出目标关键信息后，就可以从关键信息与小程序的信息的对应关系中确定目标关键信息对应的目标小程序的信息。若识别意图信息后确定该意图信息中的不同关键词可以对应到不同的小程序上，可以通过比较权重的方式确定与该意图信息最匹配的关键词，从而确定目标小程序的信息。
一个行业商户可能有一个或多个小程序来提供不同的服务，云设备可以根据意图信息确定与该意图信息匹配的目标小程序。如：该云设备是“10086”后台用于与用户进行交互的设备。若云设备识别到意图信息中的关键词“缴费”或“充值”时，可以确定该意图信息对应的小程序为缴费小程序或充值小程序。
303.云设备向终端设备发送第二富媒体消息，第二富媒体消息包括目标小程序的信息。相应地，终端设备接收来自于云设备的第二富媒体消息。
目标小程序用于用户执行意图信息所指示的意图。
本申请实施例中，第一富媒体消息和第二富媒体消息可以是短消息，如：5G短消息，或者未来的6G短消息等，当然也可以是其他即时通信富媒体消息。
304.终端设备根据目标小程序的信息显示目标小程序的描述页面。
本申请实施例中，终端设备从第二富媒体消息中获取到了目标小程序的信息，就可以显示该目标小程序，该目标小程序所包含的内容会比较多，通常会显示该目标小程序的描述页面，用户可以通过点击该描述页面使用该目标小程序。这样终端设备只需要与云设备进行一次富媒体消息交互，就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
可选地，第二富媒体消息还包括富媒体消息类型信息，富媒体消息类型信息用于指示第二富媒体消息为小程序消息。当第二富媒体消息还包括富媒体消息类型信息时，在步骤304之前，还可以包括步骤304a。
304a.终端设备根据富媒体消息类型信息从第二富媒体消息中的目标字段解析目标小程序的信息。
本申请实施例中，第二富媒体消息中的富媒体消息类型信息可以是“miniapp”这样的标识，也可以是其他能表示该第二富媒体消息是小程序消息的标识。
第二富媒体消息可以通过携带不同的富媒体消息类型信息来指示该第二富媒体消息的类型。如果：该第二富媒体消息中携带视频信息，可以通过视频类型(如：video)来指示该第二富媒体消息是视频类型的富媒体消息。如果该第二富媒体消息中携带音频信息，可以通过音频类型(如：audio)来指示该第二富媒体消息是音频类型的富媒体消息。
每种类型的富媒体消息都可以在相应字段上承载终端设备要解析的信息，如下表1所示：
表1：富媒体消息类型与相应信息字段的对应关系
其中，S1、S2和S3分别表示相应信息的起始字节，O1、O2和O3分别表示相应信息从起始字节开始的偏移量。如第二富媒体消息中携带了富媒体消息类型信息“miniapp”，则表示目标小程序的信息在第二富媒体消息中的起始位置是S1字节处以及接下来偏移量O1的目标字段都承载的是目标小程序的信息。该表1中的不同富媒体消息类型所对应的目标字段通 常是预先配置在终端设备中，或者，云设备和终端设备预先协商好的。
终端设备识别到该富媒体消息类型信息后，就可以确定该第二富媒体消息是小程序消息，然后终端设备可以在该小程序类型所对应的目标字段上解析目标小程序的信息，从而可以提高获取目标小程序的信息的速度。
本申请实施例中，关于在富媒体消息中携带用于指示小程序类型的富媒体消息类型信息的方式可以是：可以是在单卡片富媒体(Single Rich Card)消息或多卡片富媒体(Carousel of Rich Cards)消息的内容(content)数据类型中增加miniApp数据类型，包含小程序的信息相关字段。也可以通过扩展Single Rich Card或Carousel of Rich Cards富媒体消息的content数据类型中media数据类型，在该media数据类型中增加mediaContentType数据类型取值(例如：app/miniapp)。
本申请实施例中，目标小程序的信息包括页面展示信息。页面展示信息指的是终端设备会显示出来的信息，页面展示信息可以是预先为该目标小程序配置好的文案，其中，可以包括文字、图片、音频或视频中的至少一种。
本申请实施例中，目标小程序的信息还可以包括非页面展示信息。非页面展示信息指的是终端设备不需要展示出来的信息，这些信息终端设备可以用来运行目标小程序。
终端设备会显示目标小程序的描述页面，该描述页面上不仅会包含页面展示信息，还可以包含终端设备确定需要在该描述页面上显示的其他信息，如：目标小程序的操作入口。目标小程序的操作入口也可以理解为是目标小程序的访问链接，通过该操作入口就可以使用该目标小程序执行相应的用户意图。
目标小程序的操作入口与小程序引擎接口关联。小程序引擎接口指的是用于调用小程序的引擎的接口，小程序的引擎可以是一个插件(代码包)，该插件可以在终端设备的版本升级时自动配置到终端设备。
目标小程序的描述页面可以是富媒体卡片的形式，富媒体卡片指的是以卡片形式显示目标小程序的访问链接，以及文字、图片、音频或视频中的至少一种类型的信息。
非页面展示信息可以包括目标小程序的标识。目标小程序的标识可以用作目标小程序其他信息的索引。
非页面展示信息还可以包括目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号中的至少一个。
关于目标小程序的信息所包含的内容还可以参阅下表2进行理解。
表2：目标小程序的信息

当然，上述小程序的标识(appId)通常是必须的，目标小程序的信息中会包含appId，终端设备可以通过appId查找到小程序的应用包或者下载地址。其他如：小程序的名称(appName)、小程序的下载地址(appUrl)、小程序的内容描述信息(contentDescription)，以及小程序的应用包(appPackage)都是可选地，这对这些可选的信息，目标小程序的信息可以包含其中一个或多个，也可以一个都不包含。
终端设备在接收到用户对操作入口的操作时，可以根据非页面展示信息获取目标小程序的应用包，调用小程序引擎接口，以运行目标小程序的应用包，并显示目标小程序的操作页面。
本申请实施例中，关于获取目标小程序的应用包可以有如下几种不同方案，下面分别进行介绍。
1.目标小程序的信息中包括目标小程序的应用包。
若目标小程序的信息中包括目标小程序的应用包，则终端设备在接收到用户对目标小程序的操作入口的操作后，就可以调用小程序引擎接口运行该目标小程序的应用包，显示目标小程序的操作页面。目标小程序的操作页面指的是用户可以输入信息完成相应意图的页面。该种方式可以直接运行目标小程序的信息中包含的目标小程序的应用包，从而节省了查找目标小程序的应用包的时间。
2.通过目标小程序的标识获取目标小程序的应用包。
终端设备可以使用目标小程序的标识获取目标小程序的应用包，这样不需要第二富媒体消息中携带目标小程序的应用包，可以减少第二富媒体消息的字节长度，提高第二富媒体消息的传输效率。
通过目标小程序的标识获取目标小程序的应用包可以有如下两种不同的方式：
2-1.从本地存储空间获取目标小程序的应用包。
终端设备根据目标小程序的标识查询本地存储空间；若目标小程序的应用包存储在本地存储空间，则终端设备从本地存储空间获取目标小程序的应用包。
若目标小程序的信息中包括目标小程序的应用包的最新版本号，则终端设备可以通过比较版本号确定本地存储空间中存储的是否是最新版本的目标小程序的应用包，若是最新版本的，再从本地存储空间获取目标小程序的应用包。这样，可以使终端设备运行到最新版本的目标小程序的应用包。
2-2.从下载地址下载目标小程序的应用包。
若本地存储空间没有存储目标小程序的应用包，则终端设备可以根据目标小程序的标识确定对应的下载地址，从该下载地址下载目标小程序的应用包。该下载地址可以存储在终端设备的表格中，该表格中可以存储有目标小程序的标识和目标小程序的应用包的下载地址的对应关系，终端设备可以从目标小程序的标识和目标小程序的应用包的下载地址的对应关系中，查找到目标小程序的标识对应的下载地址。
3.目标小程序的信息中包括目标小程序的下载地址。
因为目标小程序的信息中包括目标小程序的下载地址，终端设备可以直接使用该下载 地址下载目标小程序的应用包。不需要再通过目标小程序的标识查找下载地址，从而加快了目标小程序的应用包的下载速度。
4.终端设备不允许默认下载目标小程序的应用包。
若终端设备不允许默认下载目标小程序的应用包，目标小程序的描述页面还包括第一提示按钮和第二提示按钮，第一提示按钮用于指示获取目标小程序的应用包，第二提示按钮用于指示不获取目标小程序的应用包，其中，第一提示按钮为目标小程序的操作入口。用户点击了第一提示按钮，终端设备就可以获取目标小程序的应用包。这种情况下目标小程序的应用包的获取方式可以参阅前面的方案1至方案3进行理解。
以上介绍了终端设备与云设备进行富媒体消息交互显示目标小程序的描述页面，以及终端设备运行目标小程序的应用包后可以显示目标小程序的操作界面的方案，下面以终端设备是手机为例，参阅附图对上述过程进行示例性描述。
如图4A所示，用户使用手机操作信息应用401，该信息应用为短消息应用，手机响应于用户对信息应用401的点击操作，显示如图4B所示的界面。在图4B所示的界面中，用户给收件人“行业商户A”402发富媒体消息，该处“行业商户A”402可以是行业商户A的接收号码或者用户存储在通讯录中的行业商户A的备注名称。手机可以响应用户对收件人“行业商户A”的选择操作，显示如图4C所示的界面，该图4C所示的界面为短消息输入界面，其中包括收件人信息窗口和信息输入窗口，收件人信息窗口中已输入了“行业商户A”，信息输入窗口也就是图4C中的输入框。在图4C所示的界面中，用户通过操作图4C界面上的软键盘在输入框中输入“意图信息”，然后点击发送按钮403，手机响应用户对“意图信息”的发送操作，向云设备发送第一富媒体消息，该第一富媒体消息中包括该意图信息。云设备接收到第一富媒体消息后对该意图信息进行识别，确定与该意图信息匹配的目标小程序为小程序A，则如图4D所示的，云设备向手机发送第二富媒体消息，手机上显示第二富媒体消息中携带的小程序A的描述页面。小程序A的描述页面上包括用户对小程序A的操作入口404。用户点击该操作入口404，手机响应用户对该操作入口404的点击操作，调用小程序引擎接口运行小程序A的应用包，显示如图4E所示的界面。关于手机获取小程序A的应用包的方案可以参阅前面介绍的几种方案进行理解。该图4E所示的界面为小程序A的操作页面，如图4E中，该小程序A可以包含服务1、服务2和服务3三种服务，图4E中显示的是服务1的操作页面，用户可以在服务1的操作区域输入信息或选择信息，从而完成相应意图。用户完成相应意图后，可以点击退出小程序按钮405退出小程序A，手机响应用户对退出小程序按钮405的点击操作，退出小程序A，显示如图4F所示的界面。如果用户还需要再使用小程序A，则可以再次点击小程序A的描述页面上的操作入口，重复上述过程。
下面再以收件方是12306为例对上述过程进行示例性的介绍。
如图5A所示，用户使用手机操作信息应用501，手机响应于用户对信息应用501的点击操作，显示如图5B所示的界面。在图5B所示的界面中，用户给收件人“12306”502发富媒体消息，手机可以响应用户对收件人“12306”502的选择操作，显示如图5C所示的界面。在图5C所示的界面中，用户在输入框中输入的意图信息为“购票”，然后点击发送按钮503，手机响应用户对“购票”的发送操作，向云设备发送第一富媒体消息，该第一富媒体消息 中包括“购票”云设备接收到第一富媒体消息后对“购票”进行识别，确定与“购票”匹配的目标小程序为12306的购票小程序，则如图5D所示的，云设备向手机发送第二富媒体消息，手机上显示第二富媒体消息中携带的购票小程序的描述页面。该描述页面中包括12306购票小程序的展示信息，如：图5D中的“起始地”、“目的地”、表示时间的“06月07日，今天”字样，“高铁/动车”、“学生票”，以及火车的图片，这些信息可以是第二富媒体消息中的目标小程序的信息中的页面展示信息。这些信息可以是行业商户预先配置在云设备中的，客户端接收到第二富媒体消息，解析出这些页面展示信息后，会再封装如图5D中的“购买车票”504这样的操作入口到描述页面上与页面展示信息一起显示。“购买车票”504这个操作入口与小程序引擎接口关联，用户点击“购买车票”504这个操作入口后，就可以调用小程序引擎接口。
在图5D中，用户不仅可以点击“购买车票”504这个操作入口，还可以点击“起始地”、“目的地”、表示时间的“06月07日，今天”字样，“高铁/动车”、“学生票”，这些可以进行信息选择的按钮。若用户点击“起始地”，则可以显示如图5E所示的界面，用户可以选择车发车站，如图5E中用户选择的出发车站为“南京”505，则“起始地”中的信息更新为南京。用户继续选择“目的地”，如图5F所示，用户选择终点车站为“上海”506，则“目的地”中的信息更新为上海。用户继续选择出发时间，如图5G所示，用户选择了“2022年06月07日”作为出发时间507。接下来用户还可以继续选择“高铁”，然后点击如图5D中的“购买车票”504，就可以显示如图5H所示的操作页面，在该操作页面上，用户可以查看列车信息，如图5H中的从南京到上海的G105列车和G115列车，用户还可以点击“查看更多”查看更多列车的信息。如果用户选择了G105列车，则可以点击该趟列车的按钮508继续输入乘车人信息等，完成支付后，即可以收到如图5H中的“订票成功”信息。
以上所介绍的示例中手机支持默认下载小程序的应用包。如果手机不支持默认下载小程序的应用包，则需要在目标小程序的描述页面中添加第一提示按钮和第二提示按钮，如图5I所示，该描述页面中“使用小程序购票”509可以为第一提示按钮，“不使用小程序购票”510可以为第二提示按钮，若用户点击“使用小程序购票”509，则可以实现上述的购票过程。
本申请实施例所介绍的富媒体消息交互的多个方案，终端设备和云设备都通过一次富媒体消息交互就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
以上介绍了富媒体消息交互的方法，下面结合附图介绍本申请实施例中的客户端和云设备。
如图6所示，本申请实施例提供的客户端60的一实施例包括：
发送单元601，用于向云设备发送第一富媒体消息，第一富媒体消息包括用户的意图信息。如执行上述方法实施例中的步骤301。
接收单元602，用于接收来自于云设备的第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序的信息是云设备根据意图信息确定的，目标小程序用于用户执行 意图信息所指示的意图。如执行上述方法实施例中的步骤303。
显示单元603，用于根据目标小程序的信息显示目标小程序的描述页面。如执行上述方法实施例中的步骤304。
本申请实施例中，客户端和云设备都通过一次富媒体消息交互就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
可选地，客户端还包括处理单元604，第二富媒体消息还包括富媒体消息类型信息，富媒体消息类型信息用于指示第二富媒体消息为小程序消息。
处理单元604，用于根据富媒体消息类型信息从第二富媒体消息中的目标字段解析目标小程序的信息。如执行上述方法实施例中的步骤304a。
可选地，目标小程序的信息包括页面展示信息；目标小程序的描述页面包括页面展示信息，以及目标小程序的操作入口，目标小程序的操作入口与目标小程序的小程序引擎接口关联。
可选地，目标小程序的信息还包括目标小程序的标识。
可选地，目标小程序的信息还包括目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号中的至少一个。
可选地，处理单元604，还用于响应于用户对目标小程序的操作入口的操作，获取目标小程序的应用包；调用小程序引擎接口，以运行目标小程序的应用包。
显示单元603，还用于显示目标小程序的操作页面。
可选地，处理单元604，具体用于从目标小程序的信息中获取目标小程序的应用包。
可选地，处理单元604，具体用于根据目标小程序的信息中的目标小程序的标识获取目标小程序的应用包。
可选地，处理单元604，具体用于根据目标小程序的信息中包含的下载地址获取目标小程序的应用包。
可选地，处理单元604，具体用于根据目标小程序的标识查询本地存储空间；若目标小程序的应用包存储在本地存储空间，则从本地存储空间获取目标小程序的应用包。
可选地，处理单元604，具体用于若本地存储空间中存储的目标小程序的应用包的版本号与最新版本号相同，则从本地存储空间获取目标小程序的应用包。
可选地，处理单元604，具体用于根据目标小程序的标识确定目标小程序的应用包的下载地址；根据下载地址获取目标小程序的应用包。
可选地，目标小程序的描述页面还包括第一提示按钮和第二提示按钮，第一提示按钮用于指示获取目标小程序的应用包，第二提示按钮用于指示不获取目标小程序的应用包，其中，第一提示按钮为目标小程序的操作入口。
可选地，第一富媒体消息和第二富媒体消息为短消息。
以上所介绍的客户端中各模块的功能可以参阅上述方法实施例中终端设备所执行的步骤进行理解。
如图7所示，本申请实施例提供的云设备70的一实施例包括：
接收单元701，用于接收客户端发送的第一富媒体消息，第一富媒体消息包括用户的意图信息。如执行上述方法实施例中的步骤301。
处理单元702，用于确定意图信息对应的目标小程序的信息；如执行上述方法实施例中的步骤302。
发送单元703，用于向客户端发送第二富媒体消息，第二富媒体消息包括目标小程序的信息，目标小程序用于用户执行意图信息所指示的意图。如执行上述方法实施例中的步骤303。
本申请中，云设备识别意图信息后确定对应的目标小程序，然后向客户端发送第二富媒体消息，客户端从第二富媒体消息中获取到了目标小程序的信息，就可以显示该目标小程序，该目标小程序所包含的内容会比较多，通常会显示该目标小程序的描述页面，用户可以通过点击该描述页面使用该目标小程序。这样客户端只需要与云设备进行一次富媒体消息交互，就可以获得能执行用户意图的目标小程序，进而操作该目标小程序就可以完成相应意图。相对于多次富媒体消息交互才能完成用户意图，降低了操作复杂度，提高了富媒体消息交互的效率。
可选地，处理单元702，具体用于对意图信息进行语义识别，以得到用于表示意图信息的目标关键信息；从关键信息与小程序的信息的对应关系，确定与目标关键信息对应的目标小程序的信息。
可选地，第二富媒体消息还包括富媒体消息类型信息，富媒体消息类型信息用于指示第二富媒体消息为小程序消息。
可选地，目标小程序的信息包括页面展示信息。
可选地，目标小程序的信息还包括目标小程序的标识，或者，目标小程序的信息还包括目标小程序的名称、目标小程序的内容描述信息、目标小程序的应用包的下载地址、目标小程序的应用包、或目标小程序的最新版本号中的至少一个。
以上所介绍的云设备中各模块的功能可以参阅上述方法实施例中云设备所执行的步骤进行理解。
需要说明的是，上述客户端的发送单元601和接收单元602可以通过收发器来实现。云设备中的接收单元701和发送单元703可以通过通信接口来实现。
在本申请的另一实施例中，还提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机执行指令，当终端的处理器执行该计算机执行指令时，终端设备执行上述图3至图5I中终端设备所执行的步骤。
在本申请的另一实施例中，还提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机执行指令，当终端的处理器执行该计算机执行指令时，云设备执行上述图3至图5I中云设备所执行的步骤。
在本申请的另一实施例中，还提供一种计算机程序产品，该计算机程序产品包括计算机程序代码，当计算机程序代码在计算机上执行时，计算机设备执行上述图3至图5I中终端所执行的步骤。
在本申请的另一实施例中，还提供一种芯片系统，该芯片系统包括一个或多个接口电路和一个或多个处理器；接口电路和处理器通过线路互联；接口电路用于从终端的存储器接收信号，并向处理器发送信号，信号包括存储器中存储的计算机指令；当处理器执行计算机指令时，终端执行前述上述图3至图5I中终端设备所执行的步骤。在一种可能的设计中，芯片系统还可以包括存储器，存储器，用于保存控制设备必要的程序指令和数据。该芯片系统，可以由芯片构成，也可以包含芯片和其他分立器件。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。
当使用软件实现所述集成的单元时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line，DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘(solid state disk，SSD))等。

Claims (25)

  1. 一种富媒体消息交互的方法，其特征在于，包括：
    客户端向云设备发送第一富媒体消息，所述第一富媒体消息包括用户的意图信息；
    所述客户端接收来自于所述云设备的第二富媒体消息，所述第二富媒体消息包括目标小程序的信息，所述目标小程序的信息是云设备根据所述意图信息确定的，所述目标小程序用于用户执行所述意图信息所指示的意图；
    所述客户端根据所述目标小程序的信息显示所述目标小程序的描述页面。
  2. 根据权利要求1所述的方法，其特征在于，所述第二富媒体消息还包括富媒体消息类型信息，所述富媒体消息类型信息用于指示所述第二富媒体消息为小程序消息；所述方法还包括：
    所述客户端根据所述富媒体消息类型信息从所述第二富媒体消息中的目标字段解析所述目标小程序的信息。
  3. 根据权利要求1或2所述的方法，其特征在于，所述目标小程序的信息包括页面展示信息；所述目标小程序的描述页面包括所述页面展示信息，以及所述目标小程序的操作入口，所述目标小程序的操作入口与所述目标小程序的小程序引擎接口关联。
  4. 根据权利要求3所述的方法，其特征在于，所述目标小程序的信息还包括所述目标小程序的标识。
  5. 根据权利要求4所述的方法，其特征在于，所述目标小程序的信息还包括所述目标小程序的名称、所述目标小程序的内容描述信息、所述目标小程序的应用包的下载地址、所述目标小程序的应用包、或所述目标小程序的最新版本号中的至少一个。
  6. 根据权利要求5所述的方法，其特征在于，所述方法还包括：
    响应于用户对所述目标小程序的操作入口的操作，所述客户端获取所述目标小程序的应用包；
    所述客户端调用所述小程序引擎接口，以运行所述目标小程序的应用包；
    所述客户端显示所述目标小程序的操作页面。
  7. 根据权利要求6所述的方法，其特征在于，所述客户端获取所述目标小程序的应用包，包括：
    所述客户端从所述目标小程序的信息中获取所述目标小程序的应用包。
  8. 根据权利要求6所述的方法，其特征在于，所述客户端获取所述目标小程序的应用包，包括：
    所述客户端根据所述目标小程序的信息中的所述目标小程序的标识获取所述目标小程序的应用包。
  9. 根据权利要求6所述的方法，其特征在于，所述客户端获取所述目标小程序的应用包，包括：
    所述客户端根据所述目标小程序的信息中包含的下载地址获取所述目标小程序的应用包。
  10. 根据权利要求8所述的方法，其特征在于，所述客户端根据所述目标小程序的标识 获取所述目标小程序的应用包，包括：
    所述客户端根据所述目标小程序的标识查询本地存储空间；
    若所述目标小程序的应用包存储在所述本地存储空间，则所述客户端从所述本地存储空间获取所述目标小程序的应用包。
  11. 根据权利要求10所述的方法，其特征在于，所述若所述目标小程序的应用包存储在所述本地存储空间，则客户端从所述本地存储空间获取所述目标小程序的应用包，包括：
    若所述本地存储空间中存储的目标小程序的应用包的版本号与所述最新版本号相同，则客户端从所述本地存储空间获取所述目标小程序的应用包。
  12. 根据权利要求8所述的方法，其特征在于，所述客户端根据所述目标小程序的标识获取所述目标小程序的应用包，包括：
    所述客户端根据所述目标小程序的标识确定所述目标小程序的应用包的下载地址；
    所述客户端根据所述下载地址获取所述目标小程序的应用包。
  13. 根据权利要求3-12任一项所述的方法，其特征在于，所述目标小程序的描述页面还包括第一提示按钮和第二提示按钮，所述第一提示按钮用于指示获取所述目标小程序的应用包，所述第二提示按钮用于指示不获取所述目标小程序的应用包，其中，所述第一提示按钮为所述目标小程序的操作入口。
  14. 根据权利要求1-13任一项所述的方法，其特征在于，所述第一富媒体消息和所述第二富媒体消息为短消息。
  15. 一种富媒体消息交互的方法，其特征在于，包括：
    云设备接收客户端发送的第一富媒体消息，所述第一富媒体消息包括用户的意图信息；
    所述云设备确定所述意图信息对应的目标小程序的信息；
    所述云设备向所述客户端发送第二富媒体消息，所述第二富媒体消息包括所述目标小程序的信息，所述目标小程序用于用户执行所述意图信息所指示的意图。
  16. 根据权利要求15所述的方法，其特征在于，所述云设备确定所述意图信息对应的目标小程序的信息，包括：
    所述云设备对所述意图信息进行语义识别，以得到用于表示所述意图信息的目标关键信息；
    所述云设备从关键信息与小程序的信息的对应关系，确定与所述目标关键信息对应的目标小程序的信息。
  17. 根据权利要求15或16所述的方法，其特征在于，所述第二富媒体消息还包括富媒体消息类型信息，所述富媒体消息类型信息用于指示所述第二富媒体消息为小程序消息。
  18. 根据权利要求15-17任一项所述的方法，其特征在于，所述目标小程序的信息包括页面展示信息。
  19. 根据权利要求18所述的方法，其特征在于，所述目标小程序的信息还包括所述目标小程序的标识。
  20. 根据权利要求19所述的方法，其特征在于，所述目标小程序的信息还包括所述目标小程序的名称、所述目标小程序的内容描述信息、所述目标小程序的应用包的下载地址、 所述目标小程序的应用包、或所述目标小程序的最新版本号中的至少一个。
  21. 一种客户端，其特征在于，包括：收发器、处理器和存储器，所述收发器和所述处理器与存储器耦合，所述存储器用于存储程序或指令，当所述程序或指令被所述处理器执行时，使得所述客户端执行如权利要求1至14中任一项所述的方法。
  22. 一种云设备，其特征在于，包括：通信接口、处理器和存储器，所述通信接口和所述处理器与存储器耦合，所述存储器用于存储程序或指令，当所述程序或指令被所述处理器执行时，使得所述客户端执行如权利要求15至20中任一项所述的方法。
  23. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有指令，当所述指令在终端上运行时，使得所述终端执行如权利要求1至20中任一项所述的方法。
  24. 一种计算机程序产品，其特征在于，所述计算机程序产品包括计算机程序代码，当所述计算机程序代码在计算机上运行时，使得所述计算机执行如权利要求1至20中任一项所述的方法。
  25. 一种通信系统，其特征在于，包括客户端和云设备，所述客户端用于执行上述权利要求1至14中任一项所述的方法，所述云设备用于执行上述权利要求15至20中任一项所述的方法。
PCT/CN2023/078333 2022-06-15 2023-02-27 一种富媒体消息交互的方法、客户端、云设备及通信系统 WO2023241093A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210675109.XA CN117278509A (zh) 2022-06-15 2022-06-15 一种富媒体消息交互的方法、客户端、云设备及通信系统
CN202210675109.X 2022-06-15

Publications (1)

Publication Number Publication Date
WO2023241093A1 true WO2023241093A1 (zh) 2023-12-21

Family

ID=89193101

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/078333 WO2023241093A1 (zh) 2022-06-15 2023-02-27 一种富媒体消息交互的方法、客户端、云设备及通信系统

Country Status (2)

Country Link
CN (1) CN117278509A (zh)
WO (1) WO2023241093A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6848004B1 (en) * 1999-11-23 2005-01-25 International Business Machines Corporation System and method for adaptive delivery of rich media content to a user in a network based on real time bandwidth measurement & prediction according to available user bandwidth
US20120089499A1 (en) * 2000-06-29 2012-04-12 Balthaser Online, Inc. Methods, systems, and processes for the design and creation of rich-media applications via the internet
CN110225203A (zh) * 2019-06-12 2019-09-10 中卓信（北京）科技有限公司 一种富媒体短信的快应用展示装置、方法及操作方法
CN113450230A (zh) * 2021-07-12 2021-09-28 中国银行股份有限公司 一种理财风险评估方法及装置、存储介质及电子设备
CN113676852A (zh) * 2021-08-19 2021-11-19 中国银行股份有限公司 一种数据处理方法、装置及系统
CN114385382A (zh) * 2021-12-22 2022-04-22 金蝶软件（中国）有限公司 轻应用的访问方法、装置、计算机设备和存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6848004B1 (en) * 1999-11-23 2005-01-25 International Business Machines Corporation System and method for adaptive delivery of rich media content to a user in a network based on real time bandwidth measurement & prediction according to available user bandwidth
US20120089499A1 (en) * 2000-06-29 2012-04-12 Balthaser Online, Inc. Methods, systems, and processes for the design and creation of rich-media applications via the internet
CN110225203A (zh) * 2019-06-12 2019-09-10 中卓信（北京）科技有限公司 一种富媒体短信的快应用展示装置、方法及操作方法
CN113450230A (zh) * 2021-07-12 2021-09-28 中国银行股份有限公司 一种理财风险评估方法及装置、存储介质及电子设备
CN113676852A (zh) * 2021-08-19 2021-11-19 中国银行股份有限公司 一种数据处理方法、装置及系统
CN114385382A (zh) * 2021-12-22 2022-04-22 金蝶软件（中国）有限公司 轻应用的访问方法、装置、计算机设备和存储介质

Also Published As

Publication number Publication date
CN117278509A (zh) 2023-12-22

Similar Documents

Publication Publication Date Title
CN108121568B (zh) 唤起app的方法及装置、电子设备和可读存储介质
US10673680B2 (en) Electronic device providing dialog contents, server and method thereof
RU2369029C2 (ru) Обработка сообщения
EP4007374B1 (en) Information processing method and apparatus, communication device and storage medium
CN108810123B (zh) 开通移动蜂窝网络服务的方法和设备
EP1166575B1 (en) Radio handset
WO2012065381A1 (zh) 一种防止恶意软件发送数据的方法及装置
KR20090003001A (ko) 이동 통신 시스템에서 심 어플리케이션 툴킷을 제공하는장치 및 방법
US11558320B2 (en) Method and system for providing interoperability for rich communication suite (RCS) messaging with local and remote applications
CN110178354A (zh) 消息会话中继协议／超文本传输协议文件传输
CN104333643A (zh) 添加联系人的方法、系统及终端
KR20050096930A (ko) 스마트카드와 서버 사이의 통신
CN112087362A (zh) 一种客户端之间的消息转发方法和装置以及终端
CN114979984A (zh) 消息的传输方法及装置
CN114650520A (zh) 基于标准蓝牙广播实现无线网络连接的方法及装置
KR100876958B1 (ko) 다양한 사양 및 종류의 단말기와 애플리케이션 서버 간의데이터 통신을 지원하는 미들웨어 및 그 운용 방법
KR20100059344A (ko) 이동단말과 인터넷전화기 간의 데이터 동기화 방법 및 시스템
CN112995005B (zh) 虚拟网络数据交换方法和装置
WO2023241093A1 (zh) 一种富媒体消息交互的方法、客户端、云设备及通信系统
KR20140112149A (ko) Nfc 태그를 이용한 이동 단말기에서 어플리케이션 실행 시스템
Beji et al. An overview of mobile applications architecture and the associated technologies
CN110351710B (zh) 一种基于usim的终端业务功能调用方法及装置
JP2003198672A (ja) 携帯通信端末およびその制御方法
WO2023226338A1 (zh) 通信方法、装置以及系统
US11575793B2 (en) Service system supporting voice call using digital assistant device, method thereof, and non-transitory computer readable medium having computer program recorded thereon

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23822665

Country of ref document: EP

Kind code of ref document: A1