CN112243016B - Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method - Google Patents

Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method Download PDF

Info

Publication number
CN112243016B
CN112243016B CN201910649655.4A CN201910649655A CN112243016B CN 112243016 B CN112243016 B CN 112243016B CN 201910649655 A CN201910649655 A CN 201910649655A CN 112243016 B CN112243016 B CN 112243016B
Authority
CN
China
Prior art keywords
service
module
processed
applet
management service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910649655.4A
Other languages
Chinese (zh)
Other versions
CN112243016A (en
Inventor
刘玮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Senge Huanrui Intelligent Technology Co ltd
Original Assignee
Beijing Senge Huanrui Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Senge Huanrui Intelligent Technology Co ltd filed Critical Beijing Senge Huanrui Intelligent Technology Co ltd
Priority to CN201910649655.4A priority Critical patent/CN112243016B/en
Publication of CN112243016A publication Critical patent/CN112243016A/en
Application granted granted Critical
Publication of CN112243016B publication Critical patent/CN112243016B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/51Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention provides a middleware platform, terminal equipment, a 5G artificial intelligent cloud processing system and a processing method, wherein the middleware platform is arranged on a SaaS platform, and comprises the following components: a cloud service engine; an application programming interface API service layer and a plurality of management service modules are arranged in the cloud service engine; the API service layer is connected with the hosting service of the SaaS platform; the management service module is connected with an Applet module of the terminal equipment through a communication network; in the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and as the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, multiple intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.

Description

Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a middleware platform, terminal equipment, a 5G artificial intelligent cloud processing system and a processing method.
Background
A mobile network of third generation communication technology (3 rd generation, 3G) primarily for providing voice and data services, and simple internet-based connectivity for accessing mobile web pages; fourth generation communication technologies (4th generation,4G), long term evolution (Long Term Evolution, LTE) mobile networks, and publicly accessible wireless fidelity (WIRELESS FIDELITY, WIFI) networks make it possible to create richer content and more intelligent functions in local mobile applications (apps). Currently, fifth generation communication technology (5th generation,5G) mobile networks are being deployed that will integrate high-speed voice, video, streaming media and big data functions on terminal devices with the same performance as high-performance desktops running on high-speed local area networks.
Single-modality intelligence functions such as computer vision (i.e., optical recognition technology of objects that can be seen by a camera of a terminal device in a field of view), artificial intelligence can handle differences between objects seen, different data forms, natural language-based technology, and technology for speech synthesis in a conversation, which processes include content parsing and high performance requirements of data, can provide customized configuration content to a user. Other single modality functions are also emerging, such as: machine learning, chat robots, data analysis, advanced geographic location, etc. However, when these new single-mode intelligent functions are designed into the App of the terminal device, the terminal device is required to process the corresponding contents and data, which will have an effect on the performance of the terminal device in terms of storage, battery life, etc.
Therefore, a scheme capable of meeting the multi-mode intelligent function requirement of the terminal equipment and avoiding influencing the performance of the terminal equipment is needed at present.
Disclosure of Invention
The embodiment of the invention provides a middleware platform, terminal equipment, a 5G artificial intelligent cloud processing system and a processing method, which are used for solving the multi-mode intelligent function requirement of the terminal equipment.
According to a first aspect of an embodiment of the present invention, there is provided a middleware platform provided in a software as a service SaaS platform, the middleware platform including: a cloud service engine;
an Application Programming Interface (API) service layer and a plurality of management service modules are arranged in the cloud service engine;
the API service layer is connected with the hosting service of the SaaS platform;
The management service module is connected with an Applet module of the terminal equipment through a communication network;
The management service module is used for receiving the service to be processed from the Applet module;
the management service module is further used for determining corresponding hosting services according to the service to be processed;
the API service layer is used for sending the service to be processed to the corresponding hosting service;
The API service layer is further configured to receive a processed service from the corresponding hosting service, and send the processed service to the plurality of management service modules;
and the management service module is also used for sending the processed service to the Applet module.
Optionally, the management service module includes at least one of:
Content management service module, API management service module, equipment management service module, service management service module, applet management service module, logic management service module.
Optionally, the hosted service includes at least one of:
Artificial intelligence/machine learning services, image services, natural language services, analytics services, database storage services, computing services, data services, device management services, business services.
Optionally, the content management service module includes:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
A metadata database, a first API database, a device database, a first service database, an App database, a content database, a first rule database, a summary database, a first heuristic database, a first network database, a logical database.
Optionally, the API management service module includes:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
A first instance database, a registry database, a protocol database, a key database, a first micro-service database, a second API database.
Optionally, the device management service module includes:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
File handle database, device input/output database, update database, software/hardware configuration identification database, alert database, second rule database, audit log database, second heuristic database, license credential database, second network database, security authentication authorization database, device instance database.
Optionally, the service management service module includes:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
a second instance database, a configuration database, a third rule database, a third API database, a second service database, a third service database, and a fourth service database.
Optionally, the Applet management service module includes:
An Applet manager, an Applet compiler, a container engine, and an Applet database.
Optionally, the logic management service module includes:
logic editing tools;
Content management service database, API management service database, device management service database, service management service database, applet management service database.
Optionally, when the service to be processed is an image service, the corresponding hosting service is the image service;
the content management service module is used for receiving the image to be processed from the Applet module;
the content management service module is further used for matching the image to be processed with the content database and determining a processing request matched with the image to be processed;
the API service layer is further used for sending the image to be processed and the processing request to the image service, and determining a display image by the image service according to the image to be processed and the processing request;
the API service layer is further used for receiving the display image from the image service and sending the display image to the content management service module;
the content management service module is further used for sending the display image to the Applet module.
Optionally, when the service to be processed is a voice service, the corresponding hosted service is the natural language service;
The content management service module is used for receiving the voice to be processed from the Applet module;
The content management service module is further used for matching the voice to be processed with the content database and determining a processing request matched with the image to be processed;
The API service layer is further used for sending the voice to be processed and the processing request to the natural language service, and determining voice content information by the natural language service according to the voice to be processed and the processing request;
The API service layer is further used for receiving the voice content information from the natural language service and sending the voice content information to the content management service module;
The content management service module is also used for sending the voice content information to the Applet module.
Optionally, when the service to be processed is a geographic location service, the corresponding hosted service is the analysis service;
The content management service module is used for receiving the geographic position data of the terminal equipment from the Applet module;
The content management service module is further used for matching the geographic position data with the content database and determining a processing request matched with the geographic position data;
The API service layer is further used for sending the geographic position data and the processing request to the analysis service, and determining a geographic position data analysis result according to the geographic position data and the processing request by the analysis service;
The API service layer is further used for receiving the geographic position data analysis result from the analysis service and sending the geographic position data analysis result to the content management service module;
The content management service module is further used for sending the geographic position data analysis result to the Applet module.
According to a second aspect of the embodiment of the present invention, there is provided a terminal device, including an input/output module and a device component, where the device component includes an operating system, a native App is set in the operating system, an Applet module is set in the native App, and the Applet module is connected to a plurality of management service modules in a middleware platform through a communication network;
the Applet module is used for sending the service to be processed to the management service module, and the management service module processes the service to be processed;
And the Applet module is also used for receiving the processed business from the management service module.
Optionally, the native App comprises:
An intelligent function module, an embedded function module, an information function module and a dialogue function module;
The intelligent functional module is connected with the Applet module.
Optionally, the Applet module includes:
The device comprises a cache unit, a local database, a device input/output functional unit, an Applet logic unit and an Applet data unit.
Optionally, when the service to be processed is an image service,
The Applet module is used for sending an image to be processed to a content management service module in the management service module;
The Applet module is further configured to receive a display image from the content management service module.
Optionally, when the service to be processed is a voice service,
The Applet module is used for sending the voice to be processed to a content management service module in the management service module;
the Applet module is further configured to receive voice content information from the content management service module.
Optionally, when the service to be processed is a geographic location service,
The Applet module is used for sending geographic position data to a content management service module in the management service module;
the Applet module is further configured to receive a geographic location data analysis result from the content management service module.
Optionally, the intelligent functional module is configured to receive the processed service from the Applet module;
the intelligent functional module is also used for determining information to be displayed according to the processed service;
the embedded functional module is used for embedding the information to be displayed into the current display interface of the terminal equipment.
Optionally, the terminal device further includes: the starting module is internally provided with at least one preset condition;
and the starting module is used for starting the Applet module when the information received by the input/output module meets the preset condition.
Optionally, the preset condition is determined by preset preference information and/or historical statistics.
According to a third aspect of an embodiment of the present invention, there is provided a 5G artificial intelligence cloud processing system, including a SaaS platform, the SaaS platform including a hosting service, including: the 5G artificial intelligence cloud processing system further comprises: the middleware platform according to the first aspect and the terminal device according to the second aspect are arranged on a SaaS platform, and the middleware platform is connected with the terminal device through a communication network.
According to a fourth aspect of an embodiment of the present invention, there is provided a processing method applied to the middleware platform according to the first aspect, the method including:
the management service module receives a service to be processed from an Applet module of the terminal equipment;
the management service module determines corresponding hosting service according to the service to be processed;
the API service layer sends the service to be processed to the corresponding hosting service;
The API service layer receives the processed business from the corresponding managed service and sends the processed business to the management service module;
and the management service module sends the processed service to the Applet module.
Optionally, when the service to be processed is an image service, the corresponding hosting service is an image service;
the management service module receives a service to be processed from an Applet module of the terminal equipment, and comprises the following steps:
The content management service module receives an image to be processed from the Applet module;
the management service module determines corresponding hosting service according to the service to be processed, and comprises the following steps:
the content management service module matches the image to be processed with the content database, and determines a processing request matched with the image to be processed;
The API service layer sends the pending service to the corresponding hosted service, including:
the API service layer sends the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
the API service layer receives the processed service from the corresponding hosting service and sends the processed service to the management service module, including:
the API service layer receives the display image from the image service and sends the display image to the content management service module;
the plurality of management service modules send the processed business to the Applet module, comprising:
and the content management service module sends the display image to the Applet module.
Optionally, when the service to be processed is a voice service, the corresponding hosted service is a natural language service;
the management service module receives a service to be processed from an Applet module of the terminal equipment, and comprises the following steps:
the content management service module receives the voice to be processed from the Applet module;
the management service module determines corresponding hosting service according to the service to be processed, and comprises the following steps:
the content management service module matches the voice to be processed with the content database and determines a processing request matched with the voice to be processed;
The API service layer sends the pending service to the corresponding hosted service, including:
the API service layer sends the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
the API service layer receives the processed service from the corresponding hosting service and sends the processed service to the management service module, including:
the API service layer receives the voice content information from the natural language service and sends the voice content information to the content management service module;
the plurality of management service modules send the processed business to the Applet module, comprising:
And the content management service module sends the voice content information to the Applet module.
Optionally, when the service to be processed is a geographic location service, the corresponding hosting service is an analysis service;
the management service module receives a service to be processed from an Applet module of the terminal equipment, and comprises the following steps:
the content management service module receives geographic position data of the terminal equipment from the Applet module;
the management service module determines corresponding hosting service according to the service to be processed, and comprises the following steps:
The content management service module matches the geographic position data with the content database and determines a processing request matched with the geographic position data;
The API service layer sends the pending service to the corresponding hosted service, including:
The API service layer sends the geographic position data and the processing request to the analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
the API service layer receives the processed service from the corresponding hosting service and sends the processed service to the management service module, including:
The API service layer receives the geographic position data analysis result from the analysis service and sends the geographic position data analysis result to the content management service module;
the plurality of management service modules send the processed business to the Applet module, comprising:
and the content management service module sends the analysis result of the geographic position data to the Applet module.
According to a fifth aspect of an embodiment of the present invention, there is provided a processing method applied to the terminal device according to the second aspect, the method including:
The Applet module sends a service to be processed to a management service module of the middleware platform, and the management service module processes the service to be processed;
and the Applet module receives the processed service from the management service module.
Optionally, when the service to be processed is an image service,
The Applet module sends the service to be processed to a management service module of the middleware platform, and the service comprises the following steps:
the Applet module sends an image to be processed to a content management service module in the management service module;
accordingly, the Applet module receives the processed service from the management service module, including:
The Applet module receives a display image from the content management service module.
Optionally, when the service to be processed is a voice service,
The Applet module sends the service to be processed to a management service module of the middleware platform, and the service comprises the following steps:
the Applet module sends the voice to be processed to a content management service module in the management service module;
accordingly, the Applet module receives the processed service from the management service module, including:
the Applet module receives voice content information from the content management service module.
Optionally, when the service to be processed is a geographic location service,
The Applet module sends the service to be processed to a management service module of the middleware platform, and the service comprises the following steps:
The Applet module sends geographic position data to a content management service module in the management service module;
accordingly, the Applet module receives the processed service from the management service module, including:
the Applet module receives the geographical location data analysis result from the content management service module.
Optionally, the method further comprises:
The intelligent functional module receives the processed service from the Applet module;
the intelligent functional module determines information to be displayed according to the processed service;
And the embedded functional module embeds the information to be displayed into the current display interface of the terminal equipment.
Optionally, before the Applet module sends the service to be processed to the management service module of the middleware platform, the method further includes:
the starting module judges that the information received by the input/output module meets the preset condition;
and when the received information meets the preset condition, starting the Applet module.
Optionally, the preset condition is determined by preset preference information and/or historical statistics.
In the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and as the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, multiple intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a 5G artificial intelligence cloud processing system according to an embodiment of the present invention;
FIG. 2 is a second schematic diagram of a 5G artificial intelligence cloud processing system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a content management service module according to an embodiment of the present invention;
Fig. 4 is a schematic structural diagram of an API management service module according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an equipment management service module according to an embodiment of the present invention;
Fig. 6 is a schematic structural diagram of a service management service module according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an Applet management service module according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a logic management service module according to an embodiment of the present invention;
fig. 9 is one of schematic structural diagrams of a terminal device according to an embodiment of the present invention;
Fig. 10 is a second schematic structural diagram of a terminal device according to an embodiment of the present invention;
FIG. 11 is a schematic flow chart of a processing method according to an embodiment of the present invention;
FIG. 12 is a second flowchart of a processing method according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, an embodiment of the present invention provides a 5G artificial intelligence cloud processing system 1, including a Software as a service (SaaS) platform 11, where the SaaS platform 11 includes a hosting service 12, and the 5G artificial intelligence cloud processing system 1 further includes a terminal device 20 and a middleware platform 30, where the middleware platform 30 is disposed on the SaaS platform 11, and the middleware platform 30 is connected to the terminal device 20 through a communication network.
The middleware platform 30 and the terminal device 20 can be connected in various ways;
fig. 1 shows that the middleware platform 30 is connected with the terminal device 20 through the mobile network 13, specifically, the terminal device 20 transmits and receives information to the mobile network 13 through the antenna 14 so as to realize communication with the middleware platform 30;
fig. 1 also shows that the middleware platform 30 and the terminal device 20 pass through the WiFi network 15. Optionally, the WiFi network 15 interfaces with the internet of things sensor 16 through the antenna 14 to obtain communications, services, and data.
Optionally, a hosted Platform as a service (PaaS) Platform 11a is provided in the SaaS Platform 11, the PaaS Platform 11a being hosted by a third party or provided exclusively by a user.
The SaaS platform 11 includes a hosting service 12, the hosting service 12 can be divided into two major categories, namely an intelligent service and a data service, and the middleware platform 30 enables interfacing with third party SaaS providers of the intelligent service and the data service by interfacing with the hosting service 12.
The terminal device 20 is provided with an Applet (Applet) module 21, which Applet module 21 is provided in a native App (Native App) of the terminal device 20.
The Applet may also be referred to as a move Applet (Mobile Applet), and the native App may also be referred to as a native move App (Native Mobile Applet).
The middleware platform 30 interfaces with the Applet module 21.
The developer or user may install the middleware platform 30 in the hosted SaaS platform 11, for example: the middleware platform 30 is installed on the PaaS platform 11a in the SaaS platform 11.
In an embodiment of the present invention, the middleware platform 30 includes: a cloud service engine 31, an application programming interface (Application Programming Interface, API) service layer 32 and a plurality of management service modules (not shown in the figure) are provided in the cloud service engine 31. The API service layer 32 is connected to the hosting service 12 of the SaaS platform 11; the plurality of management service modules are connected to the Applet module 21 of the terminal device 20 through a communication network.
The terminal device 20 develops and stores content onto the cloud using a Web-based compiler and creation toolkit; storing developer generated content on the cloud, storing a large amount of content on a server based on different users and market segments;
The management service module of the middleware platform 30 stores user preference data associated with a plurality of end device users; based on specific content preferences of the user of the terminal device 20, digital content and services are selected and deployed onto the native App 22 in the terminal device 20;
The selected content is transmitted to an internet protocol address associated with the terminal device 20 for receipt and display on the user's terminal device as a native function to be used.
Referring to fig. 2, fig. 2 is a schematic diagram of a 5G artificial intelligence cloud processing system 1 architecture further refined on the basis of fig. 1.
The plurality of management service modules in the cloud service engine 31 include at least one of:
a content management service module 33;
An API management service module 34;
a device management service module 35;
A service management service module 36;
An Applet management service module 37;
A logic management service module 38;
The hosting service 12 of the SaaS platform 11 comprises at least one of:
Artificial intelligence (ARTIFICIAL INTELLIGENCE, AI)/machine learning (MACHINE LEARNING, ML) service 111, image service 112, natural language (Natural Language Processing, NLP) service 113, analytics service 114, database storage service 115, computing service 116, data service 117, device management service 118, business service 119.
In fig. 2, hosted services 12 may be provided through public cloud services, which may be obtained from existing public cloud providers and subscribe to a hierarchy-based set of functionality through the internet, and through a private cloud scheme. Hybrid clouds are a class of services that typically combine cloud functionality and platform/hardware type options that support hybrid functionality, including cloud bursting or elastic computing services for network load balancing, rather than dedicated virtual or dedicated server environments. Private clouds are typically designed by specialized enterprises and managed by companies, but often also contain the service functions described above.
In some embodiments, the middleware platform 30 is configured by the cloud service engine 31, utilizes at least one configured hosted service 12 (optionally labeled 111-119 in fig. 2) and presents these services through the API service layer 32, and ultimately through the mobile network 13 or WiFi network 15 to the Applet module 21 in the terminal device 20 and thus to the native App 22, providing its features, functions and smart type services to the native App 22, in accordance with logical guides, rules and standards that are typically formulated by a plurality of management services (optionally labeled 33-38 in fig. 2) stored by the management service module.
In the system shown in fig. 2, multiple native apps 22 and multiple middleware platforms 30, multiple horizontally oriented and vertically oriented use cases are included in different PaaS platform 11a options, and in different SaaS platform 11 options.
Furthermore, embodiments of the present invention provide a number of intelligent functions in some native apps 22, which can be implemented simply by configuring parameters of the cloud service engine 31, including configuration in the device management service module 35, configuration in the service management service module 36, configuration in the Applet management service module 37, and configuration in the logic management service module 38.
In some embodiments, API service layer 32 contains at least one API for loading, installing, and running one or more APPs in middleware platform 30, which isolates middleware platform 30 components from the APP that invokes it, and provides various other services to the APP.
The cloud service engine 31 has the following functions: (i) receive the device profile from the Applet module 21, and (ii) send metadata to the Applet management service module 37 which is handshaking with the logic management service module 38, (iii) process immediately after reading the content profile in the content management database, and (iv) provide smart functionality and related content to the Applet module 21, causing the Applet module 21 to be presented in the form of native features in the native App 22. The cycle can be repeated in various terminal devices using the infrastructure and multiple functions created on a large scale.
The Applet module 21 is connected to the middleware platform 30 through a Web service. Web services used by mobile client applications access the server-side traffic types of the applications via hypertext transfer protocol (Hyper Text Transfer Protocol, HTTP)/simple object access protocol (Simple Object Access Protocol, SOAP) for use in synchronous and asynchronous applications. The cloud service engine 31 provides business logic and intelligence functions for Applet instances to be modularized and presented as a containerized service.
The specific structure of the plurality of management service modules in the cloud service engine 31 is described below with reference to the drawings, respectively.
Referring to fig. 3, a specific structure of the content management service module 33 is shown. The content management service module 33 includes:
a logic editing tool 330;
A plurality of databases;
A network partition 332 for storing patterns (Schema) 3321 and files (files) 3322 of the plurality of databases;
The plurality of databases includes at least one of:
a metadata database 3301 for storing metadata information compiled by the system;
A first API database 3302 for storing APIs compiled by the third party service provider, APIs compiled by the first service database 3304, APIs created by the user, and APIs compiled in the Applet management service module 37;
A device database 3303 for storing compiled device Profile (Profile) files, types, security and configuration information;
A first service database 3304 for storing compiled service resource locators (Uniform Resource Locator, URLs), configurations, instances (instances), and scripts for instances compiled in the Applet management service module 37 and hosted by a third party;
An App database 3305 for storing the compiled App designs, content associations, functions, features, configurations, instances, and scripts mapped to the compiled managed instances in the Applet management service module 37;
a content database 3306;
A first rule database 3307 for storing content or service rules compiled in the Applet management service module 37, and device-based rules compiled in the device management service module 35;
A summary database 3308 for storing summary-based rules compiled in the content management service module 33;
A first heuristic database 3309 for storing analysis-or heuristic-based triggers, rules and data sources compiled in the device management service module 35 or in the Applet management service module 37;
A first network database 3310 for storing network configuration, authentication, protocol, and service information compiled in the device management service module 35 or in the Applet management service module 37;
a logic database 3311 for storing custom network instance information compiled in the device management service module 35 or in the Applet management service module 37;
In an embodiment of the invention, all association patterns 3321 and files 3322 for each database are partitioned using dynamic databases and storage architecture and stored in network partition 332 using a third party storage cloud in the platform (e.g., database storage service 115 in hosting service 12).
Dynamic database structures use a fully hosted real-time messaging service that allows messages to be sent and received between separate applications, and where services, parameters, files, content, etc. can be created, assembled, managed, and deployed using simple, consumable database structures. These structures are created and managed using the device management service module 35 or at the Applet management service module 37 and deployed as integrated Applet instances stored in the logical database 3311. An authenticated and secure connection between a mobile telecommunications network or private wireless network is established by using the dedicated security measures of the device management service module 35 before any database operations are performed. Through the established connection, the query string may be used to insert, delete or find information, or wake up a large-scale service.
Referring to fig. 4, a specific structure of the API management service module 34 is shown. API management service module 34 is intended to create a published application programming interface directory to facilitate reusability and discoverability of single and multiple instances across platforms. In this architecture, a composite application programming interface can be built by importing a logical APP as an interface from an interface or service provider (e.g., hosting service 12).
The API management service module 34 includes:
A logic editing tool 340;
A plurality of databases;
a network partition 342 for storing patterns 3421 and files 3422 of the plurality of databases;
The plurality of databases includes at least one of:
A first instance database 3401, a registry database 3402, a protocol database 3403, a key database 3404, a first micro service database 3405, a second micro service database 3406, and a second API database 3407.
In an embodiment of the present invention, the objective of the API management service module 34 is to separate the front-end client from the back-end, enabling developers to write and rewrite the first instance database 3401, registry database 3402, protocol database 3403, key database 3404, translate requests to the first micro service database 3405 and the second micro service database 3406, and map them to different back-ends. It is also responsible for handling many cross-domain issues such as authentication, cross-source resource sharing (Cross Origin Resource Sharing, CORS) support and response caching.
The API management service module 34 can facilitate service communication between the service provider and the cloud service engine 31, enabling automatic interconnection with the hosting service 12, the commercialized SaaS platform 11, and the Applet module 21 of the terminal device 20. All association patterns 3421 and files 3422 for each database are partitioned using dynamic databases and storage patterns and stored in network partition 342 using a third party storage cloud in the platform (e.g., database storage service 115 in hosting service 12).
In one embodiment, the API instances saved into the database are stored as published lists of services available within the platform, and these provided connections may be used dynamically with artificial intelligence services, or the APIs provided using differences. Or these APIs are provided using the differences in the terminal devices and specific access to Applet instances and are hosted in the cloud. The design allows for automatic use of dynamic functionality provided by cloud services as market or user needs change.
The developer may also import existing web services through the Open API (Open API), which may also be referred to as an Open platform, through the Open API specification or through an application programming interface that supports SOAP, remote procedure call (Remote Procedure Call, RPC), and Representational state transfer (Representational STATE TRANSFER, REST), as well as the web services description language (Web Services Description Language, WSDL) specification.
Referring to fig. 5, a specific structure of the device management service module 35 is shown. The device management service module 35 may be designed with an enterprise mobility management (ENTERPRISE MOBILE MANAGEMENT, EMM) architecture that contains a set of tools, techniques, procedures and policies for managing and maintaining the use of terminal devices, APPs, content and services within the instances so that users can securely store content, features, services and instances on the terminal device 20 through the Applet module.
The device management service module 35 includes:
A logic editing tool 350;
A plurality of databases;
A network partition 352 for storing patterns 3521 and files 3522 of the plurality of databases;
The plurality of databases includes at least one of:
file handle database 3501, device input/output database 3502, update database 3503, software/hardware configuration identification database 3504, alert database 3506, second rules database 3507, audit log database 3508, second heuristic database 3509, license credential database 3510, second network database 3511, security authentication authorization database 3512, device instance database 3513;
In an embodiment of the invention, EMM architecture is capable of executing a series of policies, such as by interfacing with native App 22 of terminal device 20 to enable device input/output database 3502 access and update database updates (e.g., authentication updates), identifying software/hardware configuration identification database 3504 (e.g., software/hardware profile information), providing alert database 3506, second rules database 3507, audit log database 3508, second heuristic database 3509. Encrypted server-side communication is employed between the Applet module 21 of the terminal device 20 and the cloud service engine 31 through secure HTTP to enable certificate management, authentication and revocation of the license certificate database 3510, and the second network database 3511 supports security policies of the security authentication authorization database 3512 by employing encrypted service communication between the Applet module 21 and the cloud service engine 31, such as: terminal equipment management (Mobile DEVICE MANAGEMENT, MDM), carrying its own equipment office (Bring Your Own Device, BYOD). All association patterns 3521 and files 3522 partition each database using dynamic databases and storage patterns and are stored in network partition 352 using a third party storage cloud of the platform (e.g., database storage service 115 in hosted service 12).
The device policy is managed by the device management service module 35 receiving a policy list corresponding to the mobile design type from the configuration files of the software/hardware configuration identification database 3504, the device alert database 3506, the second rule database 3507, the audit log database 3508, and the second heuristic database 3509, and storing the policy list in the device instance database 3513, for example: terminal device type, smart phone, tablet or smart glasses function, which likewise have different hardware configurations (display type, size, processor, operating system, storage, etc.).
When a different version of a product exists, the policy may be "inherited" from other policies currently stored in the device instance database 3513, such as: multiple configuration files may be unified based on some similar features of the hardware configuration files in the software/hardware configuration identification database 3504. Policies may specify the use and support of input/output of terminal device 20 (e.g., accelerometers, multiple cameras, or other elements defined by a developer).
Referring to fig. 6, a specific structure of the service management service module 36 is shown. The service management service module 36 includes:
a logic editing tool 360;
A plurality of databases;
a network partition 362 for storing patterns 3621 and files 3622 of the plurality of databases;
The plurality of databases includes at least one of:
A second instance database 3601, a configuration database 3602, a third rule database 3603, a third API database 3604, a second service database 3605, a third service database 3606, and a fourth service database 3607.
In an embodiment of the present invention, service management service module 36 manages a plurality of cloud infrastructure services, i.e., hosted services 12, under middleware platform 30, and service management service module 36 facilitates the cost-free and complexity-free connection, integration, and deployment of these specialized cloud services. The cloud services include intelligent services including: AI/ML services 111, image services 112 (such as image indexing, augmented reality and computer vision), NLP services 113 and analytics services 114. Data services such as database storage service 115, computing service 116, data service 117, device management service 118 (e.g., MDM service), and commerce service 119 (e.g., mobile payment or mobile wallet functionality) are also provided through the cloud.
The schema, rules, and services are stored in a second instance database 3601, a configuration database 3602, a third rules database 3603, and a third API database 3604, respectively. Third party services from hosted services 12 are stored in separate infinitely repeatable second and third service databases 3605, 3606. All association patterns 3621 and each database file 3622 are partitioned using dynamic databases and storage schemas and stored in network partition 362 using a third party storage cloud in the platform (e.g., database storage service 115 in hosted service 12).
The service management service module 36 connects, integrates and manages a plurality of service functions as required by the developer, thereby constructing service instances supporting a plurality of features, a plurality of functions and the APP. These services connect to PaaS platform 11a or to service providers such as SaaS platform 11 using secure HTTP. The service management service module 36 simultaneously manages development and management automation processes, triggers and alarms using the third rules database 3603.
Referring to fig. 7, a specific structure of the Applet management service module 37 is shown. The Applet management service module 37 includes:
an Applet manager 371, an Applet compiler 372, a container engine 373, an Applet database 374;
Wherein, a plurality of sets of binary file/class libraries (Bins/Libs) (reference numerals 3751-3754) and Applet instances (reference numerals 3755-3758) may be set in the Applet database 374, it will be understood that 4 sets of binary file/class libraries and Applet instances may be set in the Applet database 374 shown in fig. 9, and the number of sets may be other, which is not limited in particular by the embodiment of the present invention.
In the embodiment of the present invention, the Applet management service module 37 performs an application version control platform function through the Applet manager 371 while using the Applet compiler 372 as an application builder to build, compile and deploy the mobile APP and related instances (e.g., applet 1 instance 1, applet 2 instance 2, applet 3 instance 3, applet 4 instance 4 in fig. 9) and store the Applet instances in the Applet database 374.
The key to embodiments of the present invention is the container architecture, which contains a container engine 373, which container engine 373 provides specific deployment of apps and instances that run in virtual states using an architecture that supports containers (e.g., docker or Kubernetes). Another key to embodiments of the present invention is the use of a container engine (153) in place of the user's workload to coordinate computing, networking, and storage infrastructure and resources. This brings great simplicity of PaaS and flexibility of Infrastructure as a service (IaaS) AS A SERVICE and provides portability across services and Infrastructure, facilitating the assembly of different modalities in a single solution deployed as Applet module 21. This also enables us to use the functionality of binary files/class libraries, which typically provide logic and resources in a set of libraries and are executed in a virtual environment by way of example by the Applet module 21, providing intelligent functionality.
The various services managed by the Applet management service module 37 are presented as intelligent functions to the user interface in the Applet module 21 and bound to the services and deployed as application instances. For example, the Applet management service module 37 specifies an API specified by the developer, has a user interface specified in the Applet, and provides functions as a virtualization layer that appears as embedded functions in the native mobile application. Corresponding to the device profile, the Applet management service module 37 is configured to work with the service management service module 36 to provide, create and manage virtual or new container-based instances on the fly to provide enhanced computing services, service additions, heuristic or intelligent functions to the client.
Key embodiments of the method of communication between all hosted services 12 and Applet modules 21. The Applet management service module 37 is designed for high availability and dynamically configures applications and instances with artificial intelligence services based on market, network, client or content extensions. To achieve this, the system uses a proxy service based on the session initiation protocol (Session Initiation Protocol, SIP), a registration service, a rule service provided by the service management service module 36, a session service, and an HTTP proxy service. For applications requiring high availability and/or low latency, a separate quality service (Quality of Service, qoS) may also be added to the platform.
Referring to fig. 8, a specific structure of the logic management service module 38 is shown. The logic management service module 38 includes:
A logic editing tool 380;
A content management service database 381, an API management service database 382, a device management service database 383, a service management service database 384, and an Applet management service database 385;
In the embodiment of the present invention, the logic management service module 38 mainly includes a service architecture that can provide access to a large number of compiled and stored contents and services, and in particular, each class library for the content management service module 33, the API management service module 34, the device management service module 35, the service management service module 36 and the Applet management service module 37. Each service provides resources for a developer, and by using logic editing tool 380, the service can be presented as intelligent features into native mobile APPs, functions, and other services. All patterns, logic, rules, content, and files are stored in separate databases including content management service database 381, API management service database 382, device management service database 383, service management service database 384, applet management service database 385.
Referring to fig. 9, a specific structure of the terminal device 20 is shown, which includes an input/output module 23 and a device component 24, the device component 24 includes an operating system 240, a native App 22 is disposed in the operating system 240, an Applet module 21 is disposed in the native App 22, and the Applet module 21 is connected to a plurality of management service modules in the middleware platform 30 through a communication network;
The native App 22 is an App that has been loaded, installed and run on a terminal device.
The input/output module 23 shown in fig. 9 includes: accelerometer 2301, power button 2302, keyboard 2303, display 2304, user identification module (Subscriber Identification Module, SIM) card 2305, battery 2306, universal serial bus (Universal Serial Bus, USB) interface 2307, speaker 2308, microphone 2309, camera 2310 (i.e., camera 1) and camera 2311 (i.e., camera 2).
The device assembly 24 shown in fig. 9 further includes: a central processing unit (Central Processing Unit, CPU) 241, a Read Only Memory (ROM) 242, a random access Memory (Random Access Memory, RAM) 243, a CODEC (Coder-DECOder) 244, a digital signal/audio speech processor 245, an analog-to-digital/digital-to-analog converter 246, a radio frequency converter, and a power amplifier 247.
The terminal device 20 shown in fig. 9 further includes: a transmit/receive software stack 25, bluetooth/GPS 26, antenna 14.
The native App 22, applet module 21 and device component 24 interface to provide unique functions including, but not limited to: image capture using the two cameras 2310 and 2311, audio capture and speech recognition using the microphone 2309, CODEC 244, digital signal/audio speech processor 245; the camera 2310 and camera 2311 are used for augmented reality simulation, the display 2304 and bluetooth/GPS 26 for geo-location services, the native App 22, the Applet module 21 and the display 2304.
In the embodiment of the present invention, the Applet module 21 interfaces with the input/output module 23 of the device simultaneously, and the Applet module 21 is connected to the middleware platform 30 of the system through a custom-made commercial SaaS platform 11. The middleware platform 30 uses parameters established in the cloud service engine 31 and uses at least one API in the API service layer 32 to load, install and run digital services, logic, rules and related content. And execute the Applet instance in the device component 24, as well as intelligent functions and services from the App that invoked it, and provide various other services to the App.
The device component 24 can be designed, implemented (assembled) and tested as a complete closed unit separate from the operating system 240 and native App 22 of the device. The term "application software" as used herein may be any software that provides the functionality desired by the user. Thus, the device component 24 may be sold or handed to a number of different users, each of whom may install new smart functionality located in the native App 22 by loading, installing and running their own application software in the component to meet their own specific requirements for the platform system.
Thus, a developer can utilize the Applet module 21 to develop a series of intelligent functions located in the native App 22 and obtain their own App software, which is then added to the device component 24 to turn on the platform system.
In some embodiments, the terminal device 20 further includes a start module, where the start module may be a separately provided module, and the start module may also be integrated inside the CPU 241, and the embodiment of the present invention is not limited to a specific implementation manner of the start module.
Specifically, the input/output module 23 is configured to start the Applet when the information received by the input/output module meets a preset condition.
In an embodiment of the present invention, the information received by the input/output module 23 may include various categories, for example: a voice password received through the microphone 2309, an image received through the camera 2310 and/or the camera 2311, geographic location data acquired through the GPS 26, and the like. When the received information content meets the preset condition, the Applet module 21 is directly started by the starting module, the original App 22 is not required to be started first, and then the Applet module 21 is started, so that the intelligent function execution efficiency of the terminal equipment 20 is improved.
Further, the above-mentioned preset condition is determined by preset preference information and/or historical statistics, wherein the preset preference information refers to a condition autonomously set by a user, for example: the user sets a specific voice password, and when the user sends the specific voice password to the terminal equipment, the starting module starts the Applet module 21 to execute the corresponding intelligent function;
The history statistics information refers to that the terminal device collects information such as time, place, weather, brightness, personal history habit, hobbies, image content and the like in the previous use process of the user, performs statistics, and determines the characteristics of the corresponding received information when the user needs to start the Applet module 21 through analysis, for example: the user often uses the intelligent function of physical ability monitoring during running exercise, the terminal device collects geographical position data of the user often exercise, movement speed, path (i.e. movement speed, path of the terminal device 20) and the like during the user exercise, so that when the user moves like usual, the geographical position, movement speed, path and the like of the terminal device 20 are obtained through the input/output module 23, and if the preset condition is met, the starting module starts the Applet module 21 to execute the corresponding intelligent function.
Referring to fig. 10, fig. 10 further refines the specific structure of the native App 22 and Applet module 21 on the basis of fig. 9. The Applet module 21 is adapted to be designed, implemented (assembled) and tested as a complete closed unit separate from the native App 22.
Wherein the Applet module 21 comprises: a cache unit 211, a local database 212, a device input/output function unit 213, an Applet logic unit 214, an Applet data unit 215.
The native App 22 also includes: an intelligent function module 221, an embedded function module 222, an information function module 223, a dialogue function module 224; the smart function module 221 is connected to the Applet module 21.
The native App 22 also includes: menu/page/service 225;
in the embodiment of the present invention, the intelligent function module 221 can learn according to the historical data and the network data, and the intelligent capability is enhanced after learning, so that the content provided by the internet protocol address can be provided for the user according to the current requirement of the user. The image is also an intelligent function which is continuously enhanced by learning according to historical image data and network image data, and can be intelligently modified, synthesized and the like according to time, place, weather, brightness, personal historical habits and hobbies, image content and the like. The Applet module 21 makes an analysis decision on the device type to determine the logic of the input and output functions. The intelligent function can also determine the device type, configuration and operating logic by detecting.
The Applet module 21 runs within a native App 22 on a terminal device (e.g. a smart phone, mobile tablet or smart glasses). The logic management service module 38 allows developers to select unique content, services, devices and rules that they want, which are then transferred over a high speed mobile telecommunications network or a wireless data network.
The graphical user interface 220 and operating system parameters of the native App 22 are responsible for rendering platform-generated content renderings as intelligent functions. The embedded function module 222, the information function module 223, the dialogue function module 224 of the native App 22 are already provided within the network and on the terminal device provided to the user. The device management service module 35 has the following functions: (i) receive the device profile from the Applet module 21, and (ii) send metadata to the Applet management service module 37 which is handshaking with the service management service module 36, (iii) process immediately after reading the content profile in the content management service module 33, and (iv) provide the smart features and related content described in the smart function module 221 in fig. 10 to the Applet module 21, causing the Applet module 21 to present in the form of the native features in the native App 22. The cycle can be repeated in various terminal devices using the infrastructure and multiple functions created on a large scale.
Thus, users may develop or otherwise obtain their own native App 22 and add software to the device components 24. The native App 22 may be sold or handed to a number of different users, each having their own complete platform system, by loading, installing and running their own native Aapp in the component in order to meet their own specific requirements for the platform system.
Referring to fig. 11, an embodiment of the present invention provides a processing method, where an execution body of the method is a middleware platform as described above, and specific steps of the method are as follows:
Step 1101: the management service module receives a service to be processed from an Applet module of the terminal equipment;
step 1102: the management service module determines corresponding hosting service according to the service to be processed;
step 1103: the API service layer sends the service to be processed to the corresponding hosting service;
step 1104: the API service layer receives the processed business from the corresponding managed service and sends the processed business to the management service module;
step 1105: and the management service module sends the processed service to the Applet module.
In the embodiment of the invention, when the terminal equipment needs to use the intelligent function, for example: computer vision, augmented reality, voice recognition and synthesis, geographic position data analysis and the like, terminal equipment sends a service to be processed related to an intelligent function to a middleware platform through an Applet module, the middleware platform guides the service to be processed to hosting service of a SaaS platform through an internal management service module, a service processing process is completed through the hosting service, and after the processed service is received from the hosting service, the processed service is fed back to the Applet module of the terminal equipment.
The terminal device may execute the intelligent function by executing program instructions in an Applet module, where the program instructions may include at least one of the following:
(1) A first set of program instructions for causing the terminal device to receive logic and content specified by the service for implantation as intelligent features in a native App on a device connected to the mobile telecommunications network;
(2) A second set of program instructions for causing the terminal device to display the service instance in the Applet module and as an intelligent feature of the terminal device;
(3) A third set of program instructions that will perform intelligent features based on the design of the device, hardware, and operating system requirements;
(4) A fourth set of program instructions to cause the Applet module to interact with the native App and instance as intelligent movement features and to transfer content to a graphical user interface of the device;
(5) A fifth set of program instructions causes the terminal device to request information from the service and present it to the device.
The invention is described below with reference to specific examples:
example one: the intelligent function of computer vision or augmented reality of the terminal equipment is realized. The service to be processed is an image service, and the corresponding hosting service is an image service;
the computer vision may include: image recognition, pattern recognition, image understanding, etc.
Specifically, the method comprises the following steps:
(1) The content management service module receives the image to be processed from the Applet module;
The image to be processed may be an image acquired by a camera of the terminal device, and the Applet module of the terminal device instructs the processor to request to identify the acquired image through an instruction, and sends the acquired image to the content management service module of the middleware platform.
(2) The content management service module matches the image to be processed with the content database and determines a processing request matched with the image to be processed;
The content management service module uses an internal content database to match the image to be processed, and determines a corresponding processing request for requesting the image service for the content matched with the image to be processed, the display content determined according to the identification of the image to be processed, and the like.
(3) The API service layer sends the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
And calling at least one corresponding API through the API service layer to send the image to be processed and the processing request to the image service, and processing the image by the image service to obtain a display image, wherein the display image is used for displaying on the terminal equipment to complete the image of the intelligent function of the terminal equipment.
(4) The API service layer receives the display image from the image service and sends the display image to the content management service module;
(5) The content management service module sends the display image to the Applet module;
The content management service module feeds back the display image to the Applet module through the communication network to complete the intelligent function of the terminal equipment.
Example two: the intelligent function of language processing or voice synthesis of the terminal equipment is realized. The service to be processed is a voice service, and the corresponding hosting service is a natural language service;
Specifically, the method comprises the following steps:
(1) The content management service module receives the voice to be processed from the Applet module;
The voice to be processed can be voice received by a microphone of the terminal equipment or voice received by the terminal equipment through a communication network, and the Applet module of the terminal equipment requests the processor to identify the received voice through instructions, and the Applet module sends the received voice to the content management service module of the middleware platform.
(2) The content management service module matches the voice to be processed with the content database and determines a processing request matched with the voice to be processed;
the content management service module uses an internal content database to match the voice to be processed, and determines a corresponding processing request, wherein the processing request is used for requesting the processing of the voice to be processed to the natural language service, and the processing request comprises analysis semantics, voice synthesis and the like.
(3) The API service layer sends the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
Calling at least one corresponding API through an API service layer to send the voice to be processed and the processing request to natural language service, and processing the voice by the natural language service to obtain voice content information; the speech processing may include: voice parsing, namely parsing and identifying the semantics of words or sentences in voice; speech synthesis, namely synthesizing a plurality of sections of speech into a whole section of speech and the like; the voice content information is used for displaying or playing the processed voice information on the terminal equipment, and can be specifically embodied in a mode of displaying the voice content in a text form on an image section of the terminal equipment or playing the voice content in a mode of matching audio through an audio section.
(4) The API service layer receives the voice content information from the image service and sends the voice content information to the content management service module;
(5) The content management service module sends the voice content information to the Applet module;
the content management service module feeds the voice content information back to the Applet module through the communication network to complete the intelligent function of the terminal equipment.
Example three: and the intelligent function of the geographic position analysis of the terminal equipment is realized. Wherein the service to be processed is a geographic location service, and the corresponding hosting service is an analysis service;
Specifically, the method comprises the following steps:
(1) The content management service module receives geographic position data from the Applet module;
The geographical position data may be geographical position data acquired by a GPS of the terminal device, or geographical position data received by the terminal device through a communication network, or geographical position data received from an internet sensor, and the Applet module of the terminal device requests the received geographical position data to be analyzed through an instruction indication processor, and sends the received geographical position data to a content management service module of the middleware platform.
(2) The content management service module matches the geographic position data with the content database and determines a processing request matched with the geographic position data;
the content management service module matches the geographic location data using an internal content database, and determines a corresponding processing request for requesting analysis of the geographic location data from an analysis service.
(3) The API service layer sends the geographic position data and the processing request to an analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
The method comprises the steps that geographic position data and a processing request are sent to analysis service through at least one API corresponding to the API service layer call, and the analysis service processes the geographic position data to obtain a geographic position data analysis result; the geographical location data analysis result is used to reflect geographical location information of the terminal device, for example: a movement path of the terminal device, a main active area of the terminal device, etc.
(4) The API service layer receives the geographic position data analysis result from the image service and sends the geographic position data analysis result to the content management service module;
(5) The content management service module sends the voice content information to the Applet module;
and the content management service module feeds back the analysis result of the geographic position data to the Applet module through the communication network to complete the intelligent function of the terminal equipment.
In the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and as the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, multiple intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.
Referring to fig. 12, an embodiment of the present invention provides a processing method, where an execution body of the method is a terminal device as described above, and specific steps of the method are as follows:
Step 1201: the Applet module sends the service to be processed to a management service module of the middleware platform, and the management service module processes the service to be processed;
Optionally, before executing step 1201, the starting module of the terminal device determines whether the information received by the input/output module meets a preset condition; and when the received information meets the preset condition, starting the Applet module.
In the embodiment of the present invention, the preset condition is determined by preset preference information and/or historical statistics information, where the preset preference information refers to a condition autonomously set by a user, for example: the user sets a specific voice password, and when the user sends the specific voice password to the terminal equipment, the starting module starts the Applet module to execute the corresponding intelligent function;
the historical statistical information refers to that the terminal equipment collects information such as time, place, weather, brightness, personal historical habit, hobbies, image content and the like in the past using process of the user, performs statistics, and determines the characteristics of the corresponding received information when the user needs to start an Applet module through analysis, for example: the user often uses the intelligent function of physical stamina monitoring when running and taking exercise, then the terminal equipment can collect the geographical position data that the user often takes exercise, the movement speed of user's exercise, route (i.e. terminal equipment's velocity of movement, route) etc. so, when the user is moving like usual, obtain terminal equipment's geographical position, velocity of movement, route etc. through input/output module, judge to satisfy the condition of predetermineeing, then start the module and start Applet module to carry out corresponding intelligent function.
Step 1202: the Applet module receives the processed business from the management service module;
In the embodiment of the invention, when the terminal equipment needs to use the intelligent function, for example: computer vision, augmented reality, voice recognition and synthesis, geographic position data analysis and the like, terminal equipment sends a service to be processed related to an intelligent function to a middleware platform through an Applet module, the middleware platform guides the service to be processed to hosting service of a SaaS platform through an internal management service module, a service processing process is completed through the hosting service, and after the processed service is received from the hosting service, the processed service is fed back to the Applet module of the terminal equipment.
The description of the above process flow may be described with reference to a method on the middleware platform side, which is not repeated herein.
Optionally, after step 1202, the method further comprises the steps of:
(1) The intelligent functional module receives the processed service from the Applet module;
(2) The intelligent functional module determines information to be displayed according to the processed service;
(3) The embedded functional module embeds the information to be displayed in the current display interface of the terminal equipment;
In the embodiment of the invention, the terminal equipment determines the information to be displayed through the intelligent function module in the native App, and the information to be displayed corresponds to the intelligent function of the terminal equipment, for example: augmented reality, speech synthesis, geographical location data analysis, etc., and accordingly, the information to be displayed may be displayed in the form of text, audio, video, images, etc. on a display interface of the terminal device.
Specifically, the information to be displayed is embedded into the current display interface of the terminal device by utilizing the embedded function in the native App.
In the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and as the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, multiple intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.
The foregoing is merely illustrative of specific embodiments of the present application, and the scope of the present application is not limited thereto, but any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (33)

1. The middleware platform is arranged on a software as a service (SaaS) platform, and is characterized in that the SaaS platform is provided with a service PaaS platform, and the middleware platform is arranged in the service PaaS platform;
the middleware platform comprises: a cloud service engine;
an Application Programming Interface (API) service layer and a plurality of management service modules are arranged in the cloud service engine;
the API service layer is connected with the hosting service of the SaaS platform;
The management service module is connected with an Applet module of the terminal equipment through a communication network;
The management service module is used for receiving the service to be processed from the Applet module;
the management service module is further used for determining corresponding hosting services according to the service to be processed;
The API service layer is used for sending the service to be processed to the corresponding hosting service;
The API service layer is further configured to receive a processed service from the corresponding hosting service, and send the processed service to the plurality of management service modules;
and the management service module is also used for sending the processed service to the Applet module.
2. The middleware platform of claim 1, wherein the management service module comprises at least one of:
Content management service module, API management service module, equipment management service module, service management service module, applet management service module, logic management service module.
3. The middleware platform of claim 2, wherein the hosted service includes at least one of:
Artificial intelligence/machine learning services, image services, natural language services, analytics services, database storage services, computing services, data services, device management services, business services.
4. The middleware platform of claim 3, wherein the content management service module comprises:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
A metadata database, a first API database, a device database, a first service database, an App database, a content database, a first rule database, a summary database, a first heuristic database, a first network database, a logical database.
5. The middleware platform of claim 3, wherein the API management service module comprises:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
A first instance database, a registry database, a protocol database, a key database, a first micro-service database, a second API database.
6. A middleware platform according to claim 3, characterized in that said device management service module comprises:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
File handle database, device input/output database, update database, software/hardware configuration identification database, alert database, second rule database, audit log database, second heuristic database, license credential database, second network database, security authentication authorization database, device instance database.
7. A middleware platform according to claim 3, characterized in that said service management service module comprises:
logic editing tools;
A plurality of databases;
A network partition for storing patterns and files of the plurality of databases;
the plurality of databases includes at least one of:
a second instance database, a configuration database, a third rule database, a third API database, a second service database, a third service database, and a fourth service database.
8. A middleware platform according to claim 3, wherein the Applet management service module comprises:
An Applet manager, an Applet compiler, a container engine, and an Applet database.
9. The middleware platform of claim 3, wherein the logic management service module comprises:
logic editing tools;
Content management service database, API management service database, device management service database, service management service database, applet management service database.
10. The middleware platform of claim 4, wherein,
When the service to be processed is an image service, the corresponding hosting service is the image service;
the content management service module is used for receiving the image to be processed from the Applet module;
the content management service module is further used for matching the image to be processed with the content database and determining a processing request matched with the image to be processed;
the API service layer is further used for sending the image to be processed and the processing request to the image service, and determining a display image by the image service according to the image to be processed and the processing request;
the API service layer is further used for receiving the display image from the image service and sending the display image to the content management service module;
the content management service module is further used for sending the display image to the Applet module.
11. The middleware platform of claim 4, wherein,
When the service to be processed is a voice service, the corresponding hosting service is the natural language service;
The content management service module is used for receiving the voice to be processed from the Applet module;
The content management service module is further used for matching the voice to be processed with the content database and determining a processing request matched with the voice to be processed;
The API service layer is further used for sending the voice to be processed and the processing request to the natural language service, and determining voice content information by the natural language service according to the voice to be processed and the processing request;
The API service layer is further used for receiving the voice content information from the natural language service and sending the voice content information to the content management service module;
The content management service module is also used for sending the voice content information to the Applet module.
12. The middleware platform of claim 4, wherein,
When the service to be processed is a geographic position service, the corresponding hosting service is the analysis service;
The content management service module is used for receiving the geographic position data of the terminal equipment from the Applet module;
The content management service module is further used for matching the geographic position data with the content database and determining a processing request matched with the geographic position data;
The API service layer is further used for sending the geographic position data and the processing request to the analysis service, and determining a geographic position data analysis result according to the geographic position data and the processing request by the analysis service;
The API service layer is further used for receiving the geographic position data analysis result from the analysis service and sending the geographic position data analysis result to the content management service module;
The content management service module is further used for sending the geographic position data analysis result to the Applet module.
13. A terminal device comprises an input/output module and a device assembly, wherein the device assembly comprises an operating system, a native App is arranged in the operating system, the terminal device is characterized in that,
An Applet module is arranged in the native App, the Applet module is connected with a plurality of management service modules in a middleware platform through a communication network, the middleware platform is arranged in a service PaaS platform, and the service PaaS platform is arranged in a SaaS platform;
the Applet module is used for sending the service to be processed to the management service module, and the management service module processes the service to be processed;
And the Applet module is also used for receiving the processed business from the management service module.
14. The terminal device of claim 13, wherein the native App comprises:
An intelligent function module, an embedded function module, an information function module and a dialogue function module;
The intelligent functional module is connected with the Applet module.
15. The terminal device of claim 13, wherein the Applet module comprises:
The device comprises a cache unit, a local database, a device input/output functional unit, an Applet logic unit and an Applet data unit.
16. The terminal device of claim 13, wherein the terminal device,
When the service to be processed is an image service,
The Applet module is used for sending an image to be processed to a content management service module in the management service module;
The Applet module is further configured to receive a display image from the content management service module.
17. The terminal device of claim 13, wherein the terminal device,
When the service to be processed is a voice service,
The Applet module is used for sending the voice to be processed to a content management service module in the management service module;
the Applet module is further configured to receive voice content information from the content management service module.
18. The terminal device of claim 13, wherein the terminal device,
When the service to be processed is a geographic location service,
The Applet module is used for sending geographic position data to a content management service module in the management service module;
the Applet module is further configured to receive a geographic location data analysis result from the content management service module.
19. The terminal device of claim 14, wherein the terminal device,
The intelligent function module is used for receiving the processed service from the Applet module;
the intelligent functional module is also used for determining information to be displayed according to the processed service;
the embedded functional module is used for embedding the information to be displayed into the current display interface of the terminal equipment.
20. The terminal device according to claim 13, characterized in that the terminal device further comprises: the starting module is internally provided with at least one preset condition;
and the starting module is used for starting the Applet module when the information received by the input/output module meets the preset condition.
21. Terminal device according to claim 20, characterized in that the preset conditions are determined by preset preference information and/or historical statistics.
22. A 5G artificial intelligence cloud processing system comprising a SaaS platform, the SaaS platform comprising hosting services, comprising: the 5G artificial intelligence cloud processing system further comprises: the middleware platform according to any one of claims 1 to 12 and the terminal device according to any one of claims 13 to 21, wherein the middleware platform is provided on a SaaS platform, and the middleware platform is connected to the terminal device through a communication network.
23. A processing method applied to the middleware platform according to any one of claims 1 to 12, characterized in that the method comprises:
the management service module receives a service to be processed from an Applet module of the terminal equipment;
the management service module determines corresponding hosting service according to the service to be processed;
the API service layer sends the service to be processed to the corresponding hosting service;
The API service layer receives the processed business from the corresponding managed service and sends the processed business to the management service module;
and the management service module sends the processed service to the Applet module.
24. The method of claim 23, wherein the step of determining the position of the probe is performed,
When the service to be processed is an image service, the corresponding hosting service is an image service;
the management service module receives a service to be processed from an Applet module of the terminal equipment, and comprises the following steps:
The content management service module receives an image to be processed from the Applet module;
the management service module determines corresponding hosting service according to the service to be processed, and comprises the following steps:
The content management service module matches the image to be processed with a content database and determines a processing request matched with the image to be processed;
The API service layer sends the pending service to the corresponding hosted service, including:
the API service layer sends the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
the API service layer receives the processed service from the corresponding hosting service and sends the processed service to the management service module, including:
the API service layer receives the display image from the image service and sends the display image to the content management service module;
the plurality of management service modules send the processed business to the Applet module, comprising:
and the content management service module sends the display image to the Applet module.
25. The method of claim 23, wherein the step of determining the position of the probe is performed,
When the service to be processed is a voice service, the corresponding hosting service is a natural language service;
the management service module receives a service to be processed from an Applet module of the terminal equipment, and comprises the following steps:
the content management service module receives the voice to be processed from the Applet module;
the management service module determines corresponding hosting service according to the service to be processed, and comprises the following steps:
the content management service module matches the voice to be processed with a content database and determines a processing request matched with the voice to be processed;
The API service layer sends the pending service to the corresponding hosted service, including:
the API service layer sends the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
the API service layer receives the processed service from the corresponding hosting service and sends the processed service to the management service module, including:
the API service layer receives the voice content information from the natural language service and sends the voice content information to the content management service module;
the plurality of management service modules send the processed business to the Applet module, comprising:
And the content management service module sends the voice content information to the Applet module.
26. The method of claim 23, wherein the step of determining the position of the probe is performed,
When the service to be processed is a geographic position service, the corresponding hosting service is an analysis service;
the management service module receives a service to be processed from an Applet module of the terminal equipment, and comprises the following steps:
the content management service module receives geographic position data of the terminal equipment from the Applet module;
the management service module determines corresponding hosting service according to the service to be processed, and comprises the following steps:
the content management service module matches the geographic position data with a content database and determines a processing request matched with the geographic position data;
The API service layer sends the pending service to the corresponding hosted service, including:
The API service layer sends the geographic position data and the processing request to the analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
the API service layer receives the processed service from the corresponding hosting service and sends the processed service to the management service module, including:
The API service layer receives the geographic position data analysis result from the analysis service and sends the geographic position data analysis result to the content management service module;
the plurality of management service modules send the processed business to the Applet module, comprising:
and the content management service module sends the analysis result of the geographic position data to the Applet module.
27. A processing method applied to a terminal device according to any of claims 13 to 21, characterized in that the method comprises:
The Applet module sends a service to be processed to a management service module of the middleware platform, and the management service module processes the service to be processed;
and the Applet module receives the processed service from the management service module.
28. The method of claim 27, wherein the step of determining the position of the probe is performed,
When the service to be processed is an image service,
The Applet module sends the service to be processed to a management service module of the middleware platform, and the service comprises the following steps:
the Applet module sends an image to be processed to a content management service module in the management service module;
accordingly, the Applet module receives the processed service from the management service module, including:
The Applet module receives a display image from the content management service module.
29. The method of claim 27, wherein the step of determining the position of the probe is performed,
When the service to be processed is a voice service,
The Applet module sends the service to be processed to a management service module of the middleware platform, and the service comprises the following steps:
the Applet module sends the voice to be processed to a content management service module in the management service module;
accordingly, the Applet module receives the processed service from the management service module, including:
the Applet module receives voice content information from the content management service module.
30. The method of claim 27, wherein the step of determining the position of the probe is performed,
When the service to be processed is a geographic location service,
The Applet module sends the service to be processed to a management service module of the middleware platform, and the service comprises the following steps:
The Applet module sends geographic position data to a content management service module in the management service module;
accordingly, the Applet module receives the processed service from the management service module, including:
the Applet module receives the geographical location data analysis result from the content management service module.
31. The method of claim 27, wherein the method further comprises:
The intelligent functional module receives the processed service from the Applet module;
the intelligent functional module determines information to be displayed according to the processed service;
And the embedded functional module embeds the information to be displayed into the current display interface of the terminal equipment.
32. The method of claim 27, wherein before the Applet module sends the pending traffic to a management service module of a middleware platform, the method further comprises:
The starting module judges whether the information received by the input/output module meets preset conditions or not;
and when the received information meets the preset condition, starting the Applet module.
33. The method according to claim 32, wherein the preset conditions are determined by preset preference information and/or historical statistics.
CN201910649655.4A 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method Active CN112243016B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910649655.4A CN112243016B (en) 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910649655.4A CN112243016B (en) 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method

Publications (2)

Publication Number Publication Date
CN112243016A CN112243016A (en) 2021-01-19
CN112243016B true CN112243016B (en) 2024-04-23

Family

ID=74167672

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910649655.4A Active CN112243016B (en) 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method

Country Status (1)

Country Link
CN (1) CN112243016B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113347609B (en) * 2021-06-22 2023-10-03 中国科学院计算技术研究所 Wireless intelligent control platform
CN114786140A (en) * 2022-03-24 2022-07-22 兰州飞天网景信息产业有限公司 5G message SaaS cloud platform
CN116258320A (en) * 2022-12-20 2023-06-13 无锡捷通数智科技有限公司 Intelligent office system based on SaaS, data processing method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101969475A (en) * 2010-11-15 2011-02-09 张军 Business data controllable distribution and fusion application system based on cloud computing
WO2014039866A1 (en) * 2012-09-07 2014-03-13 Oracle International Corporation System and method for providing a service management engine for use with a cloud computing environment
CN104966239A (en) * 2015-06-30 2015-10-07 天津爱蔻科技有限公司 Intelligent underwriting platform based on rule engine
CN107612959A (en) * 2017-07-21 2018-01-19 哈尔滨工程大学 A kind of cloud service platform based on cloud micro services Self management
CN109861978A (en) * 2018-12-28 2019-06-07 浙江工业大学 A kind of Internet of Things SaaS platform based on MQTT agreement

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008072045A2 (en) * 2006-12-11 2008-06-19 Hari Prasad Sampath A method and system for personalized content delivery for wireless devices
US8881224B2 (en) * 2010-06-24 2014-11-04 Infosys Limited Method and system for providing masking services
US9667470B2 (en) * 2012-09-07 2017-05-30 Oracle International Corporation Failure handling in the execution flow of provisioning operations in a cloud environment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101969475A (en) * 2010-11-15 2011-02-09 张军 Business data controllable distribution and fusion application system based on cloud computing
WO2014039866A1 (en) * 2012-09-07 2014-03-13 Oracle International Corporation System and method for providing a service management engine for use with a cloud computing environment
CN104966239A (en) * 2015-06-30 2015-10-07 天津爱蔻科技有限公司 Intelligent underwriting platform based on rule engine
CN107612959A (en) * 2017-07-21 2018-01-19 哈尔滨工程大学 A kind of cloud service platform based on cloud micro services Self management
CN109861978A (en) * 2018-12-28 2019-06-07 浙江工业大学 A kind of Internet of Things SaaS platform based on MQTT agreement

Also Published As

Publication number Publication date
CN112243016A (en) 2021-01-19

Similar Documents

Publication Publication Date Title
US20220167026A1 (en) Network based media processing control
US10762143B2 (en) Extension of third party application functionality for intent determination
Carlson et al. Dynamix: An open plug-and-play context framework for android
CN112243016B (en) Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method
CN102939579A (en) Method and apparatus for binding user interface elements and granular reflective processing
CN107430512A (en) Machine is managed to the application relation in machine system
CN110399578A (en) Page access method and device
CN111770062B (en) Information processing method, device and storage medium
CN114217989A (en) Service calling method, device, equipment, medium and computer program between equipment
CN105763545B (en) A kind of BYOD method and device
CN109343970B (en) Application program-based operation method and device, electronic equipment and computer medium
US20230362683A1 (en) Operator platform instance for mec federation to support network-as-a-service
Premsankar et al. Advances in cloud computing, wireless communications and the internet of things
WO2023081202A1 (en) Mec dual edge apr registration on behalf of edge platform in dual edge deployments
CN114365467B (en) Methods, apparatuses, and computer readable media for determining 3GPP FLUS reception capability
CN104424260A (en) Browser information sharing method and device
CN112597022A (en) Remote diagnosis method, device, storage medium and electronic equipment
CN111343172A (en) Network access authority dynamic processing method and device
Stukalov et al. Method for Organizing Network Requests in iOS Applications
Paniagua Discovery and push notification mechanisms for mobile cloud services
CN117857646B (en) Data network sharing method, electronic equipment and storage medium
US11811878B1 (en) Session manager providing bidirectional data transport
CN114047922B (en) Transcoding method, device, medium and equipment for precompiled device
US20230189193A1 (en) Method and system for communication in service management and orchestration
CN102821116B (en) A kind of online service provides method, device and information system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant