CN111488147A - Intelligent layout method and device - Google Patents

Abstract

The method includes that the device identifies user intentions and selects an arrangement strategy according to an arrangement request, the arrangement request comprises the user intentions and layout elements, the arrangement strategy is used for arranging the layout elements, the device triggers an end-side intelligent arrangement software development kit SDK to carry out intelligent arrangement according to the layout elements and the arrangement strategy to generate an arranged layout description language DS L, then service intelligent arrangement is carried out according to the DS L, the device generates multi-mode data according to a service intelligent arrangement result, and a layout result is output according to a preset control and the multi-mode data.

Description

Intelligent layout method and device

Technical Field

The present application relates to the field of communications technologies, and in particular, to an intelligent layout method and apparatus.

Background

The Luban system is an intelligent design platform, and the principle of the platform is that a machine learning design is trained through an artificial intelligence algorithm and a large amount of data, and advertisement posters of webpages can be automatically generated through materials. Specifically, the platform is a set of machines which can achieve the design cognitive level through self-learning, and is very similar to the process of human learning design. A developer designs a closed-loop system which can rapidly learn design styles and continuously grow for the platform, and the closed-loop system comprises three core modules of style learning, actor and evaluation network. After the machine learns the design style from a large number of design files, the mobile generates a design result according to the design requirement, and the quality of the generated result is fed back by the evaluation network. The evaluator works on the principle that a large number of design pictures and scoring data are input, and a machine finally learns to judge the quality of the design through training.

Generally, high-quality advertisement design needs to be added to a design theme after product pictures are subjected to matting. The Luban system can automatically process massive commodity designs, automatically scratch pictures, disassemble the components of design elements and control layout, organize the elements according to styles, generate posters and dynamically realize automatic typesetting according to the sizes of the posters. In the android system, User Interface (UI) development is that UI design is adopted to acquire all Interface elements and related attributes in the design, and research and development personnel correspondingly develop and output layout codes.

Disclosure of Invention

The embodiment of the application provides an intelligent layout method and device, and the problems that a Luban system design platform is single in design style and cannot meet the requirement of business diversity are solved.

The device triggers an end-side intelligent layout software development kit SDK to carry out intelligent layout according to the layout elements and the layout strategy to generate a layout description language DS L after layout and then carries out service intelligent layout according to DS L, and the device generates multi-mode data according to the result of service intelligent layout and outputs a layout result according to a preset control and the multi-mode data.

In one possible design, the device triggering the intelligent orchestration software development kit SDK according to layout elements and an orchestration strategy comprises: the device triggers the SDK to call the intelligent arrangement engine at the end side and the intelligent arrangement engine at the cloud side to carry out intelligent arrangement according to the layout elements and the arrangement strategy; the end-side intelligent layout engine is used for arranging layout elements; the cloud-side intelligent orchestration engine is used for executing policy updates and processing layout elements. The orchestration or processing layout elements herein may also be executed by both the end-side intelligent orchestration engine and the cloud-side intelligent orchestration engine, specifically related to the computation capability of the end side, where if the computation capability of the end side is strong, the orchestration or processing layout elements may be executed on the end side, and if the computation capability of the end side is general, the orchestration or processing layout elements may be executed on the cloud side due to the strong computation capability of the cloud side. Therefore, the efficiency of the orchestration computation can be improved through the interactive execution of the end side and the cloud side.

In one possible design, the cloud-side intelligent layout engine is used for intelligently arranging layout elements and processing basic services; when the cloud-side intelligent layout engine is used for intelligently arranging layout elements, the cloud-side intelligent layout engine comprises at least one of the following algorithms or rules: a color matching algorithm, a coloring algorithm, an intelligent design algorithm, a board arrangement algorithm, a quantitative evaluation algorithm, a rule template and a color matching rule; the basic services include policy updates and service authentication. Therefore, the cloud side carries out various algorithms and rule processing on the layout elements according to the layout elements and the layout strategies, and intelligent layout of the layout elements according to the layout strategies can be realized.

In one possible design, generating an arranged layout description language DS L, and performing intelligent service arrangement according to a DS L includes generating an arranged DS L, parsing a DS L to obtain a DS L corresponding to a platform executing a layout result, and performing serial arrangement on a service corresponding to an arrangement request according to a DS L corresponding to a platform executing a layout result, that is, when a language of an operating system of a platform executing a layout result is different from the arranged DS L, parsing the arranged DS L into a DS L corresponding to the platform executing a layout result, so as to play an intelligent arrangement result in a platform device executing a layout result.

In one possible design, generating multimodal data from results of intelligent orchestration of services includes: generating multi-mode data according to the serially arranged services; wherein the multimodal includes at least one of speech, environmental information, visual information, textual information, and device information. The environment information is used to characterize the environment of the device that ultimately performs the orchestration result. The layout result may be in a form of voice or text when finally presented on a platform for executing the layout result. In this way, the orchestration results can be made to appear in a multi-modal form.

In one possible design, the preset controls include at least one of a graphical user interface GUI, a voice interaction interface VUI, and a panel interface PUI. When the preset control is GUI or PUI, the arrangement result can be presented in the form of a webpage or a display mode of a television picture or an intelligent terminal, and when the preset control is VUI, the arrangement result can be presented in the form of voice, so that multi-mode presentation of the arrangement result is realized.

The second aspect provides a device which comprises a layout logic module, a layout intelligent layout module and a service intelligent layout module, wherein the layout logic module is used for identifying user intentions and selecting layout strategies according to layout requests, the layout requests comprise the user intentions and layout elements, the layout strategies are used for arranging the layout elements, the layout intelligent layout module is used for triggering an end-side intelligent layout software development kit SDK to carry out intelligent layout according to the layout elements and the layout strategies to generate an arranged layout description language DS L, the service intelligent layout module is used for carrying out intelligent service layout according to DS L, and the multi-mode adaptation module is used for generating multi-mode data according to the result of intelligent service layout and outputting layout results according to preset controls and the multi-mode data.

In one possible design, the layout intelligence orchestration module is to: triggering the SDK to call the intelligent arranging engine at the end side and the intelligent arranging engine at the cloud side to carry out intelligent arranging according to the layout elements and the arranging strategy; the end-side intelligent layout engine is used for arranging layout elements; the cloud-side intelligent orchestration engine is used for executing policy updates and processing layout elements.

In one possible design, the cloud-side intelligent layout engine is used for intelligently arranging layout elements and processing basic services; when the cloud-side intelligent layout engine is used for intelligently arranging layout elements, the cloud-side intelligent layout engine comprises at least one of the following algorithms or rules: a color matching algorithm, a coloring algorithm, an intelligent design algorithm, a board arrangement algorithm, a quantitative evaluation algorithm, a rule template and a color matching rule; the basic services include policy updates and service authentication.

In one possible design, the layout intelligent arranging module is used for generating an arranged DS L, analyzing the DS L to obtain a DS L corresponding to a platform executing a layout result, and the service intelligent arranging module is used for serially arranging a service corresponding to an arranging request according to the DS L corresponding to the platform executing the layout result.

In one possible design, a multimodal adaptation module to: generating multi-mode data according to the serially arranged services; wherein the multimodal includes at least one of speech, environmental information, visual information, textual information, and device information.

In one possible design, the preset controls include at least one of a graphical user interface GUI, a voice interaction interface VUI, and a panel interface PUI.

Therefore, the arrangement strategy is flexibly selected according to the arrangement request, the DS L is directly generated according to the layout elements and the arrangement strategy, the fixed DS L is not generated by researching and developing the layout elements in advance, and the appropriate layout codes can be flexibly generated according to the layout elements and the arrangement strategy, so that intelligent arrangement is performed according to the generated layout codes, the style of the design platform is diversified, and the requirement of service diversity can be met.

Drawings

Fig. 1 is a schematic diagram of a network architecture according to an embodiment of the present application;

fig. 2 is a schematic architecture diagram of an end-side system and a cloud-side system provided in an embodiment of the present application;

fig. 3 is a schematic flowchart of an intelligent layout method according to an embodiment of the present application;

fig. 4 is a schematic flowchart of an intelligent layout method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a network device according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a network device according to an embodiment of the present application.

Detailed Description

For ease of understanding, some of the concepts related to the present application are illustratively presented for reference. As follows:

HAG (HUAWEI accessibility Gallery) card: the rapid service distribution platform is a Huacheng rapid service distribution platform, a terminal multimedia platform is aggregated, rapid services of a third party are accurately distributed in multiple scenes and multiple entrances, the popularization efficiency of developers is improved, and more convenient and more optimized experience is provided for terminal users. In the present application, the HAG card may generate the layout code according to the orchestration request of the third party facilitator.

Domain-specific languages (DS L) A computer programming language with limited expressiveness for a domain is to solve the difficulty of requirement collection caused by the inconsistency of language models between users and constructors at the initial stage of system construction (including hardware system and software system).

Natural language Processing (Natural L Natural language Processing, N L P), a sub-field of Artificial Intelligence (AI), which studies various theories and methods that enable efficient communication between a person and a computer using Natural language.

Text To Speech (Text To Speech, TTS): is part of a human-machine conversation, enabling the machine to speak. Under the support of a built-in chip, characters are intelligently converted into natural voice streams through the design of a neural network.

Panel User Interface (Panel User Interface, PUI): an interface plug-in developed by terrestrial that allows users to use pictures on the interface.

Graphical User Interface (GUI): the computer operation user interface is a human-computer communication interface display format, and allows a user to use an input device such as a mouse to manipulate icons or menu options on a screen to select commands, call files, start programs or perform other daily tasks.

Voice-user interface (VUI): interface to any voice application/device.

The method and the device for intelligently arranging the design draft characteristic values are used for intelligently arranging the design draft characteristic values, can directly generate the layout codes for the interface elements of the design draft, and further intelligently typesetting the design draft through the layout codes.

As shown in fig. 1, the network architecture according to the embodiment of the present Application may include an end-side System and a cloud-side System, where the end-side System may include a mobile terminal, such as a mobile phone, a voice assistant, and a smart band, and the capability of the end-side System may be specifically solidified in an Application program (APP) in the mobile terminal, or a System on chip (SoC) in the mobile terminal.

Fig. 2 is a schematic diagram of an architecture of the end-side system and the cloud-side system. The end-side system can be divided into a business layer, a service layer and a platform layer, and the cloud-side system divides modules according to the capacity of the cloud-side system. The capabilities of the layers are described below.

A. The business layer comprises a Huawei service card and a three-party service card. The service card, i.e. the scenario smart card of the mobile terminal, can provide all functional algorithms and calculation processes required by the end-side system, and interact with the service layer and the platform layer, that is, process the parts related to the service, and generally, the service layer includes a series of operations performed and performed on data, for example, an Application Program Interface (API) can be called to perform parameter setting and provide the capability of element composition. The service card is Hua as HAG card, and the intelligent layout template for the third-party service access can generate a layout code; the three-party service card is a template opened to the third-party service, and can receive layout elements and the like provided by the third-party service.

B. The service layer is a collection of a series of services, and is a layer between two layers which are communicated with each other for reasonably arranging business objects, business components and other components of application, workflow and business logic under the condition of clear business logic layer and domain model. In the embodiment of the application, the service layer comprises modules such as an arrangement logic module, a layout intelligent arrangement module, a service intelligent arrangement module, a multi-mode adaptation module, an intelligent engine, an hbs (handles) engine, a multi-mode interaction control and an action library.

The arrangement logic module is used for being responsible for data processing, user intention identification, display distribution, strategy selection and the like. The data processing can be, for example, operations of cutting, adjusting, extracting and the like on layout elements provided by a third party; the user intent identification may be to identify a user's intent, such as a user's intent to take a car to a destination, or to order a meal at a take-away platform or to order a hotel, etc.; displaying and distributing the information to a terminal side system or a cloud side system to call other equipment, and distributing the intelligently arranged result to other equipment; and selecting a strategy, namely selecting an intelligent arranging strategy corresponding to the intention by the end-side system according to the intention of the user.

The intelligent layout module is divided into an end side layout module and a cloud side layout module. The end side arrangement module and the cloud end arrangement module are both used for processing the arrangement request of a third party, the end side system to which the end side arrangement module belongs, and the cloud side system to which the cloud end arrangement module belongs. When the computing power of the end-side system is insufficient, the end-side system can request the cloud deployment module to perform computing processing. Generally, the cloud orchestration module is responsible for policy updating and handling orchestration requests. The cloud arrangement module comprises an element intelligent arrangement module and a basic service module. The element intelligent arrangement module mainly comprises a color matching algorithm, a coloring algorithm, an intelligent design algorithm, a plate arrangement algorithm, quantitative evaluation, a rule template, a color matching rule and the like, and the basic service is responsible for strategy updating, service authentication and the like.

The service intelligent arranging module is responsible for serially arranging a plurality of services requested by a third party.

The multi-mode adaptation module is responsible for multi-mode fusion processing and multi-mode interaction processing.

The intelligence engine is used for image recognition, N L P, and execution of Text To language (TTS), etc. TTS is used To intelligently convert Text into a natural Speech stream.

The HBS engine comprises a rendering engine, a system adaptation and an adaptive User Interface (UI), wherein the rendering engine is a typesetting engine and is responsible for obtaining contents of intelligent layout, such as HyperText Markup language (HyperText Markup L anguage, HTM L), EXtensible Markup language (EXtensible Markup L anguage, XM L), images and the like, finishing information (such as CSS addition and the like) and calculating a display mode of a webpage, the system adaptation is used for adjusting the layout contents to a state suitable for playing of a device, the adaptive UI is used for ensuring flexible grids of layout consistency, breakpoint details of how contents are redrawn on different screens and description of how an application is zoomed from a small screen to a super large screen.

The multi-modal interaction control comprises a PUI, a GUI, a VUI and the like.

The dynamic effect library comprises a universal dynamic effect library which comprises universal animation effects.

C. The platform layer is an operating system for finally playing the typesetting result of the intelligent layout. The operating system may be Android, Windows, WatchOS, or the like.

The cloud-side system further comprises an intelligent capability module, wherein the intelligent capability module comprises functions of portrait service, N L P processing, picture semantic processing and the like, the portrait service is used for analyzing behavior preferences of a user and recommending a proper interface arrangement scheme to the user according to the behavior preferences, the N L P processing is used for converting a computer language of an operating system of a platform layer into a natural language when the user speaks, and the picture semantic processing is used for automatically segmenting and identifying content in an image, such as a picture of a person riding a motorcycle, and the image after the machine judgment can be generated after the machine judgment.

The public cloud of the cloud-side system may include an I-layer, a P-layer, and the like. The I layer is an Infrastructure As A Service (IAAS) layer, and the P layer is a Platform As A Service (PAAS) layer.

The operating system of the end-side system can be EMUI9.X (emulation UI) or EMUI10.X, and EMUI is an emotional operating system developed based on Android.

By applying the end-side system and the cloud-side system, the model is generated by extracting the characteristic value of the design draft, and the appropriate layout code is directly generated aiming at the layout elements (pictures, characters and the like) by combining other layout influence factors such as an eye movement hotspot algorithm, a visual center algorithm and the like. Furthermore, a proper color matching scheme and a proper theme style are generated through a color matching algorithm according to the picture background, the color and the like in the layout elements, and the layout elements are properly typeset through an intelligent typesetting algorithm.

The examples of the present application are further illustrated below.

An embodiment of the present application provides an intelligent layout method, as shown in fig. 3, including:

301. the device identifies the user intention and selects an arrangement strategy according to the arrangement request, wherein the arrangement request comprises the user intention and the layout elements, and the arrangement strategy is used for arranging the layout elements.

The apparatus may be a device in the end-side system or a device in the cloud-side system, or the device in the end-side system may request the device in the cloud-side system to process when the capability is not supported. The device in the end-side system may be, for example, a mobile phone or a tablet computer, and the intelligent layout system described in the embodiment of the present application may be specifically deployed in an SoC chip in the mobile phone.

Taking the device as a mobile phone as an example, the user can operate on the mobile phone, so that the mobile phone generates a scheduling request. For example, the user operates to take a car in taxi taking software on the mobile phone, the scheduling request indicates that the mobile phone user wants to take a car to a destination, the user intention may be to take a car to a destination at XX point, for example, the layout elements include time, place, and user information, etc. One scheduling request can correspond to one service or a plurality of services, and the taxi taking operation is one service. The mobile phone identifies that the arrangement request can be realized through a three-party service card of the business layer, and the three-party service card can extract the user intention and the layout elements in the arrangement request.

302. The device trigger end-side intelligent arranging software development kit SDK carries out intelligent arranging according to the layout elements and the arranging strategy to generate an arranged DS L, and then carries out intelligent arranging of services according to the DS L.

After the arrangement strategy is selected, the device can start intelligent arrangement by utilizing the SDK in the Huawei service cards of the service layer according to the arrangement strategy. The intelligent arrangement process can be divided into two operations of end-side layout intelligent arrangement and multi-mode adaptation.

In the end-side layout intelligent arrangement, firstly, the user intention and the arrangement strategy in the three-party service card can be processed through the arrangement logic module, and then the service card of the mobile phone business layer selects the arrangement strategy corresponding to the user intention and the arrangement element according to the user intention and the arrangement element provided by the three-party service card. For example, the user intends to taxi to a destination, the scheduling policy may cause the cell phone screen to eventually display taxi information, such as license plate number, body color, arrival time, and the like. In addition, the arrangement logic module can perform data preprocessing on the layout elements after recognizing the user intention, for example, unpacking the data packets of the layout elements, and then extract the picture resources, the character resources and the like in the elements, so as to cut and adjust the pictures in the picture resources to obtain useful images in the pictures.

And then, the extracted picture resources, character resources and the like are intelligently arranged through an intelligent layout module. Due to the limited computing power of the end side, intelligent orchestration can be performed by the cooperation of the end side device and the cloud side device. The side arranging module in the intelligent layout arranging module can transmit the picture resources, the character resources and the like to the cloud arranging module of the cloud side equipment through the network. As shown in fig. 2, the cloud orchestration module includes two modules, an element intelligent orchestration module and a basic service module. The element intelligent arrangement module mainly comprises a color matching algorithm, a coloring algorithm, an intelligent design algorithm, a plate arrangement algorithm, quantitative evaluation, a rule template, a color matching rule and the like, and the basic service is responsible for strategy updating, service authentication and the like. The color matching algorithm can match the colors of the picture resources and the character resources; the coloring algorithm can color the matched colors; the intelligent design algorithm can be used for selecting a set of proper layout schemes for different interface elements; a layout algorithm may be used to place elements in a layout scheme; the quantitative evaluation can be used for evaluating the aesthetic scores of the interfaces after the layout so as to continuously optimize the intelligent design algorithm through the aesthetic scores; the rule template may be a layout scheme; the color matching rule may be to color the picture elements, and select the matching colors of the fonts, the backgrounds, and the like of the layout through the main and auxiliary color matching of the picture elements.

After layout elements are arranged by the intelligent layout module, DS L L generated according to the arranged layout result may be an intermediate code, and then DS L generated is parsed to parse DS L into languages that can be recognized by an operating system of a device platform layer, for example, when the operating system is Android, the parsed languages are Android languages.

Then, the service intelligent arranging module can serially arrange a plurality of services corresponding to the arranging request, for example, a user continuously requests a plurality of services including a taxi taking service, a meal ordering service, a hotel ordering service and the like from the device, so that the device can serially arrange languages after the plurality of services are correspondingly analyzed, for example, firstly arrange the taxi taking service, then arrange the meal ordering service and finally arrange the hotel ordering service.

303. The device generates multi-mode data according to the result of the intelligent arrangement of the service, and outputs a layout result according to the preset control and the multi-mode data.

The device may generate multimodal data from the serially orchestrated services. Wherein the multimodal includes at least one of speech, environmental information, visual information, textual information, and device information.

Specifically, the device may perform data multimodal fusion processing on the language corresponding to the serially arranged service, for example, generate multimodal data from voice, environmental perception, and device information, or generate multimodal data from voice, vision, text, environmental perception, and device information. That is, a user interface or the like that a user can listen to or view is generated from the serially arranged languages. For example, if the orchestration request is triggered by speech, the generated multimodal data may be speech data, or if the orchestration request is triggered by manual input from a user at a user interface, the generated multimodal data may be text, or text and picture data. The conversion from the serially arranged language to voice data can be achieved by a smart engine, and the conversion from the serially arranged language to a user interface can be achieved by an HBS engine. If the output picture needs to drive the picture effect, the generated picture data needs to be processed through a dynamic effect library. The environment perception may be factors such as a home environment or a working environment where the user is located, for example, whether a person is at rest in the home environment or whether a person is at work in the working environment is known, and the like, that is, the environment perception affects interface generation and multimodal data conversion.

And then, processing the multi-modal data through a preset multi-modal interaction control. The preset multi-modal interaction control comprises at least one of a GUI, a VUI and a PUI. For example, the multimodal data includes voice data, and the voice data can be output after being processed by the VUI control. If the multi-modal data comprises picture data, the picture data can be output after being processed by the GUI control and/or the PUI control.

The following describes an intelligent arrangement method of the aforementioned steps 301-303 by taking an application scenario of a possible intelligent interactive system as an example.

An application scenario is for example that the user gets a car at home in the morning with a voice assistant.

A place: the family time is as follows: morning 7:50 user: chris voice assistant: small E

The voice interaction process of the user Chris and the small E can be as follows:

chris: hello, little E, help me to taxi to the company.

Small E: preferably, the XX taxi is used for calling a car, and after success, the vehicle information is sent to a mobile phone.

And small E, vehicle information, white BMW 320L i, license plate Su X, customer score 4.9 points, and vehicle 5 minutes later arriving at the cell north gate.

The Chris voice data is recognized by the small E, the voice data is the arrangement request in step 301, and is used for intending to take a taxi, and the layout elements may include a place of a home where Chris is located, a time when the voice data is recognized, a name of a user who utters voice, a taxi taking destination, and the like. The selected arranging strategy is the strategy for obtaining the taxi taking information.

Considering that the computing capacity of the small E is limited, the small E can send the arranging request and the arranging strategy to the process of triggering the intelligent arranging software development kit SDK to perform intelligent arranging according to the layout elements and the arranging strategy in the cloud device executing step 302, the intelligent arranged result obtained by the cloud device is the vehicle information, the intelligent arranged result is sent to the small E executing step 302 to generate the arranged DS L and analyze the DS L to obtain an analysis result, and then the small E performs intelligent service arranging according to the analysis result, namely, the vehicle information sent by the cloud device is generated into the arranged DS L and analyzes the DS L to obtain the language of the operating system of the small E device.

Then, the small E executes step 303, and generates multi-modal data according to the analyzed result, for example, the small E finally needs to play the vehicle information in a voice mode, and then the multi-modal data includes voice data corresponding to the vehicle information, and then invokes the VUI control to play the voice data, and the vehicle information is simultaneously sent to the cell phone of Chris, and then the small E invokes the PUI control and the GUI control through the display distribution function in the editing and logic module to send the vehicle information to the cell phone of Chris for display.

For the process of the above application scenario, as shown in fig. 4, if the small E is used as a voice instruction receiving device and the cloud device is a server, the process may be:

401. the voice instruction receiving equipment receives a voice instruction of a user and sends the voice instruction to the server.

The voice command can be understood as the arrangement request in the above description, and the above scenario is applied to correspond to the voice data of "hello, little E, help me to get a car to a company".

402. The server carries out intelligent arrangement according to the voice command and issues the service data of the intelligent arrangement to the intelligent arrangement system.

The server can trigger the SDK in the server to carry out intelligent arrangement according to the arrangement request and the arrangement strategy according to the voice instruction, and intelligent arranged service data is obtained. By applying the above scenario, the service data is the vehicle information. The intelligent orchestration system includes, for example, a cell phone, a voice assistant gadget E, and a smart band illustrated in fig. 4. The specific implementation of step 402 may be similar to the "device triggered end-side intelligent orchestration software development kit SDK performing intelligent orchestration according to layout elements and orchestration policies" in steps 301 and 302.

403. And the intelligent arrangement system performs adaptation and typesetting according to the service data.

The implementation of step 403 may be similar to the implementation of "generating a compiled DS L and parsing a DS L to obtain a parsing result, and then performing intelligent service compilation according to the parsing result" in step 302 and the implementation of "the device generates multi-modal data according to the result of intelligent service compilation, and outputs a layout result according to a preset control and the multi-modal data" in step 303.

For example, when the intelligent arranging system is a mobile phone, a voice assistant or an intelligent bracelet, the mobile phone can display the vehicle information in a text form in a display screen of the mobile phone according to the service data, the voice assistant small E can play the vehicle information in a voice form, and the intelligent bracelet can also display the vehicle information in a text form according to the size of the screen.

Through the description of the embodiment, for the user, the network architecture of the application can enable the same service to display content with value and aesthetic feeling on different devices, and user experience is improved. For developers and designers, the workload of the developers and designers can be reduced.

In case of an integrated unit, fig. 5 shows a schematic structural diagram of a network device, which may include the apparatuses in the above embodiments. The network device 50 includes: a processing module 502 and a communication module 503. Processing module 502 is used to control and manage the actions of the network device, e.g., processing module 502 is used to support the network device in performing processes 301, 302, and 303 in fig. 3, and/or other processes for the techniques described herein. The communication module 503 is used to support communication between the network device and other network entities, for example, communication between the functional module or the network entity (cloud-side system) shown in fig. 1. The network device may also include a storage module 501 for storing program codes and data for the network device.

The processing module 502 may be a Processor or a controller, such as a Central Processing Unit (CPU), a general-purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. A processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, a DSP and a microprocessor, or the like. The communication module 503 may be a transceiver, a transceiving circuit or a communication interface, etc. The storage module 501 may be a memory.

When the processing module 502 is a processor, the communication module 503 is a transceiver, and the storage module 501 is a memory, the network device according to the embodiment of the present application may be the network device shown in fig. 6.

Referring to fig. 6, the network device 60 includes: processor 601, transceiver 602, memory 603, and bus 604, may also include display 605. The transceiver 602, the processor 601 and the memory 603 are connected to each other through a bus 604; the bus 604 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 6, but this is not intended to represent only one bus or type of bus.

Those skilled in the art will recognize that in one or more of the examples described above, the functions described herein may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (12)

1. An intelligent layout method, comprising:

the device identifies a user intention and selects an arranging strategy according to an arranging request, wherein the arranging request comprises the user intention and layout elements, and the arranging strategy is used for arranging the layout elements;

the device triggers the end-side intelligent layout software development kit SDK to carry out intelligent layout according to the layout elements and the layout strategy, generates a layout description language DS L after layout, and carries out intelligent service layout according to the DS L;

the device generates multi-mode data according to the result of the intelligent arrangement of the service, and outputs the layout result according to a preset control and the multi-mode data.

2. The method of claim 1, wherein the device triggering intelligent orchestration of an intelligent orchestration Software Development Kit (SDK) according to the layout elements and the orchestration policy comprises:

the device triggers the SDK to call an intelligent arranging engine at the end side and an intelligent arranging engine at the cloud side to carry out intelligent arranging according to the layout elements and the arranging strategy;

wherein the end-side intelligent orchestration engine is to orchestrate the layout elements; the cloud-side intelligent orchestration engine is used for executing policy updates and processing the layout elements.

3. The method of claim 2, wherein the cloud-side intelligent orchestration engine is configured to intelligently orchestrate the layout elements and process infrastructure services;

the cloud-side intelligent layout engine is used for intelligently arranging the layout elements and comprises at least one of the following algorithms or rules: a color matching algorithm, a coloring algorithm, an intelligent design algorithm, a board arrangement algorithm, a quantitative evaluation algorithm, a rule template and a color matching rule;

the basic service includes policy update and service authentication.

4. The method according to any one of claims 1-3, wherein the generating of the choreographed layout description language, DS L, and the intelligent choreography of services according to the DS L comprises:

generating the DS L after arrangement;

analyzing the DS L to obtain a DS L corresponding to a platform executing the layout result;

and performing serial arrangement on the service corresponding to the arrangement request according to the DS L corresponding to the platform of the layout result.

5. The method of claim 4, wherein generating multi-modal data based on the results of the intelligent orchestration of services comprises:

generating multi-mode data according to the serially arranged services;

wherein the multimodal includes at least one of speech, environmental information, visual information, textual information, and device information.

6. The method according to any of claims 1-5, wherein the preset controls comprise at least one of a graphical user interface, GUI, a voice interaction interface, VUI, and a panel interface, PUI.

7. An apparatus, comprising:

the layout element management system comprises a layout logic module, a layout element management module and a layout element management module, wherein the layout logic module is used for identifying a user intention and selecting a layout strategy according to a layout request, the layout request comprises the user intention and a layout element, and the layout strategy is used for arranging the layout element;

the layout intelligent layout module is used for triggering the end-side intelligent layout software development kit SDK to carry out intelligent layout according to the layout elements and the layout strategy to generate a layout description language DS L after layout;

the service intelligent arranging module is used for carrying out intelligent arranging of services according to the DS L;

and the multi-mode adaptation module is used for generating multi-mode data according to the result of the intelligent service arrangement and outputting the layout result according to a preset control and the multi-mode data.

8. The apparatus of claim 7, wherein the layout intelligence orchestration module is configured to:

triggering the SDK to call the intelligent arranging engine at the end side and the intelligent arranging engine at the cloud side to carry out intelligent arranging according to the layout elements and the arranging strategy;

wherein the end-side intelligent orchestration engine is to orchestrate the layout elements; the cloud-side intelligent orchestration engine is used for executing policy updates and processing the layout elements.

9. The apparatus of claim 8, wherein the cloud-side intelligent orchestration engine is configured to intelligently orchestrate the layout elements and process infrastructure services;

the cloud-side intelligent layout engine is used for intelligently arranging the layout elements and comprises at least one of the following algorithms or rules: a color matching algorithm, a coloring algorithm, an intelligent design algorithm, a board arrangement algorithm, a quantitative evaluation algorithm, a rule template and a color matching rule;

the basic service includes policy update and service authentication.

10. The apparatus of any of claims 7-9, wherein the layout intelligence orchestration module is to:

generating the DS L after arrangement;

analyzing the DS L to obtain a DS L corresponding to a platform executing the layout result;

the service intelligent arrangement module is used for:

and performing serial arrangement on the service corresponding to the arrangement request according to the DS L corresponding to the platform of the layout result.

11. The apparatus of claim 10, wherein the multi-modal adaptation module is configured to:

generating multi-mode data according to the serially arranged services;

wherein the multimodal includes at least one of speech, environmental information, visual information, textual information, and device information.

12. The apparatus according to any of the claims 7-11, wherein the preset controls comprise at least one of a graphical user interface GUI, a voice interaction interface VUI and a panel interface PUI.

Images