WO2019105093A1 - Procédé et appareil d'encapsulation de données, dispositif et appareil de traitement de données, et dispositif électronique - Google Patents

Procédé et appareil d'encapsulation de données, dispositif et appareil de traitement de données, et dispositif électronique Download PDF

Info

Publication number
WO2019105093A1
WO2019105093A1 PCT/CN2018/104184 CN2018104184W WO2019105093A1 WO 2019105093 A1 WO2019105093 A1 WO 2019105093A1 CN 2018104184 W CN2018104184 W CN 2018104184W WO 2019105093 A1 WO2019105093 A1 WO 2019105093A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
service
algorithm
image
view component
Prior art date
Application number
PCT/CN2018/104184
Other languages
English (en)
Chinese (zh)
Inventor
汤锦鹏
陈晓升
Original Assignee
广州市动景计算机科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州市动景计算机科技有限公司 filed Critical 广州市动景计算机科技有限公司
Publication of WO2019105093A1 publication Critical patent/WO2019105093A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/73—Program documentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/65—Updates

Definitions

  • the embodiments of the present invention relate to the field of computer technologies, and in particular, to a data encapsulation and processing method, apparatus, and electronic device.
  • AR Augmented Reality
  • AR is a new technology that integrates real world information and virtual world information "seamlessly". It uses information that is difficult to experience in a certain time and space of the real world (eg, Visual information, sound information, etc.), superimposed on the real information after the simulation, the real environment and the virtual object are superimposed in the same picture or space at the same time.
  • augmented reality technology applied to smart terminals has begun to receive attention.
  • an augmented reality technology is implemented by means of an application (application) in which an embedded AR algorithm is installed.
  • an application application
  • App version upgrades are also required, and even the same AR service cannot be run simultaneously on different apps. It can be seen that this method makes the distribution and deployment cost of the AR high, which is not conducive to the popularization and development of the AR.
  • the embodiments of the present invention provide a data encapsulation and processing method, apparatus, and electronic device to solve the problem of high cost of existing AR distribution and deployment.
  • a data encapsulation method comprising: setting, according to a web page view component, an algorithm registration interface for registering an AR algorithm and an AR service interface for performing AR interaction with a webpage; a channel for communicating between the algorithm interface of the AR algorithm and the AR service interface of the web page view component; and the AR service may be encapsulated according to the web page view component, the algorithm registration interface, the AR service interface, and the channel. Call the file.
  • a data processing method including: receiving an AR service request, where an AR service request carries an AR service parameter; and an AR service parameter in an AR service request is sent to an AR service.
  • the callable file wherein the AR service callable file is generated according to the algorithm registration interface of the AR algorithm, the webpage view component, the AR service interface, and the communication channel between the AR algorithm interface and the AR service interface;
  • the AR service parameters are processed, and the processing result is returned; and the AR service is displayed according to the processing result.
  • a data encapsulating apparatus including: a first setting module, configured to set an algorithm registration interface for registering an AR algorithm and perform AR interaction with a webpage based on a webpage view component;
  • the encapsulation module is configured according to the webpage view component,
  • the algorithm registers an interface, an AR service interface, and the channel, and encapsulates an AR service callable file.
  • a data processing apparatus including: a receiving module, configured to receive an AR service request, where an AR service request carries an AR service parameter, and a sending module is configured to use the AR service
  • the AR service parameter in the request is sent to the AR service callable file, wherein the AR service callable file is encapsulated according to the algorithm registration interface of the AR algorithm, the web view component, the AR service interface, and the communication channel encapsulation between the AR algorithm interface and the AR service interface.
  • a processing module configured to process the AR service parameter by using an AR service callable file, and return a processing result
  • a display module configured to perform AR service display according to the processing result.
  • an electronic device comprising: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface complete each other through the communication bus
  • the memory is for storing at least one executable instruction that causes the processor to perform operations corresponding to the data encapsulation method of the first aspect.
  • an electronic device comprising: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface complete each other through the communication bus
  • the memory is for storing at least one executable instruction that causes the processor to perform an operation corresponding to the data processing method of the second aspect.
  • a non-transitory machine readable storage medium having stored thereon executable code for causing the executable code to be executed by a processor of an electronic device The method performs the method as described above.
  • an algorithm registration interface of an AR algorithm a webpage view component for implementing a webpage function, an AR service interface for implementing an AR service, and a communication channel between an AR algorithm interface and an AR service interface are encapsulated and generated into an AR.
  • Business callable files The AR algorithm itself is independent of the AR service callable file, and only needs to register with the AR service callable file, and informs the AR service that the corresponding algorithm information of the file can be called, that is, the AR service callable file can be called.
  • the AR service callable file does not need to understand the modification of the AR algorithm, or the specific implementation of adding or deleting, and only needs to obtain the corresponding algorithm information through the registration operation.
  • the AR service end only needs to interact with the AR service callable file to implement the corresponding AR function.
  • the AR service end does not need to embed the AR algorithm, and does not need to understand the specific implementation details of the AR algorithm. Therefore, when the new AR service is launched, the new AR service can be used only by making small changes to the front end such as the HTML page; the host application itself where the AR service can call the file itself may not have the AR algorithm, and
  • the registered AR algorithm can implement the AR service of the host App itself; when replacing or adding the AR algorithm that does not belong to the host App itself, there is no need to change the host App itself; and, the same AR service can be easily implemented on different apps. Run at the same time. It can be seen that the distribution and deployment cost of the AR is greatly reduced by the solution of the embodiment of the present invention.
  • FIG. 1 is a flow chart showing the steps of a data encapsulation method according to Embodiment 1 of the present invention
  • FIG. 2 is a flow chart showing the steps of a data encapsulation method according to Embodiment 2 of the present invention.
  • FIG. 3 is a schematic structural diagram of an AR service callable file according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of an AR data interaction according to an embodiment of the present invention.
  • FIG. 5 is a flow chart showing the steps of a data processing method according to Embodiment 3 of the present invention.
  • FIG. 6 is a flow chart showing the steps of a data processing method according to Embodiment 4 of the present invention.
  • FIG. 7 is a structural block diagram of a data encapsulating apparatus according to Embodiment 5 of the present invention.
  • FIG. 8 is a structural block diagram of a data processing apparatus according to Embodiment 6 of the present invention.
  • FIG. 9 is a schematic structural diagram of an electronic device according to Embodiment 7 of the present invention.
  • FIG. 10 is a schematic structural diagram of an electronic device according to Embodiment 8 of the present invention.
  • FIG. 1 a flow chart of steps of a data encapsulation method according to a first embodiment of the present invention is shown.
  • Step S102 Based on the webpage view component, set an algorithm registration interface for registering the AR algorithm and an AR service interface for performing AR interaction with the webpage.
  • the AR algorithm is an underlying algorithm for implementing AR functions, such as detecting a face in an image and returning information of a face key point, detecting a target object set in the image and returning the position information of the target object, and detecting the target in the image. Whether the object has a certain attribute, and so on.
  • the AR algorithm may be implemented in an appropriate language, optionally in an interpreted language such as the Java language or the C# language, or in a compiled language such as C or C++.
  • JS language Compared with scripting languages such as JS language to implement AR algorithm, compiling language or interpreted language is more efficient and faster, which can effectively meet the needs of AR business for timeliness.
  • the scripting language is also applicable to the AR algorithm of the embodiment of the present invention.
  • Algorithm registration is a way to inform the algorithm caller of relevant information of the algorithm (such as algorithm identification (name or ID, etc.), class name, etc.). Algorithm registration can be implemented by function registration or function declaration.
  • the AR algorithm can implement flexible modification within the algorithm without the caller knowing the specific details of the modification; when a new AR algorithm occurs, the new AR algorithm can be realized by informing the algorithm caller related algorithm information through registration. Call; when you need to delete the registered AR algorithm, you can no longer register or call.
  • the AR algorithm can return corresponding information through the AR algorithm interface, for example, returning corresponding information to the HTML5 page through the AR service interface, so that the HTML5 page performs further AR processing based on the information.
  • the algorithm registration interface is configured to receive the registration of the AR algorithm, and the AR algorithm notifies the algorithm caller of the algorithm information through the algorithm registration interface.
  • the specific implementation manner of the algorithm registration interface may be appropriately set by a person skilled in the art according to actual requirements, which is not limited by the embodiment of the present invention.
  • the AR service is set at the front end (as implemented by JavaScript (JS) code in the front-end HTML5 page), and functions implemented include, but are not limited to, camera data rendering or other image data rendering, AR special effects rendering, and the like.
  • the AR service does not have the AR algorithm capability.
  • the AR service interface needs to obtain the result returned by the AR algorithm. Based on the result, the AR service is finally implemented.
  • the AR service interface is an interface for performing AR interaction with a webpage, and can be implemented by a scripting language. Alternatively, the AR service interface can be implemented in the form of a JS API.
  • the AR service interface interacts with the AR algorithm interface through the webpage view component to deliver AR service parameters.
  • the web view component is a component that implements browser functions, such as WEBVIEW, which can be implemented as a web-based rendering engine based on the browser kernel, which can display the corresponding interface and webpage by loading HTML data.
  • browser functions such as WEBVIEW
  • the algorithm registration interface and the AR service interface are set based on the webpage view component, that is, the backend AR algorithm and the front end, such as the HTML5 webpage, can implement algorithm registration and front-end AR through the corresponding interface set in the webpage view component. Data interaction.
  • Step S104 Set a channel for communicating between the algorithm interface of the AR algorithm based on the web page view component and the AR service interface.
  • the front-end webpage transfers the service parameters of the AR service request to the webpage view component through the AR service interface, and the webpage view component not only performs the corresponding function according to the corresponding function module of the internal service parameter, but also is the AR.
  • the service interface and the AR algorithm interface establish a communication channel for performing transmission, interaction, processing, and the like of the AR data and the web page data.
  • the communication channel between the AR service interface and the AR algorithm interface may be represented by parameter transfer and/or interface call between each other.
  • Step S106 Encapsulate and generate an AR service callable file according to the webpage view component, the algorithm registration interface of the AR algorithm, the AR service interface, and the established channel.
  • the AR service callable file may take any suitable file format, including but not limited to a component form, such as an AAR component or a COM component.
  • a component form such as an AAR component or a COM component.
  • the related App or browser can directly call the AR algorithm for AR service processing, without implementing the AR algorithm itself, without knowing the implementation details of the AR algorithm, thereby making the AR function more flexible and compatible, and easier. Distribution and deployment.
  • the algorithm is not limited to the algorithm registration interface of the AR algorithm, the web page view component, the AR service interface, and the established channel. Those skilled in the art may also use other suitable interfaces or functional components according to actual needs. Or the function module is encapsulated into an AR service callable file.
  • the algorithm registration interface of the AR algorithm, the webpage view component that implements the webpage function, the AR service interface that implements the AR service, and the communication channel between the AR algorithm interface and the AR service interface are encapsulated and generated by the AR service. file.
  • the AR algorithm itself is independent of the AR service callable file, and only needs to register with the AR service callable file, and informs the AR service that the corresponding algorithm information of the file can be called, that is, the AR service callable file can be called.
  • the AR service callable file does not need to understand the modification of the AR algorithm, or the specific implementation of adding or deleting, and only needs to obtain the corresponding algorithm information through the registration operation.
  • the AR service end only needs to interact with the AR service callable file to implement the corresponding AR function.
  • the AR service end does not need to embed the AR algorithm, and does not need to understand the specific implementation details of the AR algorithm. Therefore, when the new AR service is launched, the new AR service can be used only by making small changes to the front end such as the HTML page; the host application itself where the AR service can call the file itself may not have the AR algorithm, and The registered AR algorithm can implement the AR service of the host App itself; when replacing or adding the AR algorithm that does not belong to the host App itself, there is no need to change the host App itself; and, the same AR service can be easily implemented on different apps. Run at the same time. It can be seen that the distribution and deployment cost of the AR is greatly reduced by the solution of the embodiment of the present invention.
  • the data encapsulation method of this embodiment may be implemented by any suitable device or device having data processing functions, including but not limited to various terminals and servers.
  • FIG. 2 a flow chart of steps of a data encapsulation method according to a second embodiment of the present invention is shown.
  • Step S202 Set an AR service interface for performing AR interaction with the webpage based on the webpage view component.
  • the web view component is a component that implements a browser function, and can be implemented as a webpage rendering engine based on a browser kernel, and the corresponding interface and webpage can be displayed by loading HTML data.
  • a browser function can be implemented as a webpage rendering engine based on a browser kernel, and the corresponding interface and webpage can be displayed by loading HTML data.
  • those skilled in the art can adopt any suitable web page view component according to actual conditions.
  • the WEBVIEW web page view component is taken as an example.
  • WEBVIEW is a control based on WEBKIT engine that displays WEB pages. In addition to the general VIEW properties and settings, WEBVIEW can also handle URL requests, page loads, renderings, and page interactions. WEBVIEW allows you to display and render web pages, use HTML files (on the web or in local assets) for layout, interact with JavaScript, and more.
  • the browser app can implement the browser function through WEBVIEW, while the non-browser app can embed the browser function into its own application through WEBVIEW.
  • WEBVIEW also provides methods to extend its own functionality.
  • the addJavascriptInterface() method provided by WEBVIEW is used to set the extended JS (JavaScript) interface to WEBVIEW, and forward the calling methods of these extended JS interfaces to the interface registration.
  • Native function the embodiment of the present invention sets an AR service interface for performing AR interaction with a webpage, so as to implement various AR functions required for the front-end webpage.
  • the AR service interface can receive the AR service parameters sent by the front end HTML5 page.
  • the AR service parameters are forwarded to the algorithm interface of the matched AR algorithm through WEBVIEW; on the other hand, the WEBVIEW invokes the corresponding according to the service parameters.
  • An image device interface or an image acquisition interface to obtain an image.
  • the AR algorithm returns the processing result to the AR service interface, and the AR service interface hands it to the HTML5 page for processing.
  • the AR service interface can be implemented in the JavaScript language.
  • a query interface for acquiring algorithm information of the AR algorithm may be set, and the query interface also interacts with the front-end webpage, and the front-end webpage can learn the registered various AR algorithms through the query interface.
  • the algorithm information is used to provide a reference for determining the AR algorithm corresponding to the AR service for subsequent selection.
  • Step S204 Set an algorithm registration interface for registering the AR algorithm based on the web page view component.
  • the algorithm registration interface of the AR algorithm is used to implement the registration of the AR algorithm, and the algorithm information of the AR algorithm caller AR algorithm is notified by registration for subsequent calls.
  • the AR algorithm may be an algorithm set in the App, or may be an independently existing algorithm such as an AR algorithm that is included in the operating system.
  • the AR algorithm can also be embedded in the AR service callable file, that is, directly encapsulated into the AR service callable file. In one possible approach, the AR algorithm can be implemented as an underlying algorithm component.
  • the AR algorithm may include one or more (two or more).
  • the AR algorithm may be configured to use a unified interface externally, and multiple AR algorithms are registered through the same interface class to simplify the interface. Settings to improve algorithm compatibility.
  • Step S206 Set an image device interface for controlling the image capturing device based on the web page view component, and/or set an image obtaining interface for acquiring image data.
  • the image device interface is used to control the image capture device, such as controlling camera opening, shooting, closing, data transfer, and the like.
  • the image device interface can also be set based on the extended function of WEBVIEW.
  • the present invention is not limited thereto.
  • those skilled in the art may also package the image collection and processing into independent functional modules according to actual needs, and provide corresponding interfaces for calling.
  • images can be acquired in real time to realize AR processing of real-time images.
  • the image device interface may control the image collection device by using an image device control algorithm, where the image device control algorithm may be an algorithm encapsulated in an AR service callable file, or may be an AR service callable file but may be called. Algorithm.
  • the image acquisition interface is used to acquire image data, such as a still image (such as a locally stored or network downloaded image), or a video frame image in a recorded video.
  • image acquisition interface can also be based on the extended function settings of WEBVIEW.
  • the present invention is not limited thereto. In practical applications, those skilled in the art may also package them into independent functional modules according to actual needs, and provide corresponding interfaces for calling.
  • the image acquisition interface may acquire image data by using an image acquisition algorithm.
  • the image acquisition algorithm may be an algorithm encapsulated in an AR service callable file, or may be an algorithm that can be called outside the AR service callable file.
  • Both the image device interface and the image acquisition interface accept the call of WEBVIEW, and according to the call, the image is acquired or the image is acquired.
  • the collected or acquired image is sent to the AR algorithm interface for processing, and on the other hand, it is returned to the AR service.
  • Interface for the AR business interface to be rendered by the front-end HTML5 page.
  • Step S208 Set a channel for communicating between the algorithm interface of the AR algorithm based on the web page view component and the AR service interface.
  • Data transmission and information exchange are implemented between the AR algorithm interface and the AR service interface through a communication channel.
  • the AR service parameter received by the webpage view component through the AR service interface may be set to be transmitted to the communication channel of the successfully registered AR algorithm interface.
  • the AR service parameters include, but are not limited to, the service type of the AR service, the operation parameters of the AR service, and the like.
  • the image device interface and the image acquisition interface it is also necessary to establish a communication channel between the image device interface and/or the image acquisition interface and the AR service interface, and the image device interface and/or image acquisition.
  • the communication channel between the interface and the AR algorithm interface That is, setting a communication channel between the image device interface and the AR service interface and the algorithm interface of the AR algorithm via the web page view component; and/or setting the image acquisition interface via the web page view component and the AR service interface respectively
  • the communication channel between the algorithm interfaces of the AR algorithm is configured to send the image data to be processed to the AR algorithm interface for processing by the AR algorithm, and return the image data to be processed to the AR service interface for the AR service interface to be handed over to the front page. Render rendering.
  • Step S210 According to at least one interface of the image device interface and the image acquisition interface, and a webpage view component, an algorithm registration interface of the AR algorithm, an AR service interface, a communication channel between the AR algorithm interface and the AR service interface, and a query interface Encapsulation generates AR business components.
  • the AR service callable file is implemented as an AR service callable component, such as a aar component.
  • AR service callable component such as a aar component
  • At least one of the image device interface and the image acquisition interface, and the algorithm registration interface, the web view component, the AR service interface, the AR algorithm interface, and the AR service interface of the AR algorithm may be communicated.
  • the channel and the query interface are encapsulated to generate an AR service component.
  • the webpage view component may not be encapsulated into the AR service component.
  • a call interface for calling the webpage view component may be set, and at least one interface of the image device interface and the image acquisition interface may be set.
  • the algorithm registration interface of the AR algorithm, the calling interface of the webpage view component, the AR service interface, the communication channel between the AR algorithm interface and the AR service interface, and the query interface are encapsulated to generate an AR service component.
  • FIG. 3 An example of an AR service callable file implemented based on the above process is shown in FIG. 3.
  • the AR service callable file is implemented as a component in the form of a WebAR framework, that is, the WebAR framework is integrally packaged into components.
  • the WebAR component referred to as the WebAR component
  • the host App such as the UC browser application, Taobao application, Alipay application in Figure 3
  • Android system packaged into aar
  • iOS system packaged into Framework.
  • the host App uses the corresponding AR algorithm registration interface in the WebAR component (such as the Android Java interface and the iOS OC interface in FIG. 3) and the corresponding algorithm class in the AR algorithm component, and the AR algorithm (such as the A algorithm in FIG. 3) A algorithm 2, B algorithm) is registered in the WebAR component.
  • the AR algorithm includes an AR algorithm that the host App itself has and/or an AR algorithm that is independent of the host App.
  • the front end is provided with an AR service 1, an AR service 2, and an AR service 3 through an HTML5 page, and the AR service implements interaction with the WebAR component through a JS interface (AR service interface).
  • the JS interface (AR service interface) is implemented by the AR environment management class ARSession.
  • ARSession is a shared object that provides AR functions by managing device cameras and motion processing. It coordinates AR's numerous processes, including data acquisition from device motion sensors, control of built-in cameras, and camera image processing. ARSession achieves AR effects by combining all the results to establish a connection between the real space and the virtual coordinate system space.
  • the front-end HTML5 page initializes the AR environment through the JS interface (AR service interface) implemented via ARSession, opens the camera and selects the Detector interface required for the AR service.
  • the HTML5 page converts the original format of the image data into a format suitable for drawing, and renders through WebGL.
  • the Detector interface can call the corresponding capability of the AR algorithm.
  • the WebAR component is responsible for transmitting the call message received through the JS interface and the image data captured by the camera to the AR algorithm, and then returning the processing result of the AR algorithm to the HTML5 page.
  • each AR algorithm adopts a separate component form, and all AR algorithms implement a unified interface type IDetector interface.
  • the IDetector interface includes a unified process interface, a detection interface, and a callback interface, such as a start() interface and a pause( ) interface, stop() interface, resume() interface, init() interface, track() interface, onResult() interface, etc.
  • These interfaces have corresponding JS (JavaScript) mapping interfaces, ie Detector interfaces, on the front end, so the front end
  • JS JavaScript
  • the host App needs to register the required AR algorithm with the WebAR component during initialization.
  • the front-end HTML5 page can query the currently available AR algorithm through the JS interface (query interface) and select the AR algorithm required for activation.
  • the WebAR component creates an AR algorithm instance through the selection of the JS interface (AR service interface), but the interaction process is completed by the IDetector. Therefore, whether the specific AR algorithm is implemented by the A algorithm 1 or the B algorithm, or even the function of the A algorithm 1 is different, but the implementation details are different.
  • the A algorithm 2 is the same for the WebAR component, so the random replacement of the AR algorithm can be implemented.
  • the WebAR component delivers camera data to the currently activated AR algorithm instance, waits for the AR algorithm to complete the detection and returns the returned result to the JS interface (AR service interface), and then the JS interface (AR service interface) is processed by the HTML5 page. .
  • the control and management of the image acquisition device is implemented by the camera management component shown in FIG. 3, which acquires and transmits the camera data through the corresponding interface.
  • the camera data can be obtained through the system interface android.hardware.Camera() or android.hardware.Camera2(); for the iOS system, the camera data can be obtained through the system interface UIImagePickerController().
  • the acquired camera data is passed to the front-end HTML5 page through the JS interface (AR service interface).
  • the HTML5 page acquires the image data currently captured by the camera in real time by calling the JS interface (AR service interface) of the WebAR component.
  • the WebGL technology is used to convert the input YUV color-encoded streaming media data into RGB format and draw it onto the Canvas canvas to realize the rendering of the camera image.
  • the WebAR component extends the JS interface for the AR service through the extension function of WebView, thereby implementing the AR extension interface of the WebAR component to the front end HTML5 page.
  • the WebAR component establishes a communication channel for the JS interface and the AR algorithm interface, so that the call message received through the JS interface can reach the AR algorithm component, and the algorithm interface of the AR algorithm component can notify the HTML5 page of the processing result through the JS interface.
  • WebView can be embedded as a component in the WebAR framework; for the iOS system, the WebView needs to be referenced by the host App. For example, the host App registers the UI WebView or WK Webview into the WebAR component.
  • FIG. 3 shows an example of a WebAR component of the Android system in which a WebView is embedded as a component in a WebAR component.
  • a process of AR data interaction is shown in Figure 4.
  • the AR service controls the camera management component to start the camera through the JS interface (AR service interface and image device interface) implemented by ARSession, and queries the registered AR from the Detector registration list.
  • the algorithm selects the AR algorithm for determining the AR service, obtains the algorithm information of the AR algorithm, for example, the information of the IDetector interface; the JS interface (the image device interface) transmits the camera data collected by the camera to the determined IDetector interface, and is handed over to the IDetector interface.
  • the processing result is sent to the front end HTML5 page through the JS interface (AR service interface), and further processed by the front end HTML5 page, for example, rendering rendering, or virtual object superposition based on the processing result.
  • the data is exchanged with the WebView in the WebAR component, the data transmission of the camera data is transmitted to the JS interface (AR service interface), and the JS interface (AR service interface and query interface) of the WebAR component is interfaced with the AR algorithm.
  • the JS interface (AR service interface and query interface) provides a unified AR related capability interface to the front end, so the front end AR service logic can be replaced at any time; the algorithm registration interface of the AR algorithm is used to bridge various AR algorithms, so the AR algorithm can be implemented at any time. Replacement; the entire WebAR framework serves as a component for the host App to reference, so after the different host App accesses, it can provide the same JS interface (AR service interface and query interface) and AR algorithm capabilities to the front end.
  • the AR service of the front-end HTML5 page, the underlying AR algorithm and the host App are only interacted with the WebAR component respectively, and the three do not depend on each other. Therefore, the ARAR service, the AR algorithm, and the host App are all freely pluggable and independent of each other without being affected by each other.
  • the problem that the new AR service on the line needs to be upgraded by the App is solved; if the AR algorithm needs to be added or the existing AR algorithm is replaced, only the new algorithm needs to implement the IDetector interface and register in the WebAR component to make The host app reference, the HTML5 page can directly use the new AR algorithm, and the HTML5 page and the host App do not need to be changed, thereby solving the problem that the replacement, the new AR algorithm needs to be upgraded by the App; if there is an AR service needs more Simultaneously running on the App, you only need to access the WebAR component on multiple target host App, you can achieve the effect of one AR service running on multiple App, no difference with the normal HTML5 webpage, thus solving the same An issue where an AR service cannot run simultaneously on different apps.
  • a pluggable WebAR component is implemented, so that the front-end AR service, the specific AR algorithm, and the host application can be flexibly replaced, so that the AR service change and the AR algorithm update do not need to wait for the App upgrade, and the same Front-end AR services can run on multiple different host applications.
  • WEBVIEW is used as the WebAR component as an example, but is not limited thereto.
  • Weex or RN React Native
  • Weex or RN can parse the JS language like WEBVIEW, and only need to follow the Weex or RN framework when implementing it.
  • the algorithm registration interface of the AR algorithm, the webpage view component that implements the webpage function, the AR service interface that implements the AR service, and the communication channel between the AR algorithm interface and the AR service interface are encapsulated and generated by the AR service. file.
  • the AR algorithm itself is independent of the AR service callable file, and only needs to register with the AR service callable file, and informs the AR service that the corresponding algorithm information of the file can be called, that is, the AR service callable file can be called.
  • the AR service callable file does not need to understand the modification of the AR algorithm, or the specific implementation of adding or deleting, and only needs to obtain the corresponding algorithm information through the registration operation.
  • the AR service end only needs to interact with the AR service callable file to implement the corresponding AR function.
  • the AR service end does not need to embed the AR algorithm, and does not need to understand the specific implementation details of the AR algorithm. Therefore, when the new AR service is launched, the new AR service can be used only by making small changes to the front end such as the HTML page; the host application itself where the AR service can call the file itself may not have the AR algorithm, and The registered AR algorithm can implement the AR service of the host App itself; when replacing or adding the AR algorithm that does not belong to the host App itself, there is no need to change the host App itself; and, the same AR service can be easily implemented on different apps. Run at the same time. It can be seen that the distribution and deployment cost of the AR is greatly reduced by the solution of the embodiment of the present invention.
  • the data encapsulation method of this embodiment may be implemented by any suitable device or device having data processing functions, including but not limited to various terminals and servers.
  • FIG. 5 a flow chart of steps of a data processing method according to a third embodiment of the present invention is shown.
  • This embodiment is described as an example of a host in which an AR service callable file is installed.
  • the AR service callable file uses the AR service callable file described in Embodiment 1 or 2 to implement data processing of the AR service, and the AR.
  • the contents related to the business callable file can be referred to the foregoing embodiment.
  • Step S302 Receive an AR service request.
  • the AR service request carries the AR service parameters, such as the service type of the AR service, the operation parameters of the AR service, and the like.
  • the AR service request can be initiated by the front end HTML5 page, and the WebAR component is called for processing.
  • Step S304 Send the AR service parameter in the AR service request to the AR service callable file.
  • the AR service callable file is generated according to at least the algorithm registration interface of the AR algorithm, the webpage view component, the AR service interface, and the communication channel encapsulation between the AR algorithm interface and the AR service interface, as described in Embodiment 1 or 2.
  • the WebAR component in the second embodiment.
  • the host application or the browser where the AR service can invoke the file When the user triggers the AR service through a webpage such as an HTML5 page, the host application or the browser where the AR service can invoke the file generates a corresponding AR service request, and the AR service callable file is called to process the AR service request, and the AR service request is processed.
  • the AR service parameters are sent to the AR service interface in the AR service callable file.
  • Step S306 The AR service parameters are processed by the AR service callable file, and the processing result is returned.
  • the AR algorithm is selected according to the AR service parameters, and the image acquisition device, such as the camera, is controlled to collect images, and the AR service parameters and image data are sent to the AR algorithm interface, and the AR algorithm interface is used to invoke the AR.
  • the algorithm processes the image data according to the AR service parameters, and returns the processing result through the AR service interface.
  • Step S308 Perform AR service presentation according to the processing result.
  • the front-end HTML5 page After receiving the processing result, the front-end HTML5 page performs corresponding AR service processing and display based on the processing result, for example, mapping the face in the current image.
  • an AR-enabled file can be used to register an interface, a web page view component that implements a web page function, an AR service interface that implements an AR service, and an AR service callable file of a communication channel between an AR algorithm interface and an AR service interface.
  • the front end does not need to implement the AR algorithm, and does not need to understand the implementation details of the AR algorithm, which greatly reduces the distribution and deployment cost of the AR.
  • the data processing method of this embodiment may be implemented by any suitable device or device having data processing functions, including but not limited to various terminals and servers.
  • FIG. 6 there is shown a flow chart of the steps of a data processing method in accordance with a fourth embodiment of the present invention.
  • This embodiment is described as an example of a host in which an AR service callable file is installed.
  • the AR service callable file uses the AR service callable file described in Embodiment 1 or 2 to implement data processing of the AR service, and the AR.
  • the contents related to the business callable file can be referred to the foregoing embodiment.
  • Step S402 Receive a registration request of the AR algorithm, and register the AR algorithm by using an algorithm registration interface of the AR service callable file.
  • the AR service can call the file to learn the algorithm information of the AR algorithm, and the registration of the AR algorithm can adopt the interface registration method.
  • the AR service callable file may be an AR service callable component, such as the WebAR component in the second embodiment.
  • Step S404 Receive an AR algorithm query request, and return the algorithm information of the AR algorithm through the query interface of the AR service callable file.
  • the AR service can call the file to store the algorithm information of the successfully registered AR algorithm, and the current HTML5 page can query the AR algorithm through the query interface encapsulated in the AR service callable file, and send the AR algorithm.
  • the AR service callable file can receive and return the algorithm information of the AR algorithm to the front end HTML5 page according to the AR algorithm query request, and the subsequent HTML5 page can pass the AR service interface and the AR according to the actual AR service requirement.
  • the algorithm interface calls the AR algorithm.
  • Step S406 Receive an AR service request.
  • the AR service request carries an AR service parameter, such as an AR service type, an AR operation parameter, and the like.
  • Step S408 Send the AR service parameter in the AR service request to the AR service callable file.
  • the AR service callable file adopts the AR service callable file in the first embodiment or the second embodiment.
  • the host application or browser of the AR service callable file sends the AR service parameters to the AR service interface in the AR service callable file.
  • Step S410 The AR service parameters are processed by the AR service callable file, and the processing result is returned.
  • the AR service parameter can be received by the AR service interface of the AR service callable file, and the matched AR algorithm is determined according to the AR service parameter, and the AR service parameter is sent to the AR of the matched AR algorithm by using the webpage view component.
  • the algorithm interface processes and receives the AR service data returned by the AR algorithm interface through the AR service interface.
  • the AR service callable file When the AR service callable file encapsulates an image device interface for controlling the image capture device, and/or encapsulates an image acquisition interface for acquiring image data, it may also pass after determining the matched AR algorithm according to the AR service parameter.
  • the AR service may invoke an image device interface of the file, invoke an image acquisition device for image collection, and/or acquire a still image or a video frame image through an image acquisition interface of the AR service callable file.
  • the processing of the AR service parameter by the web page view component to the AR algorithm interface of the matched AR algorithm includes: sending the image acquired by the image acquisition device or the image acquisition interface through the web page view component, and sending the AR service parameter.
  • the AR algorithm interface is processed.
  • Step S412 Perform AR service presentation according to the processing result.
  • the face key position data in the face image returned by the AR service interface is subjected to texture processing on the face in the image, and the like.
  • an AR-enabled file can be used to register an interface, a web page view component that implements a web page function, an AR service interface that implements an AR service, and an AR service callable file of a communication channel between an AR algorithm interface and an AR service interface.
  • the front end does not need to implement the AR algorithm, and does not need to understand the implementation details of the AR algorithm, which greatly reduces the distribution and deployment cost of the AR.
  • the data processing method of this embodiment may be implemented by any suitable device or device having data processing functions, including but not limited to various terminals and servers.
  • FIG. 7 a block diagram of a structure of a data encapsulating apparatus according to Embodiment 5 of the present invention is shown.
  • the data encapsulating device of this embodiment includes: a first setting module 502, configured to set an algorithm registration interface for registering an AR algorithm and an AR service interface for performing AR interaction with a webpage based on a webpage view component; and a second setting module 504 And a channel for performing communication between the algorithm interface of the AR algorithm based on the web page view component and the AR service interface; the encapsulation module 506 is configured to register the interface, the webpage view component, and the AR according to the algorithm of the AR algorithm.
  • the service interface and the channel encapsulate the AR service callable file.
  • the data encapsulating device of this embodiment further includes: a third setting module 508, configured to set an image device interface for controlling the image capturing device based on the web page view component, and/or configured to acquire an image An image acquisition interface of the data; the encapsulation module 506 is configured to encapsulate at least one of the image device interface and the image acquisition interface, and the algorithm registration interface, the webpage view component, the AR service interface, and the channel, and the encapsulation Generate an AR business callable file.
  • a third setting module 508 configured to set an image device interface for controlling the image capturing device based on the web page view component, and/or configured to acquire an image An image acquisition interface of the data
  • the encapsulation module 506 is configured to encapsulate at least one of the image device interface and the image acquisition interface, and the algorithm registration interface, the webpage view component, the AR service interface, and the channel, and the encapsulation Generate an AR business callable file.
  • the encapsulating module 506 is configured to encapsulate, generate, and generate, at least one of the image device interface and the image obtaining interface, and the algorithm registration interface, the webpage view component, the AR service interface, and the channel.
  • the AR service may invoke a file; or, set a call interface for invoking a web page view component, at least one interface of the image device interface and the image acquisition interface, and the algorithm registration interface, a webpage view component call
  • the interface, the AR service interface, and the channel are encapsulated to generate an AR service callable file.
  • the second setting module 504 is configured to set, by the communication channel, the AR service parameter received by the webpage view component through the AR service interface to the AR algorithm interface that is successfully registered.
  • the second setting module 504 is further configured to set, by using the webpage view component, communication between the image device interface for controlling the image collection device and the algorithm interface of the AR service interface and the AR algorithm, respectively. a channel; and/or a communication channel between the image acquisition interface for acquiring image data via the web page view component and the algorithm interface of the AR service interface and the AR algorithm, respectively.
  • the data encapsulating device of the embodiment further includes: a fourth setting module 510, configured to set a query interface for acquiring algorithm information of the AR algorithm, and encapsulate the query interface into the AR service callable file.
  • a fourth setting module 510 configured to set a query interface for acquiring algorithm information of the AR algorithm, and encapsulate the query interface into the AR service callable file.
  • the AR service callable file is an AR service callable component.
  • the AR algorithm includes multiple, and multiple AR algorithms are registered by the same interface class.
  • the data encapsulating device of this embodiment is used to implement the corresponding data encapsulation method in the foregoing multiple method embodiments, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.
  • FIG. 8 there is shown a block diagram showing the structure of a data processing apparatus according to a sixth embodiment of the present invention.
  • the data processing apparatus of this embodiment includes: a receiving module 602, configured to receive an AR service request, where the AR service request carries an AR service parameter, and a sending module 604, configured to send the AR service parameter in the AR service request to the AR a business callable file, wherein the AR service callable file is generated according to an algorithm registration interface of the AR algorithm, a web page view component, an AR service interface, and a communication channel encapsulation between the AR algorithm interface and the AR service interface; and the processing module 606 is configured to pass The AR service can process the AR service parameters and return the processing result.
  • the display module 608 is configured to perform the AR service display according to the processing result.
  • the processing module 606 is configured to receive an AR service parameter by using an AR service interface of the AR service callable file, and determine a matched AR algorithm according to the AR service parameter; send the AR service parameter to the matching by using the webpage view component.
  • the AR algorithm interface of the AR algorithm processes, and receives the AR service data returned by the AR algorithm interface through the AR service interface.
  • the AR service callable file is further encapsulated with an image device interface for controlling the image collection device, and/or an image acquisition interface for acquiring image data is encapsulated; the processing module 606 is further configured to use the AR service parameter according to the AR service parameter.
  • the image collection device is invoked to perform image acquisition through the image device interface of the AR service callable file; and/or, the static image or video frame is obtained through the image acquisition interface of the AR service callable file.
  • the image obtained by the image acquisition device or the image acquisition interface, and the AR service parameter are sent to the AR algorithm interface for processing by the webpage view component.
  • the data processing apparatus of this embodiment further includes: a registration module 610, configured to: before the receiving module 602 receives the AR service request, receive a registration request of the AR algorithm, and register an interface to the AR algorithm by using an algorithm of the AR service callable file. Sign up.
  • a registration module 610 configured to: before the receiving module 602 receives the AR service request, receive a registration request of the AR algorithm, and register an interface to the AR algorithm by using an algorithm of the AR service callable file. Sign up.
  • the AR service callable file is further encapsulated with a query interface for acquiring the algorithm information of the AR algorithm.
  • the data processing apparatus of the embodiment further includes: a query module 612, configured to receive the AR service request before receiving the AR service request The AR algorithm queries the request, and returns the algorithm information of the AR algorithm through the query interface of the AR service callable file.
  • the AR service callable file is an AR service callable component.
  • the data processing apparatus of this embodiment is used to implement the corresponding data processing method in the foregoing multiple method embodiments, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.
  • FIG. 9 a schematic structural diagram of an electronic device according to Embodiment 7 of the present invention is shown.
  • the specific embodiment of the present invention does not limit the specific implementation of the electronic device.
  • the electronic device can include a processor 702, a communications interface 704, a memory 706, and a communications bus 708.
  • Processor 702, communication interface 704, and memory 706 complete communication with one another via communication bus 708.
  • the communication interface 704 is configured to communicate with other terminal devices or servers.
  • the processor 702 is configured to execute the program 710, and specifically, perform the related steps in the foregoing data encapsulation method embodiment.
  • program 710 can include program code, the program code including computer operating instructions.
  • the processor 702 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.
  • the one or more processors included in the terminal device may be the same type of processor, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.
  • the memory 706 is configured to store the program 710.
  • Memory 706 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.
  • the program 710 may be specifically configured to cause the processor 702 to perform an operation of: setting an algorithm registration interface for registering an AR algorithm and an AR service interface for performing AR interaction with a webpage based on a webpage view component; setting based on the webpage view component And a channel for communicating between the algorithm interface of the AR algorithm and the AR service interface; and registering the interface, the webpage view component, the AR service interface, and the channel according to the algorithm, and encapsulating the AR service callable file.
  • the program 710 is further configured to enable the processor 702 to set an image device interface for controlling the image collection device based on the web page view component; and/or to set an image for acquiring image data. Obtaining an interface; the program 710 is further configured to: when the processor 702 generates an AR service callable file according to the algorithm registration interface, the webpage view component, the AR service interface, and the channel, according to the image device interface and the At least one interface in the image acquisition interface, and the algorithm registration interface, the web page view component, the AR service interface, and the channel, and the package generates an AR service callable file.
  • the program 710 is further configured to cause the processor 702 to perform at least one interface according to the image device interface and the image acquisition interface, and the algorithm registration interface, a webpage view component, And the at least one interface of the image device interface and the image acquisition interface, and the algorithm registration interface, the webpage view component, and the AR service interface, when the AR service interface and the channel are configured to generate an AR service callable file Encapsulating with the channel to generate an AR service callable file; or setting a call interface for calling a web page view component, at least one interface of the image device interface and the image acquisition interface, and the algorithm The registration interface, the calling interface of the webpage view component, the AR service interface, and the channel are encapsulated to generate an AR service callable file.
  • the program 710 is further configured to enable the processor 702 to set a channel for communication between the algorithm interface of the AR algorithm based on the web page view component and the AR service interface.
  • the AR service parameters received by the web page view component through the AR service interface are delivered to the communication channel of the AR algorithm interface that is successfully registered.
  • the program 710 is further configured to enable the processor 702 to set an image device interface for controlling the image collection device via the web page view component to respectively associate with the AR service interface and the AR algorithm. a communication channel between the algorithm interfaces; and/or a communication between the image acquisition interface for acquiring image data via the web page view component and the algorithm interface of the AR service interface and the AR algorithm, respectively aisle.
  • the program 710 is further configured to cause the processor 702 to set a query interface for acquiring algorithm information of the AR algorithm, and encapsulate the query interface into the AR service callable file.
  • the AR service callable file is an AR service callable component.
  • the AR algorithm includes multiple, and multiple AR algorithms are registered through the same interface class.
  • the algorithm registration interface of the AR algorithm, the webpage view component that implements the webpage function, the AR service interface that implements the AR service, and the communication channel between the AR algorithm interface and the AR service interface are encapsulated and generated into an AR.
  • Business callable files The AR algorithm itself is independent of the AR service callable file, and only needs to register with the AR service callable file, and informs the AR service that the corresponding algorithm information of the file can be called, that is, the AR service callable file can be called.
  • the AR service callable file does not need to understand the modification of the AR algorithm, or the specific implementation of adding or deleting, and only needs to obtain the corresponding algorithm information through the registration operation.
  • the AR service end only needs to interact with the AR service callable file to implement the corresponding AR function.
  • the AR service end does not need to embed the AR algorithm, and does not need to understand the specific implementation details of the AR algorithm. Therefore, when the new AR service is launched, the new AR service can be used only by making small changes to the front end such as the HTML page; the host application itself where the AR service can call the file itself may not have the AR algorithm, and
  • the registered AR algorithm can implement the AR service of the host App itself; when replacing or adding the AR algorithm that does not belong to the host App itself, there is no need to change the host App itself; and, the same AR service can be easily implemented on different apps. Run at the same time. It can be seen that the distribution and deployment cost of the AR is greatly reduced by the solution of the embodiment of the present invention.
  • FIG. 10 a schematic structural diagram of an electronic device according to Embodiment 7 of the present invention is shown.
  • the specific embodiment of the present invention does not limit the specific implementation of the electronic device.
  • the electronic device can include a processor 802, a communications interface 804, a memory 806, and a communications bus 808.
  • Processor 802, communication interface 804, and memory 806 complete communication with one another via communication bus 808.
  • the communication interface 804 is configured to communicate with other terminal devices or servers.
  • the processor 802 is configured to execute the program 810, and specifically may perform the related steps in the foregoing data processing method embodiment.
  • program 810 can include program code, the program code including computer operating instructions.
  • the processor 802 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.
  • the one or more processors included in the terminal device may be the same type of processor, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.
  • the memory 806 is configured to store the program 810.
  • Memory 806 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.
  • the program 810 is specifically configured to enable the processor 802 to perform the following operations: receiving an AR service request, where the AR service request carries an AR service parameter, and the AR service parameter in the AR service request is sent to the AR service callable file, where The AR service callable file is generated according to the algorithm registration interface of the AR algorithm, the webpage view component, the AR service interface, and the communication channel between the AR algorithm interface and the AR service interface; the AR service callable file is used to process the AR service parameters, and Returning the processing result; performing AR service display according to the processing result.
  • the program 810 is further configured to: when the processor 802 processes the AR service parameter by using an AR service callable file, and returns a processing result, the AR service of the file can be invoked through the AR service.
  • the interface receives the AR service parameter, and determines the matched AR algorithm according to the AR service parameter.
  • the AR service parameter is sent to the AR algorithm interface of the matched AR algorithm for processing by the webpage view component, and is received by the AR service interface.
  • the AR service callable file is further encapsulated with an image device interface for controlling the image capture device, and/or encapsulated with an image acquisition interface for acquiring image data;
  • the program 810 is further configured to enable After determining the matched AR algorithm according to the AR service parameter, the processor 802 invokes the image collection device to perform image collection through the image device interface of the AR service callable file; and/or, through the AR service, the image of the file can be called.
  • the program 810 is further configured to cause the processor 802 to pass the webpage when the AR service parameter is sent by the webpage view component to the AR algorithm interface of the matched AR algorithm
  • the view component sends the image acquired by the image acquisition device or acquired by the image acquisition interface, and the AR service parameter to the AR algorithm interface for processing.
  • the program 810 is further configured to enable the processor 802 to receive a registration request of the AR algorithm before receiving the AR service request, and register the AR algorithm by using an algorithm registration interface of the AR service callable file.
  • the AR service callable file is further encapsulated with a query interface for acquiring algorithm information of the AR algorithm; the program 810 is further configured to enable the processor 802 to receive the AR algorithm query before receiving the AR service request. The request returns the algorithm information of the AR algorithm through the query interface of the AR service callable file.
  • the AR service callable file is an AR service callable component.
  • an algorithm encapsulation interface encapsulating the AR algorithm a web page view component implementing the webpage function, an AR service interface implementing the AR service, and an AR service of the communication channel between the AR algorithm interface and the AR service interface are used.
  • the file can be called to implement the AR service of the front end.
  • the front end does not need to implement the AR algorithm, and does not need to understand the implementation details of the AR algorithm, which greatly reduces the AR distribution and deployment costs.
  • the above method according to an embodiment of the present invention may be implemented in hardware, firmware, or implemented as software or computer code that may be stored in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or implemented by
  • the network downloads computer code originally stored in a remote recording medium or non-transitory machine readable medium and stored in a local recording medium so that the methods described herein can be stored using a general purpose computer, a dedicated processor or programmable
  • Such software processing on a recording medium of dedicated hardware such as an ASIC or an FPGA.
  • a computer, processor, microprocessor controller or programmable hardware includes storage components (eg, RAM, ROM, flash memory, etc.) that can store or receive software or computer code, when the software or computer code is The methods described herein are implemented when the processor or hardware is accessed and executed. Moreover, when a general purpose computer accesses code for implementing the methods shown herein, the execution of the code transforms the general purpose computer into a special purpose computer for performing the methods illustrated herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Library & Information Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé et un appareil d'encapsulation de données, un dispositif et un appareil de traitement de données, un dispositif électronique et un support de stockage non temporaire lisible par machine. Le procédé d'encapsulation de données consiste à : fournir une interface d'enregistrement d'algorithme pour enregistrer un algorithme AR et une interface de service AR pour effectuer une interaction AR avec une page web sur la base d'un composant de visualisation de page web (S102); fournir un canal pour une communication entre une interface d'algorithme de l'algorithme AR enregistré avec succès sur la base du composant de visualisation de page web et de l'interface de service AR (S104); et encapsuler et générer un fichier éligible service AR selon le composant de visualisation de page web, l'interface d'enregistrement d'algorithme de l'algorithme AR, l'interface de service AR et le canal établi (S106). Au moyen du procédé, les coûts de distribution et de déploiement d'AR sont considérablement réduits.
PCT/CN2018/104184 2017-11-30 2018-09-05 Procédé et appareil d'encapsulation de données, dispositif et appareil de traitement de données, et dispositif électronique WO2019105093A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711241821.4 2017-11-30
CN201711241821.4A CN107861754B (zh) 2017-11-30 2017-11-30 数据封装、处理方法、装置及电子设备

Publications (1)

Publication Number Publication Date
WO2019105093A1 true WO2019105093A1 (fr) 2019-06-06

Family

ID=61704283

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/104184 WO2019105093A1 (fr) 2017-11-30 2018-09-05 Procédé et appareil d'encapsulation de données, dispositif et appareil de traitement de données, et dispositif électronique

Country Status (2)

Country Link
CN (1) CN107861754B (fr)
WO (1) WO2019105093A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860982A (zh) * 2019-11-27 2021-05-28 阿里巴巴集团控股有限公司 数据处理方法、装置、电子设备及计算机存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107861754B (zh) * 2017-11-30 2020-12-01 阿里巴巴（中国）有限公司 数据封装、处理方法、装置及电子设备
CN109325756A (zh) * 2018-08-03 2019-02-12 上海小渔数据科技有限公司 用于数据算法交易的数据处理方法及装置、服务器
CN111427529B (zh) * 2019-01-09 2023-05-30 斑马智行网络(香港)有限公司 交互方法、装置、设备及存储介质
CN110505273B (zh) * 2019-07-12 2022-04-22 苏州浪潮智能科技有限公司 一种服务能力限制的使用方法、设备及可读介质
CN116635828A (zh) * 2021-11-23 2023-08-22 京东方科技集团股份有限公司 Flutter Web应用程序与宿主程序通信方法、计算机设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103577931A (zh) * 2013-10-28 2014-02-12 北京邮电大学 一种基于语义的可复用软件服务管理系统及其实现方法
CN106201161A (zh) * 2014-09-23 2016-12-07 北京三星通信技术研究有限公司 电子设备的显示方法及系统
US20170090589A1 (en) * 2015-09-28 2017-03-30 Wand Labs, Inc. Unified virtual reality platform
CN107305435A (zh) * 2016-04-18 2017-10-31 迪斯尼企业公司 在增强现实和虚拟现实环境之间链接和交互的系统和方法
CN107861754A (zh) * 2017-11-30 2018-03-30 广州市动景计算机科技有限公司 数据封装、处理方法、装置及电子设备

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008508621A (ja) * 2004-08-03 2008-03-21 シルバーブルック リサーチ ピーティワイ リミテッド ウォークアップ印刷
CN100481002C (zh) * 2007-04-18 2009-04-22 杭州华三通信技术有限公司 一种Web界面扩展方法和装置
CN103679800B (zh) * 2013-11-21 2017-09-01 北京航空航天大学 一种视频图像虚拟场景生成系统及其框架构造方法
CN105338117B (zh) * 2015-11-27 2018-05-29 亮风台（上海）信息科技有限公司 用于生成ar应用和呈现ar实例的方法、设备与系统
CN106412082B (zh) * 2016-10-31 2019-04-26 东北大学 一种基于云的电熔镁砂熔炼过程移动监视系统及方法
CN106951233B (zh) * 2017-03-02 2020-04-17 广州天高软件科技有限公司 混合模式智能手机应用开发框架系统
CN107391201B (zh) * 2017-07-27 2020-03-27 艾迪森海安数字医疗装备有限公司 一种动态业务数据的软件框架的数据流动实现方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103577931A (zh) * 2013-10-28 2014-02-12 北京邮电大学 一种基于语义的可复用软件服务管理系统及其实现方法
CN106201161A (zh) * 2014-09-23 2016-12-07 北京三星通信技术研究有限公司 电子设备的显示方法及系统
US20170090589A1 (en) * 2015-09-28 2017-03-30 Wand Labs, Inc. Unified virtual reality platform
CN107305435A (zh) * 2016-04-18 2017-10-31 迪斯尼企业公司 在增强现实和虚拟现实环境之间链接和交互的系统和方法
CN107861754A (zh) * 2017-11-30 2018-03-30 广州市动景计算机科技有限公司 数据封装、处理方法、装置及电子设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LU , PING: "Research on Key Technology of Image Processing in Mobile Augmented Reality and its Application", CHINA DOCTORAL DISSERTATIONS FULL-TEXT DATABASE (ELECTRONIC JOURNALS, 15 May 2016 (2016-05-15), ISSN: 1674-022X *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860982A (zh) * 2019-11-27 2021-05-28 阿里巴巴集团控股有限公司 数据处理方法、装置、电子设备及计算机存储介质
CN112860982B (zh) * 2019-11-27 2024-05-10 阿里巴巴集团控股有限公司 数据处理方法、装置、电子设备及计算机存储介质

Also Published As

Publication number Publication date
CN107861754B (zh) 2020-12-01
CN107861754A (zh) 2018-03-30

Similar Documents

Publication Publication Date Title
WO2019105093A1 (fr) Procédé et appareil d'encapsulation de données, dispositif et appareil de traitement de données, et dispositif électronique
TWI444216B (zh) 基於移動終端實現遊戲之方法和裝置
CN108563517B (zh) 系统接口的调用方法及装置
WO2018050003A1 (fr) Procédé et appareil de restitution d'élément de page web par 3d canvas et dispositif électronique
AU2022211850B2 (en) Application function implementation method and electronic device
US20220007083A1 (en) Method and stream-pushing client for processing live stream in webrtc
US11706331B2 (en) Information processing method and apparatus, storage medium, and electronic device
EP2854348B1 (fr) Procédé et système d'affichage d'interface de passerelle domestique applicable à types d'affichage multiples
US11210119B2 (en) Method and device for displaying interface, electronic equipment, server, and storage medium
CN110874217B (zh) 快应用的界面显示方法、装置及存储介质
CN103430123A (zh) 用于经由支持2d画布和动态绘图的html来进行远程桌面会话的方法和系统
CN111433743A (zh) 一种app远程控制方法及相关设备
CN103430164A (zh) 用于经由http标头来进行远程桌面会话重新绘制的方法和系统
US20140201619A1 (en) Method And Device For Implementing Local Operation On Web Page
CN112527174B (zh) 一种信息处理方法及电子设备
CN113032080A (zh) 页面实现方法、应用程序、电子设备及存储介质
CN108052377B (zh) 基于云的输入处理方法、装置、服务器和存储介质
CN108364324B (zh) 图像数据处理方法、装置及电子终端
CN109725887B (zh) 基于消息研发框架的数据交互方法、装置及终端设备
WO2020221090A1 (fr) Procédé à utiliser dans le fonctionnement combiné d'applications invitées, et dispositif
EP3835967A1 (fr) Procédé et appareil d'affichage de données de carte et support d'enregistrement
CN111008050B (zh) 页面任务执行方法、装置、终端及存储介质
CN109857568B (zh) 数据封装及处理方法、装置及电子设备
US20190172263A1 (en) Method and apparatus for augmenting reality
CN117216428B (zh) 一种网页资源请求方法、终端设备及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18884044

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18884044

Country of ref document: EP

Kind code of ref document: A1