CN108287919B - Webpage application access method and device, storage medium and electronic equipment - Google Patents

Webpage application access method and device, storage medium and electronic equipment Download PDF

Info

Publication number
CN108287919B
CN108287919B CN201810150792.9A CN201810150792A CN108287919B CN 108287919 B CN108287919 B CN 108287919B CN 201810150792 A CN201810150792 A CN 201810150792A CN 108287919 B CN108287919 B CN 108287919B
Authority
CN
China
Prior art keywords
target
application
webpage application
shooting
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810150792.9A
Other languages
Chinese (zh)
Other versions
CN108287919A (en
Inventor
谢楚元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810150792.9A priority Critical patent/CN108287919B/en
Publication of CN108287919A publication Critical patent/CN108287919A/en
Priority to PCT/CN2018/125029 priority patent/WO2019157870A1/en
Application granted granted Critical
Publication of CN108287919B publication Critical patent/CN108287919B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9554Retrieval from the web using information identifiers, e.g. uniform resource locators [URL] by using bar codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/532Query formulation, e.g. graphical querying
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9532Query formulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44521Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Library & Information Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application discloses a method, a device, a storage medium and an electronic device for accessing a webpage application, wherein the method for accessing the webpage application is applied to the electronic device and comprises the following steps: acquiring the type and the identification of a target shooting object in a shot image; determining a target webpage application according to the type; generating an access instruction according to the identifier and the target webpage application, and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application, and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return; and receiving and displaying the page data returned by the server to access the target webpage application, so that the related webpage application can be directly accessed by photographing without accessing through a webpage application interface, and the method is simple.

Description

Webpage application access method and device, storage medium and electronic equipment
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for accessing a web application, a storage medium, and an electronic device.
Background
With the rapid development of mobile communication technology, more and more functions can be realized by mobile devices, such as chatting, video, beautifying, listening to music, watching news and the like, and the life of people is greatly enriched.
These functions are currently mainly implemented by installing the corresponding application in the mobile device, but, the more applications are installed in the mobile device, the higher the requirement for the memory, some manufacturers have developed a WEB page application concept, that is, a set of frames built by using HTML (hypertext markup language), CSS (cascading style sheets), JavaScript and the like based on the WEB specification, it comprises a view layer and a logic layer, wherein the view layer is used for rendering a page structure, the logic layer is used for logic processing, data request and interface calling, wherein, the logic layer notifies the data change to the view layer, triggers the update of the view layer page, the view layer notifies the triggered event to the logic layer for service processing, therefore, a plurality of program functions can be realized by using the same set of framework, a program application package does not need to be installed locally on the mobile equipment, and the system memory is released to a great extent.
However, for the existing web application program, the user needs to enter the web application interface to access the required web application through searching or browsing the historical usage records each time, which is tedious in operation and low in access efficiency.
Disclosure of Invention
The embodiment of the application provides a method and a device for accessing a webpage application, a storage medium and an electronic device, the webpage application does not need to be accessed through a webpage application interface, and the access efficiency of the webpage application is improved.
The embodiment of the application provides an access method of a webpage application, which is applied to electronic equipment and comprises the following steps:
acquiring the type and the identification of a target shooting object in a shot image;
determining a target webpage application according to the type;
generating an access instruction according to the identifier and the target webpage application, and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application, and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return;
and receiving and displaying page data returned by the server to access the target webpage application.
The embodiment of the present application further provides an access device for web applications, which is applied to electronic devices, and includes:
the acquisition module is used for acquiring the type and the identification of a target shooting object in a shot image;
the determining module is used for determining the target webpage application according to the type;
the generating module is used for generating an access instruction according to the identifier and the target webpage application and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return;
and the display module is used for receiving and displaying the page data returned by the server so as to access the target webpage application.
The embodiment of the application also provides a storage medium, wherein a plurality of instructions are stored in the storage medium, and the instructions are suitable for being loaded by a processor to execute the access method of any one webpage application.
An embodiment of the present application further provides an electronic device, which includes a processor and a memory, where the processor is electrically connected to the memory, the memory is used to store instructions and data, and the processor is used in any one of the steps in the method for accessing a web application.
The method, the device, the storage medium and the electronic equipment are applied to the electronic equipment, the type and the identification of a target shooting object in a shot image are obtained, the target webpage application is determined according to the type, then, an access instruction is generated according to the identification and the target webpage application and is sent to a server, the access instruction is used for indicating the server to start the target webpage application, page data corresponding to the identification are obtained through a preset interface of the target webpage application and are returned, then the page data returned by the server are received and displayed, the target webpage application is accessed, and therefore the related webpage application can be directly accessed through shooting without entering through a webpage application interface.
Drawings
The technical solution and other advantages of the present application will become apparent from the detailed description of the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of an implementation environment of an access method for a web application according to an embodiment of the present application.
Fig. 2 is a schematic flowchart of an access method of a web application according to an embodiment of the present application.
Fig. 3 is another schematic flow chart of an access method of a web application according to an embodiment of the present application.
Fig. 4 is a schematic flowchart of accessing a web application through a photo according to an embodiment of the present application.
Fig. 5 is a schematic view of an entry scene of a display interface provided in an embodiment of the present application.
Fig. 6 is a schematic structural diagram of an access device for a web application according to an embodiment of the present application.
Fig. 7 is a schematic structural diagram of an acquisition module according to an embodiment of the present application.
Fig. 8 is another schematic structural diagram of an access device for a web application according to an embodiment of the present application.
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a method and a device for accessing a webpage application, a storage medium and electronic equipment.
Referring to fig. 1, fig. 1 is a schematic diagram of an implementation environment of an access method for a web application according to an embodiment of the present application, and as shown in fig. 1, the implementation environment includes a smart phone, a communication network, and a server.
The operating system of the smart phone can be an android system, a Saiban system, an apple system and the like. The smart phone and the server are connected through a communication network.
The communication network comprises a wireless network and a wired network, wherein the wireless network comprises one or more of a wireless wide area network, a wireless local area network, a wireless metropolitan area network and a wireless personal network.
The server can be a background server of an open platform, through which a user can access various registered web applications, the web application is application software operated on the internet or an intranet by using a web browser, is an application program written in a web language (such as programming languages like HTML, JavaScript, Java, etc.), needs to be executed through the browser, and can be uniformly accessed through the open platform, for example, an installation package of the web application and cache data generated during running are stored in the server of the open platform, which can be installed and run in a smart phone without installation, thereby saving memory resources of the smart phone as much as possible, and the smart phone can perform data communication with a factory server of the web application through an application interface in the open platform, so as to realize access to the web application, the method is characterized in that the method is point-to-point, convenient and fast, at the moment, a server of the open platform plays the role of a proxy server, and each webpage application corresponds to one application interface.
An access method of a webpage application is applied to an electronic device and comprises the following steps: acquiring the type and the identification of a target shooting object in a shot image; determining a target webpage application according to the type; generating an access instruction according to the identifier and the target webpage application, and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application, and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return; and receiving and displaying the page data returned by the server to access the target webpage application.
As shown in fig. 2, fig. 2 is a schematic flowchart of an access method of a web application provided in an embodiment of the present application, and the specific flow is as follows:
101. the type and identification of the target photographic object in the photographic image are acquired.
In this embodiment, the shot image may be shot in real time or may be stored in an album. The target photographic subject may be a person or an object, and the type and the identification may be set by a person, wherein the type may include clothing, food, articles, movies, people, animals, and the like, the identification is mainly used for identifying different photographic subjects, and may be names of photographic subjects, such as a teacup, a coat, a golden hair (dog), a giardian (singer), "you from stars" (drama name), and the like, each type may correspond to a plurality of identifications, and each identification corresponds to one photographic subject.
For example, the step 101 may specifically include:
1-1, identifying at least one shooting object contained in the shooting image by using the trained model.
In this embodiment, the trained model may be a CNN (Convolutional Neural Network) model, which is a deep Neural Network model for processing large images. When the CNN model is trained, a large number of sample pictures may be collected, the sample pictures may be downloaded in batch from a background database of each web application (e.g., shopping application), at this time, the identifiers corresponding to the sample pictures may also be directly obtained, of course, the sample pictures may also be obtained through other approaches, such as pictures in a user album, at this time, the identifiers corresponding to the sample pictures may be manually labeled.
1-2, determining a target photographic subject from the at least one photographic subject.
For example, the step 1-2 may specifically include:
when the photographic subject is single, taking the single photographic subject as a target photographic subject;
and when a plurality of shooting objects exist, detecting whether a selected area exists on the shooting image, if so, taking the shooting object corresponding to the selected area as a target shooting object, and if not, taking the plurality of shooting objects as the target shooting objects.
In this embodiment, since the display window of the electronic device can only display a single network page under normal conditions, there is usually only one target photographic object, such as a movie star in a promotion poster, and when there are multiple target photographic objects, such as all movie stars in a promotion poster, it usually represents that the photographic image is a screenshot of a movie and television work.
It is easily understood that the selected area is generally formed by a manual operation of a user, that is, before detecting whether the selected area exists on the photographed image, the access method of the web application may further include:
displaying the shot image in a display interface;
acquiring the click operation of the user on the display interface;
and determining a selected area on the shot image according to the clicking position of the clicking operation.
In this embodiment, the display interface may be a preview interface during the shooting process, or may be an interface entered through a designated interface when browsing photos in an album, depending on whether the shot image is shot in real time or stored. In a period of time when the shot image is displayed, a user can superpose a frame selection frame on the shot image through clicking or touching and other operations, and the area in the frame selection frame is the selected area. The shape and size of the frame may be set in advance by a person, and the position of the frame on the captured image depends on the click position, for example, the click position may be set as the center point position of the frame.
And 1-3, acquiring the type and the identification corresponding to the target shooting object.
In this embodiment, when the target photographic object is a single object, the corresponding type and identifier may be directly matched in the library, for example, the type is a person, and the identifier is "michael". When there are a plurality of target photographic objects, it is necessary to acquire the type and the identification of the plurality of target photographic objects as a whole, in this case, the acquired type is usually a movie, and the identification is the name of the movie.
102. And determining the target webpage application according to the type.
For example, the step 102 may specifically include:
acquiring at least one preset webpage application corresponding to the type;
displaying the at least one preset webpage application to a user for selection;
and taking the preset webpage application selected by the user as a target webpage application.
In this embodiment, the preset web applications should be associated in advance, each type may be associated with a single or multiple preset web applications, for example, the type "teacup" may be associated with encyclopedic web applications and shopping web applications, the type "movie" may be associated with video web applications and electronic book web applications, and the like, and each type of web application may also have multiple selections.
It should be noted that, in the process of displaying the preset web page application to the user, the display duration may be determined according to the number of the preset web page applications, for example, if the preset web page application is a single preset web page application, since there is no other candidate application, the user may not need to perform a selection operation, so the display duration may be set to be very short, for example, after 1s, the user may automatically default that the only preset web page application has been selected as the target web page application by the user, and if the preset web page applications are multiple preset web page applications and there is a preset web page application of the same category, in order to make the display concise and orderly, a navigation interface may be displayed first, a category tag corresponding to the preset web page application, such as category tags of encyclopedic, shopping, etc., may be displayed on the navigation interface, and the user may enter the selection interface of the specific preset web page application by clicking the category tag, thereby avoiding that the display is disordered due to, the hierarchical structure is clear.
103. And generating an access instruction according to the identifier and the target webpage application, and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application, and acquiring page data corresponding to the identifier through a preset interface of the target webpage application for returning.
In this embodiment, the preset interface may be set manually, for example, it may be an item purchase search entry, an encyclopedia search entry, a video play entry, or the like. The webpage application needs to be accessed on the premise of installation and operation, the installation package is stored in the server but not the user equipment, so when the server receives an access instruction of a certain webpage application, whether the webpage application is in an operation state locally in the server needs to be confirmed, if yes, the webpage data corresponding to the identification, such as a related purchase page of a teacup, can be accessed by directly utilizing a preset interface of the operated webpage application, the accessed webpage data are sent to the electronic equipment, if not, the webpage application needs to be started firstly, then the webpage access can be carried out through the started webpage application, and the starting operation can be realized in a sandbox environment.
104. And receiving and displaying the page data returned by the server to access the target webpage application.
In this embodiment, for the page data received by the server, the electronic device may adjust the page display size according to the size of the display screen of the electronic device to display the page data, and certainly, in the display process, the user may also enlarge or reduce the displayed page by controlling the distance between the two fingers.
As can be seen from the above, the method for accessing a web application provided in this embodiment is applied to an electronic device, and includes obtaining a type and an identifier of a target object in a captured image, determining the target web application according to the type, then generating an access instruction according to the identifier and the target web application, and sending the access instruction to a server, where the access instruction is used to instruct the server to start the target web application, and obtaining page data corresponding to the identifier through a preset interface of the target web application to return, and then receiving and displaying the page data returned by the server to access the target web application, so that a related web application can be directly accessed by taking a picture without accessing through a web application interface.
In this embodiment, the access device of the web application will be described, and in particular, the access device of the web application will be described in detail by taking an example of integrating the access device of the web application in the electronic device and the server.
Referring to fig. 3 and 4, a specific process of an access method of a web application may be as follows:
201. the electronic equipment displays the shot image in the display interface.
For example, the display interface may be a preview interface during the shooting process, or may be an interface entered by the user through a web application icon when browsing photos in the album, see fig. 5, and accordingly, the shot image may be shot in real time, or may be a photo stored in the album.
202. The electronic equipment detects whether a user clicks the display interface, if yes, the selected area on the shot image is determined according to the clicking position of the clicking operation, and if not, the selected area on the shot image is determined to be empty.
For example, if three objects, namely stars, flowers and bags, exist in the shot image, the electronic device may automatically generate three boxes during the display process to prompt the user to select a single object, and at this time, the user may click on the desired object to select the object.
203. The electronic device identifies at least one photographic subject contained in the photographic image using the trained model.
For example, the trained model may be a CNN model. Referring to fig. 4, a user may click a designated key in a display interface, such as an "OK" key, to trigger a recognition operation of a trained model, and for a captured image with multiple objects, the CNN model may generate a recognition result for each object and a combination of all objects, such as a person name, a flower variety, a package brand, and a movie title when the captured image contains a person, a flower, and a package, and the captured image is a screenshot of a movie.
204. When the photographic subject is single, the electronic equipment takes the single photographic subject as a target photographic subject.
For example, when only a cup is in a captured image, the cup automatically defaults to the target subject.
205. When the shooting objects are multiple, the electronic equipment detects whether a selected area exists on the shot image, if so, the shooting object corresponding to the selected area is taken as a target shooting object, and if not, the shooting objects are taken as target shooting objects.
For example, for a shot image in which three shot objects including a person, a flower, and a bag exist, if the selected area is a human face, the subject person is the target shot object, and if the selected area is "empty", that is, if the user does not perform the selecting operation, the subject person, the flower, and the bag are the target shot object together, in this case, the shot image is usually a movie screenshot.
206. The electronic equipment acquires the type and the identification corresponding to the target shooting object and acquires at least one preset webpage application corresponding to the type.
For example, if the target object is a bag, the corresponding type may be "shoe bag", the corresponding identifier may be "crocodile bag", and the obtained preset web applications may include a shopping-type web application and an encyclopedic-type web application, wherein the shopping-type web application is mainly used for providing relevant purchase information of the "crocodile bag", and the encyclopedic-type web application is mainly used for introducing the "crocodile bag", such as historical origin, type, well-known brand and the like.
207. The electronic equipment displays the at least one preset webpage application to a user for selection by the user, and takes the preset webpage application selected by the user as a target webpage application.
For example, the electronic device may display all preset web applications corresponding to the "shoe bag" in a stacked manner, for example, a navigation page is displayed first, the navigation page includes two options of "shopping" and "encyclopedia", when the user selects the "shopping" option, application names such as "X treasure", "X cat", "wei-pin" and the like may appear, the application names may be displayed in a column according to the historical use habits of the user, the application with the larger browsing times of the user is more advanced in the display position of the column, and otherwise, the later, if the user clicks a certain application name, such as "wei-pin X", then the "wei-pin X" is the target web application.
208. And the electronic equipment generates an access instruction according to the identification and the target webpage application and sends the access instruction to the server.
209. The server starts the target webpage application according to the access instruction, acquires page data corresponding to the identification through a preset interface of the target webpage application, and then sends the page data to the electronic equipment.
For example, when the server receives an access instruction sent by the electronic device, it first checks whether the application program "item only X" is locally in an operating state, and if so, the server may directly obtain a related merchant page corresponding to the "crocodile package" through the item purchase search portal, and then return the merchant page to the electronic device.
210. The electronic device receives and displays the page data to access the target web application.
For example, when the electronic device receives a merchant page returned by the server, the display size of the electronic device is automatically adjusted according to the size of the display screen of the electronic device, so that the merchant page is displayed in an appropriate display size.
As can be seen from the above description, the access method for web applications provided in this embodiment is applied to an electronic device and a server, where the electronic device displays a captured image on a display interface, and detects whether a click operation is performed on the display interface by a user, if so, determines a selected area on the captured image according to a click position of the click operation, if not, the selected area indicates a null, then identifies at least one captured object included in the captured image by using a trained model, if the captured object is a single object, the electronic device regards the single object as a target object, if there are multiple objects, the electronic device detects whether there are selected areas on the captured image, if so, regards an object corresponding to the selected area as a target object, if not, regards the multiple objects as target objects, then, obtaining a type and an identification corresponding to the target shooting object, obtaining at least one preset webpage application corresponding to the type, then displaying the at least one preset webpage application to a user for selection by the user, taking the preset webpage application selected by the user as a target webpage application, then generating an access instruction according to the identification and the target webpage application, and sending the access instruction to a server, wherein the server can start the target webpage application according to the access instruction, obtain page data corresponding to the identification through a preset interface of the target webpage application, then send the page data to the electronic equipment, and finally the electronic equipment receives and displays the page data to access the target webpage application, so that the electronic equipment can directly enter related webpage applications through shooting without entering through a webpage application interface, the method is simple, the webpage application access efficiency is high, the electronic equipment does not need to install the webpage application locally, a large amount of occupied storage space is avoided, the use performance of the electronic equipment is improved, and the user experience is good.
According to the method described in the foregoing embodiment, the embodiment will be further described from the perspective of an access device of a web application, which may be specifically implemented as an independent entity, or may be implemented by being integrated in an electronic device, such as a terminal, where the terminal may include a mobile phone, a tablet computer, a personal computer, and the like.
Referring to fig. 6, fig. 6 specifically describes an access apparatus for a web application provided in the embodiment of the present application, which is applied to an electronic device, and the access apparatus for the web application may include: the device comprises an acquisition module 10, a determination module 20, a generation module 30 and a display module 40, wherein:
(1) acquisition module 10
And the acquisition module 10 is used for acquiring the type and the identification of the target shooting object in the shot image.
In this embodiment, the shot image may be shot in real time or may be stored in an album. The target photographic subject may be a person or an object, and the type and the identification may be set by a person, wherein the type may include clothing, food, articles, movies, people, animals, and the like, the identification is mainly used for identifying different photographic subjects, and may be names of photographic subjects, such as a teacup, a coat, a golden hair (dog), a giardian (singer), "you from stars" (drama name), and the like, each type may correspond to a plurality of identifications, and each identification corresponds to one photographic subject.
For example, referring to fig. 7, the obtaining module 10 may specifically include an identifying submodule 11, a determining submodule 12, and an obtaining submodule 13, where:
and the recognition sub-module 11 is used for recognizing at least one shooting object contained in the shooting image by using the trained model.
In this embodiment, the trained model may be a CNN (Convolutional Neural Network) model, which is a deep Neural Network model for processing large images. When the CNN model is trained, a large number of sample pictures may be collected, the sample pictures may be downloaded in batch from a background database of each web application (e.g., shopping application), at this time, the identifiers corresponding to the sample pictures may also be directly obtained, of course, the sample pictures may also be obtained through other approaches, such as pictures in a user album, at this time, the identifiers corresponding to the sample pictures may be manually labeled.
A determination sub-module 12 for determining a target photographic subject from the at least one photographic subject.
For example, the determination submodule 12 may be specifically configured to:
when the photographic subject is single, taking the single photographic subject as a target photographic subject;
and when a plurality of shooting objects exist, detecting whether a selected area exists on the shooting image, if so, taking the shooting object corresponding to the selected area as a target shooting object, and if not, taking the plurality of shooting objects as the target shooting objects.
In this embodiment, since the display window of the electronic device can only display a single network page under normal conditions, there is usually only one target photographic object, such as a movie star in a promotion poster, and when there are multiple target photographic objects, such as all movie stars in a promotion poster, it usually represents that the photographic image is a screenshot of a movie and television work.
It will be readily appreciated that the selected area is typically formed by a manual operation by the user, i.e. referring to fig. 8, the access device may further comprise a selection module 50 for:
displaying the photographed image in a display interface before the determination sub-module 12 detects whether the selected area exists on the photographed image;
acquiring the click operation of the user on the display interface;
and determining a selected area on the shot image according to the clicking position of the clicking operation.
In this embodiment, the display interface may be a preview interface during the shooting process, or may be an interface entered through a designated interface when browsing photos in an album, depending on whether the shot image is shot in real time or stored. In a period of time when the shot image is displayed, a user can superpose a frame selection frame on the shot image through clicking or touching and other operations, and the area in the frame selection frame is the selected area. The shape and size of the frame may be set in advance by a person, and the position of the frame on the captured image depends on the click position, for example, the click position may be set as the center point position of the frame.
And the obtaining submodule 13 is configured to obtain a type and an identifier corresponding to the target shooting object.
In this embodiment, when the target photographic object is a single object, the corresponding type and identifier may be directly matched in the library, for example, the type is a person, and the identifier is "michael". When there are a plurality of target photographic objects, it is necessary to acquire the type and the identification of the plurality of target photographic objects as a whole, in this case, the acquired type is usually a movie, and the identification is the name of the movie.
(2) Determination module 20
And a determining module 20, configured to determine the target web application according to the type.
For example, the determining module 20 may be specifically configured to:
acquiring at least one preset webpage application corresponding to the type;
displaying the at least one preset webpage application to a user for selection;
and taking the preset webpage application selected by the user as a target webpage application.
In this embodiment, the preset web applications should be associated in advance, each type may be associated with a single or multiple preset web applications, for example, the type "teacup" may be associated with encyclopedic web applications and shopping web applications, the type "movie" may be associated with video web applications and electronic book web applications, and the like, and each type of web application may also have multiple selections.
It should be noted that, in the process of displaying the preset web application to the user by the determining module 20, the display duration may be determined according to the number of the preset web applications, for example, if the preset web application is a single preset web application, since there is no other candidate application, the user may not need to perform a selection operation, so that the display time may be set to be very short, for example, after 1s, the user may automatically default that the only preset web application has been selected as the target web application by the user, and if there are multiple preset web applications and there are preset web applications of the same category, in order to make the display concise and orderly, a navigation interface may be displayed first, on the navigation interface, a category tag corresponding to the preset web application, such as category tags of encyclopedic, shopping, and the like, may be displayed, and the user may enter the selection interface of the specific preset web application by clicking the category tag, thereby avoiding that the display is disordered due to the excessive number of the preset web applications, the hierarchical structure is clear.
(3 Generation Module 30
And the generating module 30 is configured to generate an access instruction according to the identifier and the target web application, and send the access instruction to a server, where the access instruction is used to instruct the server to start the target web application, and obtain and return page data corresponding to the identifier through a preset interface of the target web application.
In this embodiment, the preset interface may be set manually, for example, it may be an item purchase search entry, an encyclopedia search entry, a video play entry, or the like. The webpage application needs to be accessed on the premise of installation and operation, the installation package is stored in the server but not the user equipment, so when the server receives an access instruction of a certain webpage application, whether the webpage application is in an operation state locally in the server needs to be confirmed, if yes, the webpage data corresponding to the identification, such as a related purchase page of a teacup, can be accessed by directly utilizing a preset interface of the operated webpage application, the accessed webpage data are sent to the electronic equipment, if not, the webpage application needs to be started firstly, then the webpage access can be carried out through the started webpage application, and the starting operation can be realized in a sandbox environment.
(4) Display module 40
And the display module 40 is used for receiving and displaying the page data returned by the server so as to access the target webpage application.
In this embodiment, for the page data received by the server, the display module 40 may adjust the page display size according to the size of the display screen of the display module to perform display, and certainly, in the display process, the user may also enlarge and reduce the displayed page by controlling the distance between the two fingers.
In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.
As can be seen from the above, the method for accessing a web application provided by this embodiment is applied to an electronic device, the type and identification of the target photographic subject in the photographed image are acquired by the acquisition module 10, the determination module 20 determines the target web application according to the type, the generating module 30 then generates an access instruction according to the identifier and the target web application, and sends the access instruction to the server, the access instruction is used to instruct the server to start the target web application, and to obtain the page data corresponding to the identifier through the preset interface of the target web application for returning, and then the display module 40 receives and displays the page data returned by the server to access the target web application, therefore, related webpage applications can be directly accessed by photographing without accessing through a webpage application interface, the method is simple, the webpage application access efficiency is high, and the user experience is good.
In addition, the embodiment of the application also provides electronic equipment which can be equipment such as a smart phone and a tablet computer. As shown in fig. 9, the electronic device 900 includes a processor 901, a memory 902, a display 903, and a control circuit 904. The processor 901 is electrically connected to the memory 902, the display 903, and the control circuit 904.
The processor 901 is a control center of the electronic device 900, connects various parts of the whole electronic device by using various interfaces and lines, executes various functions of the electronic device and processes data by running or loading an application program stored in the memory 902 and calling the data stored in the memory 902, thereby performing overall monitoring of the electronic device.
In this embodiment, the processor 901 in the electronic device 900 loads instructions corresponding to processes of one or more application programs into the memory 902 according to the following steps, and the processor 901 runs the application programs stored in the memory 902, so as to implement various functions:
acquiring the type and the identification of a target shooting object in a shot image;
determining a target webpage application according to the type;
generating an access instruction according to the identifier and the target webpage application, and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application, and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return;
and receiving and displaying the page data returned by the server to access the target webpage application.
Memory 902 may be used to store applications and data. The memory 902 stores applications containing instructions executable in the processor. The application programs may constitute various functional modules. The processor 901 executes various functional applications and data processing by running an application program stored in the memory 902.
The display 903 may be used to display information input by or provided to the user as well as various graphical user interfaces of the terminal, which may be comprised of images, text, icons, video, and any combination thereof.
The control circuit 904 is electrically connected to the display 903, and is configured to control the display 903 to display information.
In some embodiments, as shown in fig. 9, the electronic device 900 further comprises: a radio frequency circuit 905, an input unit 906, an audio circuit 907, a sensor 908, and a power supply 909. The processor 901 is electrically connected to the rf circuit 905, the input unit 906, the audio circuit 907, the sensor 908, and the power source 909.
The radio frequency circuit 905 is configured to receive and transmit radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and receive and transmit signals with the network device or other electronic devices.
The input unit 906 may be used to receive input numbers, character information, or user characteristic information (e.g., a fingerprint), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. The input unit 906 may include a fingerprint recognition module.
The audio circuit 907 may provide an audio interface between the user and the terminal through a speaker, microphone, or the like.
The electronic device 900 may also include at least one sensor 908, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or the backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.
The power supply 909 is used to supply power to the various components of the electronic device 900. In some embodiments, the power source 909 may be logically connected to the processor 901 through a power management system, so that functions of managing charging, discharging, and power consumption management are realized through the power management system.
Although not shown in fig. 9, the electronic device 900 may further include a camera, a bluetooth module, etc., which are not described in detail herein.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor. To this end, the present invention provides a storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a processor to execute the steps in the method for accessing a web application according to any one of the embodiments of the present invention.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium may execute the steps in any of the methods for accessing a web application provided by the embodiments of the present invention, beneficial effects that can be achieved by any of the methods for accessing a web application provided by the embodiments of the present invention may be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
In summary, although the present application has been described with reference to the preferred embodiments, the above-described preferred embodiments are not intended to limit the present application, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application, so that the scope of the present application shall be determined by the appended claims.

Claims (4)

1. An access method of a web application is applied to an electronic device, and is characterized by comprising the following steps:
identifying at least one shooting object contained in a shooting image by using a trained model, wherein the shooting object is a real object, and determining a target shooting object from the at least one shooting object, wherein when the shooting object is single, the single shooting object is used as the target shooting object; when a plurality of shooting objects exist, detecting whether a selected area exists on the shooting image, if so, taking the shooting object corresponding to the selected area as a target shooting object, and if not, taking the plurality of shooting objects as target shooting objects; the selected area is formed by manual operation of a user, the shot image is displayed in a display interface before whether the selected area exists on the shot image is detected, the clicking operation of the user on the display interface is obtained, and the selected area on the shot image is determined according to the clicking position of the clicking operation;
acquiring the type and the identification of a target shooting object in a shooting image, wherein the type is used for corresponding to a plurality of identifications, and the identification is used for corresponding to one shooting object;
determining a target webpage application according to the type, wherein at least one preset webpage application corresponding to the type is acquired, at least one preset webpage application is displayed for a user to select, if a plurality of preset webpage applications exist and the preset webpage applications of the same type exist, a navigation interface is displayed, category labels corresponding to the preset webpage applications are displayed on the navigation interface, when the category labels are clicked by the user, a selection interface of the corresponding preset webpage application is entered, and the preset webpage application selected by the user in the selection interface is used as the target webpage application;
generating an access instruction according to the identifier and the target webpage application, and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application, and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return;
and receiving and displaying page data returned by the server to access the target webpage application.
2. An access device for a web application, applied to an electronic device, comprising:
the acquisition module is used for identifying at least one shooting object contained in a shooting image by using a trained model, wherein the shooting object is a real object, and a target shooting object is determined from the at least one shooting object, and when the shooting object is single, the single shooting object is used as the target shooting object; when a plurality of shot objects exist, detecting whether a selected area exists on the shot image, if so, taking the shot object corresponding to the selected area as a target shot object, if not, taking the plurality of shot objects as the target shot object, wherein the selected area is formed by manual operation of a user, before detecting whether the selected area exists on the shot image, displaying the shot image in a display interface, acquiring click operation of the user on the display interface, determining the selected area on the shot image according to the click position of the click operation, and further acquiring the type and the identification of the target shot object in the shot image, wherein the type is used for corresponding to a plurality of identifications, and the identification is used for corresponding to one shot object;
the determining module is used for determining a target webpage application according to the type, acquiring at least one preset webpage application corresponding to the type, displaying the at least one preset webpage application to a user for selection, displaying a navigation interface if the preset webpage applications are multiple and the preset webpage applications of the same type exist, displaying category labels corresponding to the multiple preset webpage applications on the navigation interface, entering a selection interface of the corresponding preset webpage application when the category labels are clicked by the user, and taking the preset webpage application selected by the user in the selection interface as the target webpage application;
the generating module is used for generating an access instruction according to the identifier and the target webpage application and sending the access instruction to a server, wherein the access instruction is used for indicating the server to start the target webpage application and acquiring page data corresponding to the identifier through a preset interface of the target webpage application to return;
and the display module is used for receiving and displaying the page data returned by the server so as to access the target webpage application.
3. A storage medium having stored therein a plurality of instructions adapted to be loaded by a processor to perform the method of accessing a web application of claim 1.
4. An electronic device comprising a processor and a memory, the processor being electrically connected to the memory, the memory being configured to store instructions and data, the processor being configured to perform the steps of the method for accessing a web application according to claim 1.
CN201810150792.9A 2018-02-13 2018-02-13 Webpage application access method and device, storage medium and electronic equipment Expired - Fee Related CN108287919B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810150792.9A CN108287919B (en) 2018-02-13 2018-02-13 Webpage application access method and device, storage medium and electronic equipment
PCT/CN2018/125029 WO2019157870A1 (en) 2018-02-13 2018-12-28 Method and device for accessing webpage application, storage medium, and electronic apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810150792.9A CN108287919B (en) 2018-02-13 2018-02-13 Webpage application access method and device, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN108287919A CN108287919A (en) 2018-07-17
CN108287919B true CN108287919B (en) 2020-05-12

Family

ID=62832777

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810150792.9A Expired - Fee Related CN108287919B (en) 2018-02-13 2018-02-13 Webpage application access method and device, storage medium and electronic equipment

Country Status (2)

Country Link
CN (1) CN108287919B (en)
WO (1) WO2019157870A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108287919B (en) * 2018-02-13 2020-05-12 Oppo广东移动通信有限公司 Webpage application access method and device, storage medium and electronic equipment
CN109151022B (en) * 2018-08-21 2022-06-14 平安科技(深圳)有限公司 Calling method and device of webpage console, computer equipment and storage medium
CN109461041A (en) * 2018-09-05 2019-03-12 西安艾润物联网技术服务有限责任公司 Information-pushing method and relevant device
CN109918591A (en) * 2019-03-01 2019-06-21 北京猎户星空科技有限公司 Using adding method, device, electronic equipment and storage medium
CN111462281B (en) * 2020-03-31 2023-06-13 北京创鑫旅程网络技术有限公司 Poster generation method, device, equipment and storage medium
CN111783762A (en) * 2020-06-30 2020-10-16 联想(北京)有限公司 Processing method and device
CN114912058A (en) * 2022-06-27 2022-08-16 中银金融科技有限公司 Page rendering method and related equipment for bank customer full-time investigation system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101770498A (en) * 2009-01-05 2010-07-07 李铭 Step searching method
CN102200971A (en) * 2010-03-22 2011-09-28 腾讯科技(深圳)有限公司 Method and equipment for realizing webpage content previewing
CN102262638A (en) * 2010-05-31 2011-11-30 国际商业机器公司 Method and device for indexing picture
CN107590267A (en) * 2017-09-22 2018-01-16 珠海市魅族科技有限公司 Information-pushing method and device, terminal and readable storage medium storing program for executing based on picture

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003036212A (en) * 2001-07-23 2003-02-07 Funai Electric Co Ltd Personal digital assistant with camera function
CN102855273A (en) * 2012-07-16 2013-01-02 宇龙计算机通信科技(深圳)有限公司 Terminal and information acquisition method
US20150310300A1 (en) * 2014-04-28 2015-10-29 Distiller, Llc System and method for multiple object recognition and personalized recommendations
CN117390330A (en) * 2017-05-27 2024-01-12 北京小米移动软件有限公司 Webpage access method and device
CN108287919B (en) * 2018-02-13 2020-05-12 Oppo广东移动通信有限公司 Webpage application access method and device, storage medium and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101770498A (en) * 2009-01-05 2010-07-07 李铭 Step searching method
CN102200971A (en) * 2010-03-22 2011-09-28 腾讯科技(深圳)有限公司 Method and equipment for realizing webpage content previewing
CN102262638A (en) * 2010-05-31 2011-11-30 国际商业机器公司 Method and device for indexing picture
CN107590267A (en) * 2017-09-22 2018-01-16 珠海市魅族科技有限公司 Information-pushing method and device, terminal and readable storage medium storing program for executing based on picture

Also Published As

Publication number Publication date
WO2019157870A1 (en) 2019-08-22
CN108287919A (en) 2018-07-17

Similar Documents

Publication Publication Date Title
CN108287919B (en) Webpage application access method and device, storage medium and electronic equipment
US11630861B2 (en) Method and apparatus for video searching, terminal and storage medium
US10038839B2 (en) Assisted text input for computing devices
GB2589506A (en) Method and apparatus for selecting background music for video capture, terminal device, and medium
CN107943547B (en) Multi-service integration method and device, intelligent terminal, server and operating system
KR101143606B1 (en) System, user terminal unit and method for guiding display information using mobile device
JP7104242B2 (en) Methods for sharing personal information, devices, terminal equipment and storage media
CN111966275B (en) Program trial method, system, device, equipment and medium
US10440435B1 (en) Performing searches while viewing video content
CN104133844A (en) Method and device for loading webpage
CN107229711A (en) Webpage display process and device
JP6949059B2 (en) How to display dynamic lists, devices, devices and systems
JP6046874B1 (en) Information processing apparatus, information processing method, and program
US11297225B2 (en) Video producing method, apparatus, storage medium, and electronic device
CN107622074A (en) A kind of data processing method, device and computing device
KR20170013369A (en) Method, apparatus and computer program for displaying serch information
CN108363793B (en) Webpage application access method and device, storage medium and electronic equipment
US20230034462A1 (en) Display control method and apparatus for virtual item, and display method and apparatus for virtual item
CN111310086A (en) Page jump method and device and electronic equipment
CN107862728B (en) Picture label adding method and device and computer readable storage medium
CN115311051A (en) Page display method, equipment and storage medium for house with view
CN113821145A (en) Page processing method, device and medium
CN113721816A (en) Video processing method and device
CN114816180A (en) Content browsing guiding method and device, electronic equipment and storage medium
KR101701952B1 (en) Method, apparatus and computer program for displaying serch information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200512

CF01 Termination of patent right due to non-payment of annual fee