CN109033346B - Method, device, storage medium and terminal equipment for three-dimensional content presentation - Google Patents
Method, device, storage medium and terminal equipment for three-dimensional content presentation Download PDFInfo
- Publication number
- CN109033346B CN109033346B CN201810822037.0A CN201810822037A CN109033346B CN 109033346 B CN109033346 B CN 109033346B CN 201810822037 A CN201810822037 A CN 201810822037A CN 109033346 B CN109033346 B CN 109033346B
- Authority
- CN
- China
- Prior art keywords
- picture
- dimensional content
- dimensional
- request
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000012549 training Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 3
- 208000025174 PANDAS Diseases 0.000 description 23
- 208000021155 Paediatric autoimmune neuropsychiatric disorders associated with streptococcal infection Diseases 0.000 description 23
- 240000004718 Panda Species 0.000 description 23
- 235000016496 Panda oleosa Nutrition 0.000 description 23
- 230000015654 memory Effects 0.000 description 23
- 238000004891 communication Methods 0.000 description 13
- 235000017166 Bambusa arundinacea Nutrition 0.000 description 12
- 235000017491 Bambusa tulda Nutrition 0.000 description 12
- 241001330002 Bambuseae Species 0.000 description 12
- 235000015334 Phyllostachys viridis Nutrition 0.000 description 12
- 239000011425 bamboo Substances 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 241001465754 Metazoa Species 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 230000036316 preload Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a method, a device, a storage medium and terminal equipment for presenting three-dimensional content, wherein the method comprises the following steps: under the condition that a request of a three-dimensional content viewing control of a picture on a current page is detected, acquiring the picture on the current page requested to be viewed; sending the picture to a server through a three-dimensional content viewing request, so that the server can retrieve related three-dimensional content by using the picture; receiving three-dimensional content related to the picture returned by the server; and displaying the three-dimensional content related to the picture. By adopting the method and the device, the three-dimensional content related to the picture can be retrieved by utilizing the picture in real time and presented in the page, and the efficiency is high.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, a storage medium, and a terminal device for three-dimensional content presentation.
Background
With the development of internet technology, 3D (3D) content-based search scenes are increasing. Typically, a picture may be displayed in a page of the terminal device. In the case that the user needs to present the three-dimensional image scene in this page, the user can click on the picture and then present the three-dimensional image scene corresponding to the picture. The image and the three-dimensional image scene are pre-associated, generally in one-to-one correspondence, and the three-dimensional image scene needs to be pre-loaded in the page. Thus, when a user requests to present a three-dimensional image scene in a page, the preloaded three-dimensional image scene can be directly presented.
However, the above solution has the following drawbacks: for each picture, the editors need to pre-associate the pictures with the three-dimensional image scenes one by one, and pre-load the three-dimensional image scenes in the page, which is inefficient.
Disclosure of Invention
The embodiment of the invention provides a method and device for presenting three-dimensional content, a storage medium and terminal equipment, which are used for solving or relieving one or more of the technical problems in the prior art.
In a first aspect, an embodiment of the present invention provides a method for presenting three-dimensional content, including:
under the condition that the operation of a three-dimensional content viewing control on a current page is detected, acquiring a picture corresponding to the three-dimensional content viewing control;
sending the picture to a server through a three-dimensional content viewing request, so that the server can retrieve related three-dimensional content by using the picture;
receiving three-dimensional content which is returned by the server and is related to the picture; and
and displaying the three-dimensional content related to the picture.
With reference to the first aspect, in a first implementation manner of the first aspect, the method further includes:
and displaying the picture on the current page, and displaying the three-dimensional content viewing control on the picture.
With reference to the first implementation manner of the first aspect, in a second implementation manner of the first aspect, displaying the three-dimensional content viewing control on the picture includes:
scanning a picture in the current page when the current page is in a display state; and
and adding the three-dimensional content viewing control in the picture when the display size of the picture meets the preset picture size standard.
In a second aspect, an embodiment of the present invention provides a method for presenting three-dimensional content, including:
receiving a three-dimensional content viewing request from a request end, wherein the three-dimensional content viewing request comprises a picture requested to be viewed;
retrieving three-dimensional content related to the picture using the picture; and
and sending the three-dimensional content related to the picture to the request terminal so as to display the three-dimensional content related to the picture on the request terminal.
With reference to the second aspect, in a first implementation manner of the second aspect, retrieving, with the picture, three-dimensional content related to the picture includes:
performing content recognition on the picture by using a picture recognition service model to obtain text retrieval words and sentences; and
three-dimensional content associated with the text retrieval word and sentence is retrieved from a three-dimensional content database.
With reference to the first implementation manner of the first aspect, in a second implementation manner of the second aspect, the method further includes:
acquiring training data of the graph recognition service model; wherein the training data comprises a sample picture and a text description of the sample picture; and
and training the graph recognition service model according to the training data.
In a third aspect, an embodiment of the present invention provides an apparatus for three-dimensional content presentation, including:
the image acquisition module is used for acquiring an image corresponding to the three-dimensional content viewing control under the condition that the operation of the three-dimensional content viewing control on the current page is detected;
the picture sending module is used for sending the picture to the server through a three-dimensional content viewing request so that the server can retrieve related three-dimensional content by using the picture;
the three-dimensional content receiving module is used for returning three-dimensional content which is related to the picture and is returned by the server; and
and the three-dimensional content display module is used for displaying the three-dimensional content related to the picture.
With reference to the third aspect, in a first implementation manner of the third aspect, the apparatus further includes:
and the picture control display module is used for displaying the picture on the current page and displaying the three-dimensional content viewing control on the picture.
With reference to the first implementation manner of the third aspect, in a second implementation manner of the third aspect, the picture control display module includes:
the picture scanning unit is used for scanning pictures in the current page when the current page is in a display state; and
and the control display unit is used for adding the three-dimensional content viewing control in the picture when the display size of the picture meets the preset picture size standard.
In a fourth aspect, an embodiment of the present invention provides an apparatus for three-dimensional content presentation, including:
the request receiving module is used for receiving a three-dimensional content viewing request from the request end, wherein the three-dimensional content viewing request comprises a picture requested to be viewed;
the three-dimensional content retrieval module is used for retrieving three-dimensional content related to the picture by using the picture; and
and the three-dimensional content sending module is used for sending the three-dimensional content related to the picture to the request terminal so as to display the three-dimensional content related to the picture on the request terminal.
With reference to the fourth aspect, in a first implementation manner of the fourth aspect, the three-dimensional content retrieval module includes:
the picture identification unit is used for carrying out content identification on the picture by utilizing a picture identification service model to obtain text retrieval words and sentences; and
and the retrieval unit is used for retrieving the three-dimensional content related to the text retrieval words and sentences from the three-dimensional content database.
The functions of the device can be realized by hardware, and also can be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.
In one possible design, the structure of the three-dimensional content presentation includes a processor and a memory, where the apparatus for three-dimensional content presentation executes the program for three-dimensional content presentation in the first aspect or the second aspect, and the processor is configured to execute the program stored in the memory. The means for three-dimensional content presentation may further comprise a communication interface for communication with other devices or communication networks.
In a third aspect, embodiments of the present invention also provide a computer readable storage medium comprising computer software instructions for use in an apparatus for three-dimensional content presentation, including a program for performing the method of three-dimensional content presentation of the first or second aspects described above.
One of the above technical solutions has the following advantages or beneficial effects:
according to the embodiment of the invention, the three-dimensional content viewing control is arranged on the picture of the current page, and when the request for the three-dimensional content viewing control is detected, the picture of the current page requested to be viewed is acquired. And then, sending the picture to the server, wherein the server can retrieve the three-dimensional content related to the picture by using the acquired picture and return the three-dimensional content related to the picture to the request terminal, and the request terminal displays the three-dimensional content related to the picture. Therefore, the mode of searching the three-dimensional content related to the picture through the picture does not need to be related to the three-dimensional content one by one in advance, and the applicability is wide. And three-dimensional content related to the picture can be retrieved in real time, so that the efficiency is high.
One of the above technical solutions has the following advantages or beneficial effects:
the embodiment of the invention can be applied to the third-party website, and when the page of the third-party website is opened, the pictures in the page can be scanned. When the display size of the picture meets the preset picture size standard, a three-dimensional content viewing control can be added in the picture. At this time, when the requester clicks or touches the three-dimensional content viewing control, the corresponding picture may be sent to the server to perform the three-dimensional content retrieval. And when receiving the three-dimensional content returned by the server, presenting the three-dimensional content in the page. Therefore, the embodiment of the invention can provide an access method for three-dimensional content presentation for the third-party website, greatly improve the propagation speed of the three-dimensional content and bring more friendly experience for users.
The foregoing summary is for the purpose of the specification only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features of the present invention will become apparent by reference to the drawings and the following detailed description.
Drawings
In the drawings, the same reference numerals refer to the same or similar parts or elements throughout the several views unless otherwise specified. The figures are not necessarily drawn to scale. It is appreciated that these drawings depict only some embodiments according to the disclosure and are not therefore to be considered limiting of its scope.
FIG. 1 is a flow diagram of one embodiment of a method of three-dimensional content presentation provided by the present invention;
FIG. 2 is a schematic diagram of one embodiment of a display process for displaying a three-dimensional content viewing control over a picture provided by the present invention;
FIG. 3 is a flow diagram of another embodiment of a method of three-dimensional content presentation provided by the present invention;
FIG. 4 is a flow diagram of one embodiment of a retrieval process for retrieving related three-dimensional content provided by the present invention;
FIGS. 5 and 6 are diagrams of examples of applications for three-dimensional content presentation provided by the present invention;
FIG. 7 is a schematic diagram illustrating the structure of one embodiment of an apparatus for three-dimensional content presentation provided by the present invention;
FIG. 8 is a schematic diagram of another embodiment of an apparatus for three-dimensional content presentation provided by the present invention;
fig. 9 is a schematic structural diagram of an embodiment of a terminal device provided by the present invention.
Detailed Description
Hereinafter, only certain exemplary embodiments are briefly described. As will be recognized by those of skill in the pertinent art, the described embodiments may be modified in various different ways without departing from the spirit or scope of the present invention. Accordingly, the drawings and description are to be regarded as illustrative in nature and not as restrictive.
Referring to fig. 1, an embodiment of the present invention provides a method for presenting three-dimensional content, which can be applied to a terminal device (i.e., a request end). The terminal device may include, but is not limited to, a smart phone, tablet, computer, smart watch, large educational tablet, and the like. The present embodiment includes steps S100 to S400, which are specifically as follows:
s100, under the condition that the operation of the three-dimensional content viewing control on the current page is detected, obtaining a picture corresponding to the three-dimensional content viewing control.
In this embodiment, the current page may include one page presented by the application in the display interface. For example, open a web page in a browser, open a sales page in an online store, etc. The online store may include a panning, a jingdong, a snow storm game sales, etc. The pictures may include two-dimensional pictures of people, objects, attractions, etc. The three-dimensional content viewing control may be disposed in an area in the picture, such as an upper left corner, an upper right corner, a lower left corner, a lower right corner, or an edge area, etc. The three-dimensional content viewing control may be displayed in a highlighting color, such as red, yellow, etc., or may be bolded in fonts, or may be displayed in a picture with a special icon. In one specific example, a red highlighted tile including the font "enter 3D" is used as a three-dimensional content viewing control. The three-dimensional content viewing control may be a virtual control or an embedded control. For example, if an embedded control is set for a picture meeting the requirement or any one of the pages, the embedded control is not displayed on the interface, and when a preset operation is detected to be performed on the picture, the picture can be acquired to display three-dimensional content. This preset operation may include any of clicking, double clicking, long pressing, sliding left or right, sliding up or down, etc.
Optionally, the operating conditions of the control may include: the requestor triggers the three-dimensional content viewing control through a mouse or a shortcut key, the requestor touches the three-dimensional content viewing control through touch of a stylus or a limb, and the like.
In this embodiment, when an operation on the control is detected, the picture requested to be viewed may be a picture including the control on the current page. For example, if the three-dimensional content viewing control a is displayed in the picture a, when the three-dimensional content viewing control a is clicked or touched, the picture requested to be viewed at this time is the picture a. For another example, if the three-dimensional content viewing control a is embedded in the picture a, when the requester performs a preset operation on the picture a, the picture requested to be viewed is the picture a.
And S200, sending the acquired picture to the server through the three-dimensional content viewing request, so that the server can retrieve the three-dimensional content related to the picture by utilizing the acquired picture.
In an embodiment, the three-dimensional content viewing request may be generated by a network protocol between the request end and the service end, where the three-dimensional content viewing request includes a picture requested to be viewed, that is, a picture acquired in step S100. The request end sends the three-dimensional content viewing request to the server end, and the acquired picture can be sent to the server end.
In this embodiment, the server may include a terminal device such as a server or a computer. The service end mainly provides service for the request end, and can provide picture identification, retrieval service for three-dimensional content according to pictures and the like.
S300, receiving three-dimensional content which is returned by the server and is related to the picture.
In the present embodiment, the three-dimensional content may include a three-dimensional model and description information describing the three-dimensional model. Three-dimensional models primarily refer to body models such as characters, animals, objects, buildings, environments, etc. The description information may include names of the three-dimensional models, brief contents of the three-dimensional models, and the like. Illustratively, if the three-dimensional model is a panda model, the name may be: "pandas" and brief introduction may be "pandas is a protective animal".
And S400, displaying the three-dimensional content related to the picture.
In this embodiment, the three-dimensional content may further include science popularization information of the three-dimensional model. When three-dimensional content is presented at the requesting end, the requester may interface with the three-dimensional model through related actions such as movement, rotation, scaling, and the like. Through the three-dimensional presentation of the three-dimensional model and the display of science popularization information of the three-dimensional model, a requester can more comprehensively know the content on the original picture.
In this embodiment, a tag script may be introduced into the third-party website, where the tag script may implement the method provided in this embodiment. For example, if a web page is opened in the browser and a tag script is added to the website where the web page is located, the requestor may click on the three-dimensional content viewing control of the picture in the web page to render the three-dimensional content. For another example, if a sales page is opened in an online store where a tag script is added, the requestor may click on a three-dimensional content view control of the pictures in the sales page to render the three-dimensional content.
In a possible implementation manner, the method provided by the embodiment of the invention further includes: and displaying the picture on the current page, and displaying the three-dimensional content viewing control on the picture.
In this embodiment, when displaying a page or displaying a picture in a page, the tag script may control the picture on the page to display a three-dimensional content viewing control. The display position of the three-dimensional content viewing control in the picture may also be selected.
In one possible implementation, as shown in fig. 2, the present embodiment may display a three-dimensional content viewing control on a picture, where the display process includes steps S510 and S520, as follows:
s510, scanning the picture in the current page when the current page is in a display state.
Illustratively, taking a web page opened by a requester as an example, if the web page cannot be displayed in the display interface of the terminal device at one time, the web page may include a plurality of pages, for example, pages 1 to 5. When the requester opens the first page, i.e. scans the picture of the first page; when the requestor opens the second page, i.e., scans the second-side graph, and so on.
And S520, adding a three-dimensional content viewing control in the picture when the display size of the picture meets the preset picture size standard.
In this embodiment, the size of the picture may include the area, length and width, diameter, size of the pixel or the picture file, and the size of the picture in the display page may be measured. For example, taking a picture size standard as an example that the size of a picture file is within 100kb, when the picture of a display page is greater than 100kb, a three-dimensional content viewing control may be added to this picture of the display page.
Referring to fig. 3, an embodiment of the present invention provides a method for presenting three-dimensional content, which can be applied to a server (i.e., a server side). The server may comprise a computer, microcomputer, etc. for providing three-dimensional content retrieval services to the requesting end. The present embodiment includes steps S600 to S800, which are specifically as follows:
s600, receiving a three-dimensional content viewing request from a request end, wherein the three-dimensional content viewing request comprises a picture on a current page of the request end requesting to view.
In this embodiment, the server may filter out the request that cannot identify the picture, for example, a picture with unclear picture or too low picture pixel. Requests for which the picture content is unsatisfactory may also be filtered. For example, requests for picture content that are child resistant content may be filtered. The current page here is the page currently displayed by the requesting end.
And S700, retrieving three-dimensional content related to the picture by using the picture.
In this embodiment, the content of the picture may include a subject such as a person, an animal, an article, a building, or the like. For example, if the content of the photo is a scene showing one panda eating bamboo in a forest, the three-dimensional content related to the photo may include a three-dimensional model of the panda and profile information describing the panda, or a three-dimensional model of the bamboo and profile information describing the bamboo. That is, the retrieved three-dimensional content may describe one or more subjects of the picture.
S800, sending the three-dimensional content related to the picture to the request terminal so as to display the three-dimensional content related to the picture on the request terminal.
In this embodiment, when the three-dimensional content related to the picture cannot be retrieved, a prompt message without a retrieval result may be sent to the requesting end. The requesting end can prompt the requester that the three-dimensional content related to the picture requested to be checked cannot be displayed.
In this embodiment, the server may pre-establish an index relationship between the picture and the three-dimensional content, and when receiving the request, may perform picture matching according to the transferred picture content, and index to the three-dimensional content associated with the picture. In another possible implementation manner, referring to fig. 4, the above step S700 may identify the picture content to retrieve the related three-dimensional content, and the process includes the following steps S710 and S720:
s710, carrying out content recognition on the picture by using the picture recognition service model to obtain text retrieval words and sentences.
In embodiments of the present invention, the recognition service model may be built based on machine-learned models and picture recognition techniques, such as Variational Auto-encoders (VAEs). The text retrieval word and sentence may include words or sentences, for example, if the content of the picture is a scene in which one panda eats bamboo in a forest, and the content of the picture is identified using an identification service model, the identified text retrieval word and sentence may include one or more of panda, bamboo, or panda eats bamboo in the forest.
S720, retrieving three-dimensional content related to the text retrieval words and sentences from the three-dimensional content database.
For example, if the text retrieval word includes pandas, the three-dimensional content may include a three-dimensional model of pandas and profile information describing pandas. If the text retrieval word includes bamboo, the three-dimensional content may include a three-dimensional model of bamboo and profile information describing bamboo. If the text retrieval word and sentence includes that the panda eats bamboo in the forest, the three-dimensional content includes a three-dimensional model of the panda eating bamboo, a model of the forest, and descriptive information of the scene. Wherein the three-dimensional model of pandas eating bamboo is placed in the model of forest.
In the present embodiment, the text retrieval words and phrases may establish a many-to-one indexing relationship with the three-dimensional content, for example, { 'panda', } the text retrieval words and phrases may point to { the number of the three-dimensional content of panda }. Then, the three-dimensional content corresponding to the number is extracted according to the number.
In one possible implementation manner, the embodiment may further perform training update on the graph recognition service model, and the training process may include: firstly, training data of a picture-identifying service model is obtained; wherein the training data comprises a sample picture and a textual description of the sample picture. Then, the graph recognition service model is trained according to the training data.
In this embodiment, a training similarity threshold of the graph recognition service model may be set. Assuming that the sample picture a is input into the graph recognition service model, if the similarity between the text description output by the graph recognition service model and the text description of the input sample picture a meets the training similarity threshold, the iterative training of the model may be stopped. If the training similarity threshold is not met, training of the model needs to be continued.
Fig. 5 and fig. 6 are schematic diagrams of an application example of three-dimensional content presentation according to an embodiment of the present invention. The embodiment can realize the application scene of three-dimensional content search and presentation based on the Web technology and the picture recognition technology: when a user browses a page of a third-party website on a terminal device, a picture about pandas is seen in the current page, and a button (control) capable of viewing three-dimensional content is arranged on the picture, for example, a small square containing a font of 'enter 3D' in fig. 5. The user can click a button to trigger the terminal device to enter a relevant panda three-dimensional page, and corresponding three-dimensional (3D) content can be displayed for the user. The effect is shown in fig. 5.
Taking the application scenario as an example, as shown in fig. 6, a flowchart of an implementation method of the present embodiment, according to a flow sequence, a processing procedure may include:
1. and (5) a label script. The third party website imports the tag script. The tag script may scan the pictures in the page when the user opens the web page of the corresponding third-party website. The button of "view 3D content" is marked on the picture conforming to the picture size standard set by the third party. When the user touches or clicks a button for viewing 3D content on one picture, the tag script may send the picture content corresponding to the button to an API (Application Programming Interface ) of the server through a network protocol.
2. The content module is identified. The module is arranged at the service end. When the API of the server receives the corresponding network request, the picture content transmitted in the network request can be subjected to content identification through the picture identification service model, and the picture content is converted into a text search word. After the identification is successful, the text search word is transmitted to the next step.
The image recognition service model can be constructed through machine learning training and image recognition technology. And inputting the two-dimensional picture into an identification service module, and identifying the specific text description of the two-dimensional picture. For example, a photograph of a panda may be taken by the service module to obtain a textual description "panda". Machine learning is mainly to learn a large amount of sample training data to obtain a correlation relationship between a picture and a text, namely, to identify a service model.
3. 3D content is retrieved. When the text search term is transferred to the step, the server side uses the search service to search the corresponding 3D content in the 3D content library. And if the corresponding content is found, returning the retrieved 3D content to the tag script.
The server establishes a many-to-one index relation from various search words to the 3D content in the search service. For example, the search term { 'panda', } points to 3D content { the number of 3D content of panda }.
4. 3D content presentation. And when receiving the 3D content returned by the server, presenting the 3D content and related science popularization information to a user through a 3D content presentation page. The user can interact with the 3D model in the 3D content through related actions such as movement, rotation, scaling and the like, so as to learn more three-dimensional information. Wherein the 3D model may be drawn in a 3D content presentation page by webGL (Web Graphics Library, network graphics library). webGL is a 3D drawing protocol.
The embodiment can open a script which can be introduced for a third-party website by utilizing web technology. After the third-party website is accessed to the script, a small icon for three-dimensional content viewing appears on the picture with the set size when the user opens the third-party website in the terminal equipment. When the user clicks on this icon, the script interacts with the server that provides the search service. And sending the picture where the icon is positioned to a server, and identifying the content of the received picture on line by the server. If the search service result comprises a three-dimensional model related to the picture content, the interface of the terminal equipment jumps to a 3D content showing page provided by the server, and the 3D content showing page comprises the retrieved three-dimensional model.
Referring to fig. 7, an embodiment of the present invention provides an apparatus for three-dimensional content presentation, including:
the image acquisition module 100 is configured to acquire an image corresponding to a three-dimensional content viewing control on a current page when detecting an operation of the three-dimensional content viewing control;
the picture sending module 200 is configured to send the picture to a server through a three-dimensional content viewing request, so that the server retrieves related three-dimensional content by using the obtained picture;
the three-dimensional content receiving module 300 is configured to return, by the server, three-dimensional content related to the picture; and
and the three-dimensional content display module 400 is used for displaying the three-dimensional content related to the picture.
In one possible implementation, the apparatus further includes:
and the picture control display module is used for displaying the picture on the current page and displaying the three-dimensional content viewing control on the picture.
In one possible implementation manner, the picture control display module includes:
the picture scanning unit is used for scanning pictures in the current page when the current page is in a display state; and
and the control display unit is used for adding the three-dimensional content viewing control in the picture when the display size of the picture meets the preset picture size standard.
Referring to fig. 8, an embodiment of the present invention provides an apparatus for three-dimensional content presentation, including:
the request receiving module 600 is configured to receive a three-dimensional content viewing request from a request end, where the three-dimensional content viewing request includes a picture requested to be viewed;
a three-dimensional content retrieval module 700 for retrieving related three-dimensional content using the picture; and
the three-dimensional content sending module 800 is configured to send the three-dimensional content related to the picture to the request terminal, so as to display the three-dimensional content related to the picture on the request terminal.
In one possible implementation, the three-dimensional content retrieval module includes:
the picture identification unit is used for carrying out content identification on the picture by utilizing a picture identification service model to obtain text retrieval words and sentences; and
and the retrieval unit is used for retrieving the three-dimensional content related to the text retrieval words and sentences from the three-dimensional content database.
The functions of the device can be realized by hardware, and also can be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.
In one possible design, the structure of the three-dimensional content presentation includes a processor and a memory, the memory being used for executing the program of the three-dimensional content presentation by the device for three-dimensional content presentation, and the processor being configured to execute the program stored in the memory. The means for three-dimensional content presentation may further comprise a communication interface for communication with other devices or communication networks.
The embodiment of the invention also provides a terminal device, as shown in fig. 9, which comprises: memory 21 and processor 22, and memory 21 stores a computer program that is executable on processor 22. The processor 22, when executing the computer program, implements the method of intent matching in the above-described embodiments. The number of memories 21 and processors 22 may be one or more.
The apparatus further comprises:
a communication interface 23 for communication between the processor 22 and an external device.
The memory 21 may comprise a high-speed RAM memory or may further comprise a non-volatile memory (non-volatile memory), such as at least one disk memory.
If the memory 21, the processor 22 and the communication interface 23 are implemented independently, the memory 21, the processor 22 and the communication interface 23 may be connected to each other and perform communication with each other through a bus. The bus may be an industry standard architecture (ISA, industry Standard Architecture) bus, a peripheral component interconnect (PCI, peripheral Component) bus, or an extended industry standard architecture (EISA, extended Industry Standard Component) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, only one thick line is shown in fig. 9, but not only one bus or one type of bus.
Alternatively, in a specific implementation, if the memory 21, the processor 22 and the communication interface 23 are integrated on a chip, the memory 21, the processor 22 and the communication interface 23 may communicate with each other through internal interfaces.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The computer readable medium of the embodiments of the present invention may be a computer readable signal medium or a computer readable storage medium or any combination of the two. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include at least the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable read-only memory (CDROM). In addition, the computer-readable storage medium may even be paper or other suitable medium upon which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
In an embodiment of the invention, the computer readable signal medium may comprise a data signal propagated in baseband or as part of a carrier wave, with computer readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, input method, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, radio Frequency (RF), and the like, or any suitable combination of the foregoing.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or part of the steps carried out in the method of the above-described embodiments are programs that can be implemented by means of a program to instruct related hardware, and the programs can be stored in a computer readable storage medium, and the programs, when executed, include one or a combination of the steps of the method embodiments.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product. The storage medium may be a read-only memory, a magnetic disk or optical disk, etc.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that various modifications and substitutions are possible within the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (9)
1. A method of three-dimensional content presentation, comprising:
scanning a picture in a third-party website page, and adding a three-dimensional content viewing control in the picture when the display size of the picture meets the preset picture size standard; under the condition that the operation of the three-dimensional content viewing control displayed on the current page through the label script is detected, obtaining a picture corresponding to the three-dimensional content viewing control;
sending the picture to a server through a three-dimensional content viewing request, so that the server can retrieve related three-dimensional content by using the picture;
receiving three-dimensional content which is returned by the server and is related to the picture through the label script; and
and displaying the three-dimensional content related to the picture.
2. A method of three-dimensional content presentation, comprising:
receiving a three-dimensional content viewing request from a request end, wherein the three-dimensional content viewing request comprises pictures in a third-party website page sent through a tag script;
obtaining a text retrieval statement by identifying the content of the picture, and obtaining three-dimensional content related to the picture based on the text retrieval statement; and
transmitting three-dimensional content related to the picture to the request terminal through the tag script so as to display the three-dimensional content related to the picture at the request terminal;
wherein the requesting end is configured to perform the method of claim 1.
3. The method of three-dimensional content presentation of claim 2, wherein retrieving three-dimensional content associated with the picture using the picture comprises:
performing content recognition on the picture by using a picture recognition service model to obtain text retrieval words and sentences; and
three-dimensional content associated with the text retrieval word and sentence is retrieved from a three-dimensional content database.
4. The method of three-dimensional content presentation of claim 3, further comprising:
acquiring training data of the graph recognition service model; wherein the training data comprises a sample picture and a text description of the sample picture; and
and training the graph recognition service model according to the training data.
5. An apparatus for three-dimensional content presentation, comprising:
the image acquisition module is used for scanning the images in the third-party website pages, and adding a three-dimensional content viewing control in the images when the display size of the images meets the preset image size standard; under the condition that the operation of the three-dimensional content viewing control displayed on the current page through the label script is detected, obtaining a picture corresponding to the three-dimensional content viewing control;
the picture sending module is used for sending the picture to the server through a three-dimensional content viewing request so that the server can retrieve related three-dimensional content by using the picture;
the three-dimensional content receiving module is used for receiving the three-dimensional content which is returned by the server and is related to the picture through the label script; and
and the three-dimensional content display module is used for displaying the three-dimensional content related to the picture.
6. An apparatus for three-dimensional content presentation, comprising:
the request receiving module is used for receiving a three-dimensional content viewing request from a request end, wherein the three-dimensional content viewing request comprises pictures in a third-party website page sent through a tag script;
the three-dimensional content retrieval module is used for obtaining text retrieval sentences through identifying the content of the pictures and obtaining three-dimensional content related to the pictures based on the text retrieval sentences; and
the three-dimensional content sending module is used for sending the three-dimensional content related to the picture to the request terminal through the tag script so as to display the three-dimensional content related to the picture on the request terminal;
wherein the requesting end comprises the apparatus of claim 5.
7. The apparatus for three-dimensional content presentation of claim 6, wherein the three-dimensional content retrieval module comprises:
the picture identification unit is used for carrying out content identification on the picture by utilizing a picture identification service model to obtain text retrieval words and sentences; and
and the retrieval unit is used for retrieving the three-dimensional content related to the text retrieval words and sentences from the three-dimensional content database.
8. A terminal device for implementing three-dimensional content presentation, the terminal device comprising:
one or more processors;
a storage means for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of three-dimensional content presentation of any of claims 1-4.
9. A computer readable storage medium storing a computer program, characterized in that the program when executed by a processor implements a method of three-dimensional content presentation according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810822037.0A CN109033346B (en) | 2018-07-24 | 2018-07-24 | Method, device, storage medium and terminal equipment for three-dimensional content presentation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810822037.0A CN109033346B (en) | 2018-07-24 | 2018-07-24 | Method, device, storage medium and terminal equipment for three-dimensional content presentation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109033346A CN109033346A (en) | 2018-12-18 |
| CN109033346B true CN109033346B (en) | 2024-04-12 |
Family
ID=64645655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810822037.0A Active CN109033346B (en) | 2018-07-24 | 2018-07-24 | Method, device, storage medium and terminal equipment for three-dimensional content presentation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109033346B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107045730A (en) * | 2017-03-06 | 2017-08-15 | 青岛鹏海软件有限公司 | A kind of multidimensional exhibition system and method for digital culture scene or image |
| US9886789B2 (en) * | 2011-05-31 | 2018-02-06 | Rakuten, Inc. | Device, system, and process for searching image data based on a three-dimensional arrangement |
| CN107967633A (en) * | 2016-10-19 | 2018-04-27 | 苏宁云商集团股份有限公司 | The methods of exhibiting and system of commodity in a kind of website |
-
2018
- 2018-07-24 CN CN201810822037.0A patent/CN109033346B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9886789B2 (en) * | 2011-05-31 | 2018-02-06 | Rakuten, Inc. | Device, system, and process for searching image data based on a three-dimensional arrangement |
| CN107967633A (en) * | 2016-10-19 | 2018-04-27 | 苏宁云商集团股份有限公司 | The methods of exhibiting and system of commodity in a kind of website |
| CN107045730A (en) * | 2017-03-06 | 2017-08-15 | 青岛鹏海软件有限公司 | A kind of multidimensional exhibition system and method for digital culture scene or image |
Non-Patent Citations (1)
| Title |
|---|
| 田翠华.基于GT4的物联网交通信息服务仿真研究.《基于GT4的物联网交通信息服务仿真研究》.厦门大学出版社,2017,(第1版),第242-345页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109033346A (en) | 2018-12-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10726212B2 (en) | Presenting translations of text depicted in images | |
| US10417275B2 (en) | Artificial intelligence assisted tagging of users in digital media online | |
| US10353947B2 (en) | Relevancy evaluation for image search results | |
| US9239833B2 (en) | Presenting translations of text depicted in images | |
| CN110020411B (en) | Image-text content generation method and equipment | |
| JP7283067B2 (en) | A system and method for detangling interrupted conversations in a communication platform, a method, a program, and a computer device for parsing unstructured messages | |
| CN109034069B (en) | Method and apparatus for generating information | |
| CN109346158A (en) | Ultrasonic image processing method, computer equipment and readable storage medium storing program for executing | |
| CN109218750B (en) | Video content retrieval method, device, storage medium and terminal equipment | |
| US20170351371A1 (en) | Touch interaction based search method and apparatus | |
| US9934206B2 (en) | Method and apparatus for extracting web page content | |
| CN110741331A (en) | System, method and apparatus for image response automated assistant | |
| JP7069802B2 (en) | Systems and methods for user-oriented topic selection and browsing, how to display multiple content items, programs, and computing devices. | |
| EP3869393B1 (en) | Image recognition method and apparatus, electronic device, and medium | |
| US20240143163A1 (en) | Digital ink processing system, method, and program | |
| CN113867875A (en) | Method, device, equipment and storage medium for editing and displaying marked object | |
| CN109033346B (en) | Method, device, storage medium and terminal equipment for three-dimensional content presentation | |
| CN111666735A (en) | Image text label display method and device and storage medium | |
| CN112883218A (en) | Image-text combined representation searching method, system, server and storage medium | |
| CA3209355A1 (en) | Intelligent assistant content generation | |
| US10095802B2 (en) | Methods and systems for using field characteristics to index, search for, and retrieve forms | |
| KR102159331B1 (en) | Sketch Retrieval system, user equipment, service equipment and service method based on meteorological phenomena information and computer readable medium having computer program recorded therefor | |
| CN113268193B (en) | Notebook page moving method, electronic equipment and computer storage medium | |
| CN114896967B (en) | Method, equipment and storage medium for processing forum problem in purchasing platform | |
| CN117874256A (en) | Obstetric and research atlas analysis method, system and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |