CN109697242B - Photographing question searching method and device, storage medium and computing equipment - Google Patents

Photographing question searching method and device, storage medium and computing equipment Download PDF

Info

Publication number
CN109697242B
CN109697242B CN201811608191.4A CN201811608191A CN109697242B CN 109697242 B CN109697242 B CN 109697242B CN 201811608191 A CN201811608191 A CN 201811608191A CN 109697242 B CN109697242 B CN 109697242B
Authority
CN
China
Prior art keywords
title
searching
coordinate information
user
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811608191.4A
Other languages
Chinese (zh)
Other versions
CN109697242A (en
Inventor
薛泽融
王宁
谢仪伦
于桐
麦晓云
郝双
马凌峰
宫思伟
唐韬然
彭尹星
王雨
刘志强
鲜于海舒
林辉
王标
邓冰峰
周枫
吴迎晖
王文龙
林会杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Youdao Information Technology Beijing Co Ltd
Original Assignee
Netease Youdao Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Youdao Information Technology Beijing Co Ltd filed Critical Netease Youdao Information Technology Beijing Co Ltd
Priority to CN201811608191.4A priority Critical patent/CN109697242B/en
Publication of CN109697242A publication Critical patent/CN109697242A/en
Application granted granted Critical
Publication of CN109697242B publication Critical patent/CN109697242B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/63Scene text, e.g. street names
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention provides a photographing question searching method, a photographing question searching device, a storage medium and computing equipment. The method comprises the following steps: acquiring a picture containing a title; transmitting the picture to a server; acquiring coordinate information of one or more titles which are input by a user and need to be searched in the picture; transmitting coordinate information input by a user to a server; and receiving a search result corresponding to the title of the coordinate information position sent by the server. By setting the coordinate information corresponding to the titles, the titles to be searched can be input by inputting the coordinate information. The method of the invention obviously reduces the photographing times in the problem searching process, thereby obviously reducing the operation complexity of photographing and problem searching, bringing better experience to users and reducing the time consumption of the whole process of photographing and problem searching.

Description

Photographing question searching method and device, storage medium and computing equipment
Technical Field
The embodiment of the invention relates to the field of education, in particular to a photographing question searching method, a photographing question searching device, a storage medium and a computing device.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
At present, some methods for shooting and searching categories appear, which all enable a user to shoot a single-channel title, submit a picture with the single-channel title for searching, and finally return a searched result. The provided shooting and question searching function can only search a single question at a time, if a user wants to continuously search other questions on the picture after searching a certain question, the user needs to shoot again, and the process is repeated.
Disclosure of Invention
The prior art inputs the title to be searched by repeatedly taking pictures.
Therefore, in the prior art, the operation of repeatedly taking pictures in the process of searching questions is a very annoying process.
For this reason, an improved method for searching for questions is highly desired so that the number of photographing times is reduced.
In this context, embodiments of the present invention are intended to provide a photographing question searching method, apparatus, storage medium and computing device.
In a first aspect of the embodiments of the present invention, there is provided a method for searching for a question by taking a picture, including:
acquiring a picture containing a title;
transmitting the picture to a server;
acquiring coordinate information of one or more titles which are input by a user and need to be searched in the picture;
transmitting coordinate information input by a user to a server; and
and receiving a search result corresponding to the title of the coordinate information position sent by the server.
In an embodiment of the invention, the coordinate information is input by selecting a question frame and selecting a question to be searched in a sliding manner.
In another embodiment of the present invention, the question box can be dragged or stretched to change the position or size for inputting the coordinate information.
In another embodiment of the present invention, the number of the search results is multiple, and each search result corresponds to a number, and the method further includes:
and responding to the operation of the user on the number, and displaying the detailed information corresponding to the number.
In yet another embodiment of the present invention, each number and its corresponding details are displayed in columns.
In yet another embodiment of the present invention, the number is displayed in the vicinity of the corresponding title.
In yet another embodiment of the present invention, in response to a user's manipulation of a number, detailed information corresponding to the number is displayed in an additional page.
In a second aspect of the embodiments of the present invention, there is provided another method for searching questions by taking pictures, including:
receiving a picture including a title;
receiving coordinate information of one or more titles needing to be searched and input by a user in the picture;
determining a title from a result obtained by identifying the picture according to the coordinate information;
obtaining a search result corresponding to the determined title;
and transmitting the search result to the user.
In one embodiment of the invention, the method further comprises marking searched topics, and recording the search results of the topics selected by the user.
In a third aspect of the embodiments of the present invention, there is provided a photographing question searching apparatus, including:
the acquisition module is used for acquiring pictures containing questions;
the picture transmission module is used for transmitting the picture to the server;
the coordinate acquisition module is used for acquiring coordinate information of one or more titles which are input by a user and need to be searched in the picture;
the coordinate information transmission module is used for transmitting the coordinate information input by the user to the server; and
and the receiving module is used for receiving the search result corresponding to the title of the coordinate information position sent by the server.
In an embodiment of the present invention, the coordinate obtaining module is configured to obtain coordinate information input by selecting a question to be searched in a question frame and selecting a question to be searched in a sliding manner.
In yet another embodiment of the present invention, the question box may be dragged or stretched to change the position or size for inputting the coordinate information.
In yet another embodiment of the present invention, the apparatus further comprises: the number module is used for numbering a plurality of search results, and each search result corresponds to one number; and the display unit is used for responding to the operation of the user on the number and displaying the detailed information corresponding to the number.
In yet another embodiment of the present invention, the display unit displays each number and its corresponding details in columns.
In still another embodiment of the present invention, the display unit displays the number in the vicinity of the corresponding title.
In still another embodiment of the present invention, the display unit displays detailed information corresponding to the number in another page in response to a user's manipulation of the number.
In a fourth aspect of the embodiments of the present invention, there is provided another photographing question searching apparatus, including:
the picture receiving module is used for receiving pictures including titles;
the coordinate receiving module is used for receiving coordinate information of one or more titles which need to be searched and are input by a user in the picture;
the identification module is used for determining a title from a result obtained by identifying the picture according to the coordinate information;
the searching module is used for obtaining a searching result corresponding to the determined title;
and the sending module is used for transmitting the search result to a user.
In an embodiment of the present invention, the apparatus further includes a mark recording module, configured to mark searched topics, and record search results of the topics selected by the user.
In a fifth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the photo title method as described above.
In a sixth aspect of embodiments of the present invention, there is provided a computing device comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to execute the photo title method as described above via execution of the executable instructions.
According to the method for searching for the questions by photographing, the number of photographing times of the user during searching for the questions can be reduced, repeated photographing operation is not needed, the number of times of operation during searching for the questions is remarkably reduced, time consumption of the whole process of photographing and searching for the questions is reduced, and better experience is brought to the user.
Drawings
The foregoing and other objects, features and advantages of exemplary embodiments of the present invention will be readily understood by reading the following detailed description with reference to the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
fig. 1 schematically illustrates an application scenario of a photographing question searching method and apparatus according to an embodiment of the present disclosure;
FIG. 2 schematically shows a flowchart of a photo topic searching method according to an embodiment of the present invention;
FIG. 3 is a diagram schematically illustrating a comparison between display effects of a frame selection coordinate input method according to an embodiment of the present invention;
fig. 4 is a schematic diagram schematically illustrating a search result display effect according to an embodiment of the present invention.
FIG. 5 schematically shows a flowchart of a photo topic searching method according to an embodiment of the invention;
FIG. 6 is a schematic medium diagram illustrating a method for searching for questions by photographing according to an embodiment of the present invention;
FIG. 7 is a block diagram schematically illustrating a photographing question searching apparatus according to an embodiment of the present invention;
FIG. 8 is a block diagram schematically illustrating a photographing question searching apparatus according to an embodiment of the present invention;
FIG. 9 schematically shows a structural diagram of a computing device according to an embodiment of the invention.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present invention will be described with reference to a number of exemplary embodiments. It should be understood that these embodiments are given only for the purpose of enabling those skilled in the art to better understand and to implement the present invention, and do not limit the scope of the present invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
In this document, it should be understood that the term "Application" refers to a program installed on a smart device such as a mobile phone, and generally needs to be run in cooperation with a server. Common applications fall into two main categories. One is pre-installed system applications such as short messages, photos, memos, Safari, etc.; still another category is third party applications such as e.g. internet news for information, panning for shopping, wechat for social, etc.
The term "Optical Character Recognition" or OCR for short refers to a process OCR in which a computing device (e.g., a scanner or digital camera) examines a printed Character on paper, determines its shape by detecting dark and light patterns, and then translates the shape into computer text using Character Recognition methods.
The term question bank refers to a database for storing the electronic information of questions, and the main composition fields include question stems, answers, analyses, knowledge points and the like.
The term "retrieving" generally refers to the system querying a database to return relevant information according to the provided information using a specific set of rules by providing the information. The main implementation of the search in this document is to identify topics from the image information by using OCR technology and search in the topic library and return the relevant results.
Moreover, any number of elements in the drawings are by way of example and not by way of limitation, and any nomenclature is used solely for differentiation and not by way of limitation.
The principles and spirit of the present invention are explained in detail below with reference to several exemplary embodiments thereof.
Summary of The Invention
The inventor finds that the existing shooting and searching schemes enable users to shoot single-channel questions, submit pictures with the single-channel questions for searching, and finally return retrieved results. If the user wants to continue to query other topics on the picture after querying a certain topic, the user needs to shoot again, and the process is repeated, so that the efficiency of searching the topics in real time is low, and the improvement of user experience is hindered.
Therefore, the embodiment of the invention provides a photographing question searching method, a photographing question searching device, a storage medium and computing equipment, which can reduce the photographing times of a user during question searching without repeated photographing operations, thereby remarkably reducing the operation times during question searching, reducing the time consumption of the whole process of photographing question searching and bringing better experience to the user.
Having described the general principles of the invention, various non-limiting embodiments of the invention are described in detail below.
Application scene overview
Referring first to fig. 1, fig. 1 schematically shows an application scenario according to an embodiment of the present invention.
As shown in fig. 1, taking a scene of taking a picture for searching questions as an example, the application scene includes clients 101 and 102 running the software for searching questions and a server 200, where the clients 101 and 102 may be terminal devices having functions of taking a picture and transmitting data, such as an intelligent mobile phone, a tablet computer, and an intelligent wearable device.
The user uses the topic searching software to call the cameras of the client sides 101 and 102 to shoot, a picture containing a plurality of or single topics to be searched is obtained, the picture is transmitted to the server side 200 through the client sides 101 and 102, the client sides 101 and 102 obtain coordinate information of the plurality of or single topics to be searched input by the user in the picture, and the coordinate information of the plurality of or single topics in the picture is transmitted to the server side 200 through the client sides 101 and 102. The server 200 receives a picture including topics and coordinate information of one or more topics needing to be searched and input by a user in the picture, performs character recognition on the topics in the picture, searches in a topic library of the server 200, and transmits a search result to the client after the server 200 obtains the search result corresponding to the topic.
It should be noted that the method for searching for questions by photographing of the present invention can be applied to a variety of scenes for searching for questions, including the scenes for searching for questions by photographing, the scenes for searching for questions by pictures, etc., and for convenience of description, the present invention will be described in detail below by taking the scenes for searching for questions by photographing as an example, but is not limited to the embodiments of the present invention.
Exemplary method
In conjunction with the above application scenarios, a photo topic search method according to an exemplary embodiment of the present invention is described below with reference to fig. 2 to 5. It should be noted that the above application scenarios are merely illustrative for the convenience of understanding the spirit and principles of the present invention, and the embodiments of the present invention are not limited in this respect. Rather, embodiments of the present invention may be applied to any scenario where applicable.
Fig. 2 schematically shows a flowchart of a photo topic searching method according to a first embodiment of the present invention. The execution main body of the method can be various devices with processing functions, such as client devices of smart phones, tablet computers, intelligent wearable devices and the like, and more specifically, can be application programs installed in the smart phones, the tablet computers, the intelligent wearable devices and the like.
Referring to fig. 2, the method for searching for questions by taking a picture according to the first embodiment of the present invention includes the following steps S11 to S15, which are described in detail as follows:
and S11, acquiring the picture containing the title.
According to the embodiment of the invention, the acquired picture can be an image shot by a camera on site or a picture stored in a client, and the picture contains a title to be searched.
And S12, transmitting the picture to a server.
According to the embodiment of the invention, the picture transmitted by the client can be automatically transmitted to the server immediately after the shooting is finished, or the picture can be transmitted by the user after the shooting is finished. And for the pictures stored in the client, the user selects the pictures and then transmits the pictures to the server from the client.
And S13, acquiring coordinate information of one or more titles which need to be searched and are input by the user in the picture.
According to the embodiment of the invention, a user operates on a client to input, or performs operations such as frame selection or sliding selection on one or more topics needing to be searched, and the client generates coordinate information (topic coordinate information) of the topics needing to be searched according to the input or the operation of the user.
And S14, transmitting the coordinate information input by the user to the server.
According to the embodiment of the invention, the topic coordinate information generated by the client is transmitted to the server.
S15, receiving the search result corresponding to the title of the coordinate information position sent by the server.
According to the embodiment of the invention, the client receives the search result sent by the server, the search result is a search result of a topic corresponding to the coordinate information input by the user, and the search result can include topic information, answer information or related knowledge information and the like. According to the invention, the picture including the questions is transmitted to the server once, only coordinate information needs to be input when the questions are searched for multiple times, repeated photographing is not needed, and photographing times of the user during the question searching can be reduced, so that the operation times during the question searching are obviously reduced, time consumption of the whole process of photographing and question searching is reduced, and better experience is brought to the user.
There are many ways to input coordinate information, and in one embodiment of the present invention, a question frame is displayed on a display device, and the specific shape of the question frame may be preset, and in this embodiment, a rectangular question frame is selected. The question to be searched is selected through the question frame, and the coordinates of the question frame can be used as the coordinates of the question. In one embodiment, the size of the question box may be adjusted, for example, if the question box is too small to cover the question to be searched, the question box may be adjusted to cover the question to be searched. In the case where the question box covers only one question, the width of the question box can be adjusted to cover the width of multiple questions to be searched. The coordinates of the four vertices of the question box may be used as the coordinate information of the question. This adjustment may be accomplished by dragging or stretching the question box.
Besides acquiring the coordinate information input by the user by using the question box, the coordinate information input by the user can be acquired by acquiring the sliding selection of the user. In this manner, the user slides from a certain position (slide start position) of the title to a certain position (slide end position) at the end of one or more titles to be searched. In this case, the coordinates of the slide start position and the coordinates of the slide end position may be used as the coordinate information of the title.
In one embodiment of the present invention, as shown in fig. 3, in the process of inputting coordinate information through the question box 610, the input coordinate information may be adjusted by dragging the preset question box 610. As shown in FIG. (a), the entry of the coordinate position is completed by selecting the topic one 620 box in the topic box 610. As shown in fig. b, the input of the coordinate position is changed by moving the position of the question box 610 and selecting the second question 630 box in the question box 610. As shown in FIG. c, the coordinate information of multiple topics can be input by stretching the question box 610 to change its size to a new question box 610', and selecting the first topic 620 and the second topic 630. Therefore, after a question is searched, the operation is very simple and convenient when the question is searched again, and only the question selecting frame 610 needs to be operated, so that the efficiency of shooting and searching the question is improved.
In one embodiment of the invention, when the search result is multiple, each search result corresponds to a number, and in response to the operation of the user on the number, the detailed information corresponding to the number is displayed.
According to the embodiment of the invention, for the search results of topics, under the condition that a plurality of topics are searched, a plurality of search results exist, and under the condition that a plurality of search results are searched, each search result is numbered, so that a user can select detailed information of the search results to be displayed according to specific needs.
In addition, when a single topic is searched, there may be a case where there are a plurality of search results, for example, there are a plurality of answer information or a plurality of related knowledge information. For these situations, each search result may be numbered, and the user may select the detailed information that needs to be displayed for the search result according to the specific needs.
In one embodiment of the invention, each number and its corresponding details are displayed in columns. Specifically, as shown in FIG. 4(a), each search result is divided into a first display field 640 and a second display field 650.
The title to be searched is displayed above the display device, the search result is displayed below the title, and the title and the search result are simultaneously displayed in the same screen, so that a user can conveniently check and input coordinate information.
In one embodiment of the invention, the number is displayed in the vicinity of the corresponding title.
And in response to the operation of the number by the user, displaying the detailed information corresponding to the number in another page.
Each search result can be individually set as a display page, for example, as shown in fig. 4(b), in this embodiment, the display page includes a first page 660, a second page 670, and a third page 680, each page is clearly separated, and when each search result needs to be selected, the user inputs an instruction operation and selects a corresponding number.
As shown in fig. 4(a), according to one embodiment, for example, a mark 690 with a triangular shape is arranged at the upper right corner of the searched title, and the user can display the search result by operating the mark 690. Of course, the indicia 690 may be any suitable shape. In the case where there are a plurality of search results for one topic, information on the search result selected and confirmed by the user may be transmitted to the server. The next time the server provides the search result for the topic, the server preferentially provides the confirmed search result, for example, the confirmed search result is placed in front of all the search results. The search results may also be recorded locally, with the confirmed search results being preferentially displayed next time they are displayed.
Fig. 5 schematically shows a flowchart of a photo title photographing method according to a second embodiment of the present invention, which steps are performed by, for example, the server 200 in fig. 1.
Referring to fig. 5, the photo title searching method according to the second embodiment of the present invention includes the following steps S31 to S35, which are described in detail as follows:
and S31, receiving the picture comprising the title.
According to the embodiment of the invention, the server receives the picture, and the picture contains the title to be searched.
And S32, receiving coordinate information of one or more titles needing to be searched and input by the user in the picture.
According to the embodiment of the present invention, the coordinate information may be received separately after the picture is received, or may be received simultaneously with the picture.
And S33, determining the title from the result obtained by identifying the picture according to the coordinate information.
According to the embodiment of the invention, the server determines the title to be searched through character recognition.
According to one embodiment, when the coordinate information is coordinates of four vertexes of the question box, characters and/or figures in the coordinate box can be identified, and therefore the question to be searched can be determined. In one embodiment, the method further comprises: a step of identifying the completeness of the question, which is to determine whether the question obtained according to the size of the question frame is a complete question; and an identification range adjusting step of adjusting the identification range according to the coordinate information based on the condition that the titles are incomplete, and expanding the identification range so as to obtain complete titles. When the coordinate information is the coordinates of the sliding start position and the sliding end position, the characters and/or the graphics in the range determined by the two coordinates can be identified, so that the title to be searched can be determined. And a step of identifying the completeness of the topic and a step of adjusting the identification range can be carried out according to requirements. Such a scheme would reduce the user's requirement for the operation of the question box or the sliding selection operation, so that the operation of the question box or the sliding selection operation does not have to be particularly accurate.
The server may perform OCR recognition of the entire picture upon receiving the picture including the title in step S31, or may perform OCR recognition of pictures within the range of the coordinate information upon receiving the coordinate information in step S33.
And S34, obtaining the search result corresponding to the determined title.
According to the embodiment of the invention, after the server determines the topics to be searched, the server compares the topics in the topic library and the like to obtain the search results corresponding to the topics. The search result is a search result of a topic corresponding to the coordinate information input by the user, and the search result may include topic information, answer information, or topic-related knowledge information, etc.
And S35, transmitting the search result to the user.
In one embodiment of the present invention, referring to fig. 5, the method further includes step S36, which is described in detail as follows:
and S36, marking the searched topics and recording the search result of the topics selected by the user.
According to the embodiment of the invention, the searched topics are marked in the server side and displayed at the client side. For example, as shown in FIG. 4, a triangular mark 690 is placed in the upper right corner of the title. And meanwhile, receiving information about the search result selected and confirmed by the user from the client when a plurality of search results exist for one topic, and providing the search result next to the client.
According to the technical scheme of the embodiment of the invention, the shooting times of the user in searching the questions can be reduced, and repeated shooting operation is not required, so that the operation times in searching the questions are obviously reduced, the time consumption of the whole process of shooting and searching the questions is reduced, and better experience is brought to the user.
Exemplary Medium
Having described the method of exemplary embodiments of the present invention, a computer-readable storage medium of exemplary embodiments of the present invention is described next.
In some possible embodiments, aspects of the present invention may also be implemented as a computer-readable storage medium having stored thereon a computer program for implementing a photo topic searching method and steps thereof according to various exemplary embodiments of the present invention described in the above-mentioned "exemplary methods" section of this specification when the program is executed by a processor of a device.
Specifically, the processor of the device, when executing the program, is configured to implement the following steps:
acquiring a picture containing a title;
transmitting the picture to a server;
acquiring coordinate information of one or more titles which are input by a user and need to be searched in the picture;
transmitting coordinate information input by a user to a server; and
and receiving a search result corresponding to the title of the coordinate information position sent by the server.
Still more specifically, the processor of the device, when executing the program, is configured to implement the steps of:
receiving a picture including a title;
receiving coordinate information of one or more titles needing to be searched and input by a user in the picture;
determining a title from a result obtained by identifying the picture according to the coordinate information;
obtaining a search result corresponding to the determined title;
and transmitting the search result to the user.
It should be noted that: the computer-readable storage medium described above may be, for example but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
As shown in fig. 6, a medium 300, which may take the form of a portable compact disc read only memory (CD-ROM) and include a program and may run on a device, according to an embodiment of the present invention is depicted. However, the invention is not limited in this respect, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN).
Exemplary devices
Having described the media of exemplary embodiments of the present invention, the accompanying drawings next illustrate a photo topic search apparatus of exemplary embodiments of the present invention that can be understood based on the above description of the method steps.
Referring to fig. 7, a photographing question searching apparatus 400 according to an embodiment of the present invention includes:
an obtaining module 410, configured to obtain a picture including a title;
the picture transmission module 431 is used for transmitting the picture to the server;
the coordinate acquisition module 440 is configured to acquire coordinate information of one or more titles, which are input by a user and need to be searched, in the picture;
a coordinate information transmission module 432, configured to transmit coordinate information input by a user to a server;
a receiving module 420, configured to receive a search result corresponding to the title of the coordinate information position sent by the server.
According to one embodiment, the coordinate acquisition module is used for acquiring coordinate information input by a way of selecting a question frame and selecting a question needing to be searched in a sliding manner.
According to one embodiment, the question box may be dragged or stretched to change position or size for inputting the coordinate information.
According to one embodiment, the apparatus further comprises: a numbering module 450, configured to number a plurality of search results, where each search result corresponds to a number; the display unit 433 displays detailed information corresponding to the number in response to an operation of the number by the user.
According to one embodiment, the display unit 433 displays each number and its corresponding details in columns.
According to one embodiment, the display unit 433 displays the number in the vicinity of the corresponding title.
According to one embodiment, the display unit 433 displays detailed information corresponding to the number in another page in response to a user's operation on the number.
Next, a photographing problem-searching apparatus according to another exemplary embodiment of the present invention will be described with reference to fig. 8.
Referring to fig. 8, a photographing question searching apparatus 500 according to an embodiment of the present invention includes:
a picture receiving module 511, configured to receive a picture including a title;
a coordinate receiving module 512, configured to receive coordinate information of one or more titles that need to be searched and are input by a user in the picture;
the identification module 520 is configured to determine a title from a result obtained by identifying the picture according to the coordinate information;
a searching module 530, configured to obtain a search result corresponding to the determined title;
a sending module 540, configured to transmit the search result to the user.
In a possible implementation manner, based on the above scheme, the system further includes a mark recording module 550, configured to mark the searched topics, and record the search results of the topics selected by the user.
Exemplary computing device
Having described the method, medium, and apparatus of exemplary embodiments of the present invention, a computing device of exemplary embodiments of the present invention is described next.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible implementations, a computing device according to an embodiment of the invention may include at least one processing unit, and at least one memory unit. Wherein the storage unit stores program code that, when executed by the processing unit, causes the processing unit to perform the photo title searching method and steps thereof according to various exemplary embodiments of the present invention described in the above section "exemplary method" of this specification.
As shown in fig. 9, computing device 110 is embodied in the form of a general purpose computing device. Components of computing device 110 may include, but are not limited to: the at least one processing unit 1101, the at least one storage unit 1102, and a bus 1103 connecting different system components (including the processing unit 1101 and the storage unit 1102).
The bus 1103 includes a data bus, a control bus, and an address bus.
The storage unit 1102 may include readable media in the form of volatile memory, such as Random Access Memory (RAM)11021 and/or cache memory 11022, and may further include readable media in the form of non-volatile memory, such as Read Only Memory (ROM) 11023.
The memory unit 1102 may also include a program/utility 11025 having a set (at least one) of program modules 11024, such program modules 11024 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Computing device 110 may also communicate with one or more external devices 1104 (e.g., keyboard, pointing device, etc.). Such communication may occur via input/output (I/O) interfaces 1105. Also, the computing device 110 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 1106. The network adapter 1106 communicates with the other modules of the computing device 110 over the bus 1103. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computing device 110, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
It should be noted that although in the above detailed description several units/modules or sub-units/modules of the apparatus are mentioned, such a division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more of the units/modules described above may be embodied in one unit/module according to embodiments of the invention. Conversely, the features and functions of one unit/module described above may be further divided into embodiments by a plurality of units/modules.
Further, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
While the spirit and principles of the invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, nor is the division of aspects, which is for convenience only as the features in such aspects may not be combined to benefit. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (18)

1. A method for searching questions by photographing comprises the following steps:
acquiring a picture containing at least two questions;
transmitting the picture to a server;
when searching for a question, acquiring coordinate information of one or more questions needing to be searched and input by a user in the picture;
transmitting coordinate information input by a user to a server, wherein the coordinate information is used for being provided for the server so that the server determines a title from a result obtained by identifying the picture according to the coordinate information; and
receiving a plurality of search results corresponding to the titles of the coordinate information positions sent by the server, wherein each search result corresponds to one number;
when the title of the coordinate information position has a plurality of search results corresponding to one title and the plurality of search results corresponding to one title have search results confirmed by the user, displaying the number of the confirmed search result in front of the number corresponding to the plurality of search results corresponding to one title;
and responding to the operation of a user on the number, and displaying detailed information corresponding to the number, wherein the detailed information comprises a search result corresponding to the number, a search title and a mark representing that the title has been searched.
2. The photo title searching method according to claim 1, wherein the coordinate information is inputted by selecting a title frame and selecting a title to be searched in a sliding manner.
3. The method for searching for questions by taking a picture according to claim 2, wherein the question box can be dragged or stretched to change the position or size thereof for inputting the coordinate information.
4. The photo title searching method of claim 1, wherein each number and its corresponding details are displayed in columns.
5. The photo title searching method of claim 1, wherein the number is displayed near the corresponding title.
6. The photo title searching method of claim 1, wherein in response to the user's operation on the number, the detailed information corresponding to the number is displayed in another page.
7. A method for searching questions by photographing comprises the following steps:
receiving a picture comprising at least two titles;
receiving coordinate information of one or more titles needing to be searched and input by a user during searching for the titles in the picture;
determining a title from a result obtained by identifying the picture according to the coordinate information;
obtaining a plurality of search results corresponding to the determined titles, wherein each search result corresponds to a number; when the determined title has a plurality of search results corresponding to one title and the plurality of search results corresponding to one title have search results confirmed by the user, arranging the number of the confirmed search results in front of the number corresponding to the plurality of search results corresponding to one title;
transmitting the plurality of search results to a user;
marking searched topics, and recording search results of the topics selected by a user.
8. A photographing question searching device comprises:
the acquisition module is used for acquiring a picture containing at least two questions;
the picture transmission module is used for transmitting the picture to the server;
the coordinate acquisition module is used for acquiring coordinate information of one or more titles which are input by a user and need to be searched in the picture during title searching;
the coordinate information transmission module is used for transmitting coordinate information input by a user to a server, and the coordinate information is used for being provided for the server so that the server can determine a title from a result obtained by identifying the picture according to the coordinate information;
the receiving module is used for receiving a plurality of search results corresponding to the titles of the coordinate information positions sent by the server, and each search result corresponds to one number;
a display unit, configured to display, when there are multiple search results corresponding to one topic in a topic at the coordinate information position and there is a search result confirmed by a user in the multiple search results corresponding to the one topic, a number of the confirmed search result before a number corresponding to the multiple search results corresponding to the one topic; and responding to the operation of a user on the number, and displaying detailed information corresponding to the number, wherein the detailed information comprises a search result corresponding to the number, a search title and a mark representing that the title has been searched.
9. The apparatus for searching for the question by taking a picture according to claim 8, wherein the coordinate acquiring module is configured to acquire the coordinate information input by selecting the question frame and selecting the question to be searched in a sliding manner.
10. The apparatus for searching for questions by taking a picture according to claim 9, wherein the question box can be dragged or stretched to change the position or size thereof for inputting the coordinate information.
11. The apparatus for searching for test subjects by taking a picture according to claim 8, wherein said display unit displays each number and its corresponding detailed contents in columns.
12. The apparatus of claim 8, wherein the display unit displays the number in the vicinity of the corresponding title.
13. The apparatus for searching for the subject by taking a picture according to claim 8, wherein said display unit displays the detailed information corresponding to the number in another page in response to the operation of the number by the user.
14. A photographing question searching device comprises:
the picture receiving module is used for receiving a picture comprising at least two titles;
the coordinate receiving module is used for receiving coordinate information of one or more titles needing to be searched and input by a user in searching the titles in the picture;
the identification module is used for determining a title from a result obtained by identifying the picture according to the coordinate information;
the searching module is used for obtaining a plurality of searching results corresponding to the determined titles, and each searching result corresponds to one number; when the determined title has a plurality of search results corresponding to one title and the plurality of search results corresponding to one title have search results confirmed by the user, arranging the number of the confirmed search results in front of the number corresponding to the plurality of search results corresponding to one title;
the sending module is used for transmitting the plurality of search results to the user;
and the marking recording module is used for marking the searched topics and recording the search results of the topics selected by the user.
15. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-6.
16. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of claim 7.
17. A computing device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-6 via execution of the executable instructions.
18. A computing device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of claim 7 via execution of the executable instructions.
CN201811608191.4A 2018-12-27 2018-12-27 Photographing question searching method and device, storage medium and computing equipment Active CN109697242B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811608191.4A CN109697242B (en) 2018-12-27 2018-12-27 Photographing question searching method and device, storage medium and computing equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811608191.4A CN109697242B (en) 2018-12-27 2018-12-27 Photographing question searching method and device, storage medium and computing equipment

Publications (2)

Publication Number Publication Date
CN109697242A CN109697242A (en) 2019-04-30
CN109697242B true CN109697242B (en) 2022-03-08

Family

ID=66232224

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811608191.4A Active CN109697242B (en) 2018-12-27 2018-12-27 Photographing question searching method and device, storage medium and computing equipment

Country Status (1)

Country Link
CN (1) CN109697242B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110837833A (en) * 2019-11-14 2020-02-25 广东小天才科技有限公司 Question selection method and device, terminal equipment and readable storage medium
CN111767424B (en) * 2020-09-02 2020-12-11 北京新唐思创教育科技有限公司 Image processing method, image processing device, electronic equipment and computer storage medium
CN113360064A (en) * 2021-06-09 2021-09-07 深圳集智数字科技有限公司 Method and device for searching local area of picture, medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107463681A (en) * 2017-08-08 2017-12-12 广东小天才科技有限公司 A kind of recognition methods of topic to be searched and device
CN108021648A (en) * 2017-11-30 2018-05-11 广东小天才科技有限公司 A kind of method, apparatus and intelligent terminal for searching topic
CN108196782A (en) * 2018-01-25 2018-06-22 广东小天才科技有限公司 One kind, which is taken pictures, searches topic method and electronic equipment
CN108228731A (en) * 2017-12-12 2018-06-29 广东小天才科技有限公司 It takes pictures and searches topic method, apparatus, server and storage medium
CN108287900A (en) * 2018-01-23 2018-07-17 广东小天才科技有限公司 A kind of hand-held photographing device searches topic method, system and hand-held photographing device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108197299B (en) * 2018-01-24 2020-07-24 广东小天才科技有限公司 Photographing and question searching method and system based on handheld photographing equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107463681A (en) * 2017-08-08 2017-12-12 广东小天才科技有限公司 A kind of recognition methods of topic to be searched and device
CN108021648A (en) * 2017-11-30 2018-05-11 广东小天才科技有限公司 A kind of method, apparatus and intelligent terminal for searching topic
CN108228731A (en) * 2017-12-12 2018-06-29 广东小天才科技有限公司 It takes pictures and searches topic method, apparatus, server and storage medium
CN108287900A (en) * 2018-01-23 2018-07-17 广东小天才科技有限公司 A kind of hand-held photographing device searches topic method, system and hand-held photographing device
CN108196782A (en) * 2018-01-25 2018-06-22 广东小天才科技有限公司 One kind, which is taken pictures, searches topic method and electronic equipment

Also Published As

Publication number Publication date
CN109697242A (en) 2019-04-30

Similar Documents

Publication Publication Date Title
CN109697242B (en) Photographing question searching method and device, storage medium and computing equipment
EP2405349A1 (en) Apparatus and method for providing augmented reality through generation of a virtual marker
CN111866392B (en) Shooting prompting method and device, storage medium and electronic equipment
US20150169944A1 (en) Image evaluation apparatus, image evaluation method, and non-transitory computer readable medium
CN117251091A (en) Information interaction method, device, equipment, storage medium and program product
US10713485B2 (en) Object storage and retrieval based upon context
CN110568973A (en) screenshot method, screenshot device, storage medium and terminal equipment
KR101747299B1 (en) Method and apparatus for displaying data object, and computer readable storage medium
CN112698775B (en) Image display method and device and electronic equipment
US20150082248A1 (en) Dynamic Glyph-Based Search
KR101768914B1 (en) Geo-tagging method, geo-tagging apparatus and storage medium storing a program performing the method
CN112822394B (en) Display control method, display control device, electronic equipment and readable storage medium
KR102234172B1 (en) Apparatus and method for providing digital twin book shelf
KR101477642B1 (en) Flat board printer
CN112396675A (en) Image processing method, device and storage medium
CN111796733B (en) Image display method, image display device and electronic equipment
CN114416664A (en) Information display method, information display device, electronic apparatus, and readable storage medium
US20180189602A1 (en) Method of and system for determining and selecting media representing event diversity
CN107733779B (en) Function expansion method and device based on contact persons
CN111428613A (en) Data processing method, device, equipment and storage medium
CN111083552A (en) Thumbnail generation method, device, equipment and medium
CN105975621B (en) Method and device for identifying search engine in browser page
KR20150096552A (en) System and method for providing online photo gallery service by using photo album or photo frame
CN116882371A (en) Resource adding method, electronic device and readable storage medium
US20220100457A1 (en) Information processing apparatus, information processing system, and non-transitory computer-executable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant