CN106650727B - Information display method and AR equipment - Google Patents
Information display method and AR equipment Download PDFInfo
- Publication number
- CN106650727B CN106650727B CN201611123080.5A CN201611123080A CN106650727B CN 106650727 B CN106650727 B CN 106650727B CN 201611123080 A CN201611123080 A CN 201611123080A CN 106650727 B CN106650727 B CN 106650727B
- Authority
- CN
- China
- Prior art keywords
- target
- information
- font
- image information
- character
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
- G06V20/63—Scene text, e.g. street names
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/12—Use of codes for handling textual entities
- G06F40/151—Transformation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an information display method and AR equipment, wherein the method comprises the following steps: when detecting that the image information of the current scene comprises characters, identifying the character information referred by the characters; receiving a font conversion instruction aiming at a target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into a target font; according to the font conversion instruction and the target character information indicated by the target characters, the target character information is displayed on the image information in the target font, so that the font conversion of the characters contained in the image information can be realized, a user can be helped to more clearly identify the characters in the image information, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of terminal technologies, and in particular, to an information display method and an AR device.
Background
Augmented Reality technology (AR for short) is a technology for calculating the position and angle of a camera image in real time and adding corresponding images, videos and 3D models, the AR technology can seamlessly integrate and interact real world information and virtual world information on a screen, and AR equipment is increasingly used by users along with the improvement of the CPU operation capacity of portable electronic products.
However, in the prior art, the AR device may collect and display image information in a scene, and when the image information includes a character, the AR device may recognize the character as much as possible, and the character in the image information may only be displayed as the original character in the image information, and may not perform font conversion on the character in the collected image information, for example, some users may not recognize a complex character, which may cause the user to be unable to recognize the complex character, and user experience is poor.
Disclosure of Invention
The embodiment of the invention discloses an information display method and AR equipment, which can realize font conversion of characters contained in image information, help a user to more clearly identify the characters in the image information and improve user experience.
In a first aspect, an embodiment of the present invention provides an information display method, including:
when detecting that the image information of the current scene comprises characters, identifying the character information referred by the characters;
receiving a font conversion instruction aiming at a target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into a target font;
and displaying the target character information on the image information in the target font according to the font conversion instruction and the target character information indicated by the target character.
Optionally, the displaying, according to the font conversion instruction and the target text information referred by the target text, the target text information in the target font on the image information includes:
removing the target characters in the image information;
and displaying the target character information in the target font at the position corresponding to the target character in the image information according to the font conversion instruction and the target character information indicated by the target character.
Optionally, when it is detected that the image information of the current scene includes a text, after identifying text information to which the text refers, the method further includes:
receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;
the displaying the target character information on the image information in the target font according to the font conversion instruction and the character information referred by the target character comprises:
and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.
Optionally, after the target text information is displayed in the target font on the image information according to the font conversion instruction and the text information referred by the target text, the method further includes:
sending a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request;
and receiving and displaying the retrieval result.
Optionally, the keyword further includes location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.
In a second aspect, an embodiment of the present invention further provides an AR device, including:
the processing unit is used for identifying character information referred by characters when detecting that the image information of the current scene comprises the characters;
a receiving unit, configured to receive a font conversion instruction for a target text in the image information, where the font conversion instruction is used to instruct to convert a font of the target text in the image information into a target font;
and the display unit is used for displaying the target character information in the target font on the image information according to the font conversion instruction and the target character information indicated by the target character.
Optionally, the processing unit is further configured to: removing the target characters in the image information;
the display unit is further configured to: and displaying the target character information in the target font at the position corresponding to the target character in the image information according to the font conversion instruction and the target character information indicated by the target character.
Optionally, the receiving unit is further configured to: receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;
the display unit is further configured to: and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.
Optionally, the AR device further comprises:
the sending unit is used for sending a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request;
the receiving unit is further configured to: and receiving and displaying the retrieval result.
Optionally, the keyword further includes location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.
In the above invention, when it is detected that the image information of the current scene includes a character, the AR device identifies the character information referred by the character; receiving a font conversion instruction aiming at a target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into a target font; and according to the font conversion instruction and the target character information indicated by the target characters, the target character information is displayed on the image information in the target font, so that the font conversion of the characters contained in the image information can be realized, a user can be helped to more clearly identify the characters in the image information, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a system architecture diagram of a communication system according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of an information display method according to an embodiment of the present invention;
FIG. 3 is a block diagram illustrating an embodiment of a font conversion operation according to the present invention;
FIGS. 4A-4D are schematic diagrams illustrating steps in a method for displaying target text information according to an embodiment of the present invention;
FIG. 5 is a block diagram illustrating an embodiment of a font size setting operation according to the present invention;
fig. 6 is a schematic structural diagram of a search result display interface according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an AR device according to an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of another AR device provided in an embodiment of the present invention;
fig. 9 is a schematic structural diagram of another AR device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
It is to be understood that the terminology used in the embodiments of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
Referring to fig. 1, fig. 1 is a system architecture diagram of a communication system according to an embodiment of the present invention. The communication system may include an Augmented Reality (AR) device 11, a mobile terminal 12, a server 13, and the like, where the AR device 11 may have a communication function to establish a communication connection with the mobile terminal 12 or the server 13. It should be understood that the information display method according to the present invention may be implemented based on the AR device 11, may also be implemented based on a communication system formed by the AR device 11 and the server 13, and may also be implemented based on the communication system shown in fig. 1.
The AR device 11 may comprise at least one image sensor, such as a camera, for obtaining image information of the current scene, the AR device 11 may be smart glasses, a smartphone, a tablet computer, etc., and may be arranged to communicate according to one or more other types of wireless communication (e.g., protocols). The wireless communication may include bluetooth, cellular technology, zigbee, nfc (near Field communication), and RFID (Radio Frequency Identification) communication, among others.
The mobile terminal 12 has a communication connection relationship with the AR device 11, may be a smart phone, a tablet computer, etc., and may include a wireless communication function to request information from a server.
Referring to fig. 2, fig. 2 is a schematic flow chart of an information display method according to an embodiment of the present invention. As shown in fig. 2, the information display method includes the steps of:
step S210: when detecting that the image information of the current scene comprises characters, identifying the character information referred by the characters.
Specifically, the AR device may acquire image information of a current scene through an image sensor, such as a camera, and detect whether the image information of the current scene contains characters, if so, the image information of the current scene contains characters, and identify character information referred by the characters; otherwise, the image information of the current scene does not contain characters, and the process can be ended.
The method for detecting whether the acquired image information of the current scene contains text information or not by the AR device and identifying the text information referred by the text may be: the AR device converts image information of the current scene into a gray-scale image, binarizes the gray-scale image, removes image noise and corrects inclination, further segments a plurality of characters included in the image information, matches the segmented characters with standard character templates, calculates the similarity degree between the segmented characters and each standard character template, takes character information corresponding to the standard character template with the maximum similarity degree as a recognition result, and detects that the acquired image information of the current scene includes character information.
Step S220: and receiving a font conversion instruction aiming at the target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into the target font.
Specifically, the target text in the image information may include all or part of the text in the image information. The font conversion instruction can be generated by the AR device according to the font conversion operation of receiving the user input aiming at the target characters in the image information; the AR device may also trigger the generated font conversion instruction after recognizing the text information indicated by the text in the image information, and specifically, the AR device may preset a target font for text display. Referring to fig. 3, fig. 3 is a schematic structural diagram of an embodiment of a font conversion operation according to an embodiment of the present invention. The font conversion operation may be a selection operation of selecting the target font "song body" in the font option pull-down menu 331 in the menu bar 33 after the user inputs the target font 321 "dutch moons" in the display interface of the image information 31 of the current scene. It is to be understood that the image information 31 of the current scene may include a plurality of texts 32 shown by dashed boxes, and the target text 321 may include all or part of the plurality of texts 32.
It is understood that font conversion includes a traditional conversion of a chinese font, a conversion of a font format, and the like.
Step S230: and displaying the target character information on the image information in the target font according to the font conversion instruction and the target character information indicated by the target character.
Specifically, the AR device may input target text information having a font that is a target font on the image information, and display the image information after the input target text information, and it can be understood that the input target text information may be displayed in a manner of covering the original target text.
In this embodiment of the present invention, one implementation manner of step S130 may be: the AR device may remove the target text from the image information, and further, display the target text information in the image information in the target font at a position corresponding to the target text according to the font conversion instruction and the text information indicated by the target text. Referring to fig. 4A to 4D, fig. 4A to 4D are schematic diagrams illustrating steps of a target text message display method according to an embodiment of the present invention. Specifically, fig. 4A is an interface diagram of image information of a target text before font conversion; the AR device may remove the target text in the image information, as shown in fig. 4B; further rendering the background color of the image information to the region from which the target character is removed, as shown in fig. 4C; displaying the target character information in the target font only for the position corresponding to the target character in the image information; as shown in fig. 4D.
In this embodiment of the present invention, after step S110, the information display method may further include: the AR equipment receives a word size setting instruction input aiming at a target character in the image information, wherein the word size setting instruction is used for setting the word size of the target character as a target word size; at this time, one implementation manner of step S130 may be: and displaying the target character information on the image information by the target font and the target font size according to the font conversion instruction, the font size setting instruction and the character information referred by the target character.
Specifically, the font size setting instruction may be generated by the AR device according to a font size setting operation received from a user for inputting a target character in the image information; the AR device may also trigger the generated font size setting instruction after recognizing the text information indicated by the text in the image information, and specifically, the AR device may preset a target font size of the text display. Referring to fig. 5, fig. 5 is a schematic structural diagram of an embodiment of a font size setting operation according to an embodiment of the present invention. The character size setting operation may be a selection operation in which the user displays a character 52 indicated by a dashed line box on the display interface of the image information 51 of the current scene and inputs the target character 521 "the moons of the lotus pool", and then the character size column 531 in the menu column 53 selects the target character size. And the AR equipment displays the target character information on the image information according to the target character font and the target character size according to the character font conversion instruction, the character size setting instruction and the target character information referred by the target character.
Optionally, after step S130, the information display method further includes: the AR equipment sends a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request; and the AR equipment receives and displays the retrieval result.
Specifically, the AR device may preset an application program, such as a browser, and input a keyword, that is, target text information, through a search engine window built in the browser to generate a search request, the AR device sends the search request to the server, and the server returns a search result to the AR device after receiving the search request. For example, the keyword is "the moons of the lotus pool", the AR device invokes the browser to input the "moons of the lotus pool" on the Baidu search interface to perform the search, the Baidu server may send the search result of the keyword "the moons of the lotus pool" to the AR device, and the AR device receives and displays the search result. Optionally, the search result may be information with the highest matching degree with the keyword in the searched information, please refer to fig. 6, where fig. 6 is a schematic structural diagram of a search result display interface provided in an embodiment of the present invention, and the AR device may display the search result on the target text information display interface. It is understood that the preset application may be a default application of the AR device or an application preset by the user.
It should be noted that the AR device may also send a search instruction including the keyword information to a mobile terminal in a communication connection state with the AR device, and the mobile terminal sends a search request to the server, so that the server sends a search result to the mobile terminal after receiving the search request, and then the mobile terminal sends the search result to the AR device.
Optionally, the keyword further includes location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information. The AR device may obtain a current position of the AR device through a Satellite Navigation System such as a GPS (Global Positioning System), a BDS (BeiDou Navigation Satellite System, BeiDou Satellite Navigation System), and the like, for example, the current position is "shanghai city nanjing west road 1", keywords retrieved by the AR device include "shanghai city nanjing west road 1" and "lotus pool moonlight", a retrieval request is sent to the server, and the server returns a retrieval result.
In the embodiment of the invention, when detecting that the image information of the current scene comprises characters, the AR equipment identifies the character information referred by the characters; receiving a font conversion instruction aiming at a target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into a target font; and according to the font conversion instruction and the target character information indicated by the target characters, the target character information is displayed on the image information in the target font, so that the font conversion of the characters contained in the image information can be realized, a user can be helped to more clearly identify the characters in the image information, and the user experience is improved.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an AR device according to an embodiment of the present invention. The AR device may include as illustrated in fig. 8: a processing unit 710, a receiving unit 720, and a display unit 730, wherein,
a processing unit 710, configured to, when it is detected that the image information of the current scene includes a character, identify character information referred to by the character;
a receiving unit 720, configured to receive a font conversion instruction for a target text in the image information, where the font conversion instruction is used to instruct to convert a font of the target text in the image information into a target font;
the display unit 730 is configured to display the target text information in the target font on the image information according to the font conversion instruction and the target text information indicated by the target text.
Optionally, the processing unit 710 is further configured to: removing the target characters in the image information;
the display unit 730 is further configured to: and displaying the target character information in the target font at the position corresponding to the target character in the image information according to the font conversion instruction and the target character information indicated by the target character.
Optionally, the receiving unit 720 is further configured to: receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;
the display unit 730 is further configured to: and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.
Optionally, referring to fig. 8, fig. 8 is a schematic structural diagram of another AR device according to an embodiment of the present invention, where the AR device shown in fig. 8 may further include, in addition to the units shown in fig. 7:
a sending unit 740, configured to send a search request to a server by using the target text information as a keyword, so that the server returns a search result after receiving the search request;
the receiving unit 720 is further configured to: and receiving and displaying the retrieval result.
Optionally, the keyword further includes location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.
It should be noted that, in the AR device in each embodiment of the present invention, the functions of the processing unit 710, the receiving unit 720, the displaying unit 730, and the sending unit 740 may be specifically implemented according to the method in the foregoing method embodiment, and a specific implementation process thereof may refer to the related description of the foregoing method embodiment, which is not described herein again.
Referring to fig. 9, fig. 9 is a schematic structural diagram of another AR device according to an embodiment of the present invention. The AR device is adapted to cooperate to implement the above-described scheme. The AR apparatus provided in the embodiment of the present invention may be used to implement the method implemented in the embodiments of the present invention shown in fig. 2, and for convenience of description, only the portions related to the embodiments of the present invention are shown, and details of the specific technology are not disclosed, please refer to the embodiments of the present invention shown in fig. 2. Wherein, the AR device shown in fig. 9 may include: the processor 901, and a memory 902, an input module 903, an output module 904, and a communication module 905 connected to the processor 901, for example, the processor 901 may be connected to the memory 902, the input module 903, the output module 904, and the communication module 905, and the like, through a bus 906.
The input module 903 is used to enable interaction of a user with the AR device and/or input of information into the AR device. For example, the input module 903 may receive numeric or character information input by a user to generate a signal input related to a user setting or function control. In the embodiment of the present invention, the input module 903 may be a touch panel, other human-computer interface, such as an entity input key, a microphone, or other external information capturing device, such as a camera. A touch panel, also referred to as a touch screen or touch screen, may collect an operation action on which a user touches or approaches. For example, the user uses any suitable object or accessory such as a finger, a stylus, etc. to operate on or near the touch panel, and drives the corresponding connection device according to a preset program.
The output module 904 may include, but is not limited to, an image output unit, a sound output unit, and a tactile output unit. The image output unit is used for outputting characters, pictures and/or videos. The image output unit may include a display panel, and although the input module 903 and the output module 904 are shown as two separate components in fig. 9 to implement the input and output functions of the mobile terminal, in some embodiments, a touch panel may be integrated with the display panel to implement the input and output functions of the mobile terminal.
The memory 902 may be used to store software programs and modules, and the processor 901 executes various functional applications of the AR device and implements data processing by operating the software programs and modules stored in the memory 902. The memory 902 mainly includes a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, such as a sound playing program, an image playing program, and the like; the data storage area may store data (such as audio data, a phonebook, etc.) created according to the use of the mobile terminal, and the like. In an embodiment of the invention, the Memory 902 may include a volatile Memory, such as a Nonvolatile dynamic random access Memory (NVRAM), a Phase Change random access Memory (PRAM), a Magnetoresistive Random Access Memory (MRAM), and a non-volatile Memory, such as at least one magnetic disk Memory device, an Electrically Erasable programmable read-only Memory (EEPROM), a flash Memory device, such as a flash Memory (NOR) or a flash Memory (NAND) or a flash Memory.
The communication module 905 is configured to establish a communication channel, so that the AR device is connected to a communication peer through the communication channel, and interacts data with the communication peer through the communication channel. The Communication module 905 may include a Wireless Local Area Network (Wireless LAN) module, a bluetooth module, Near Field Communication (NFC) module, a baseband (Base Band) module, and other Wireless Communication modules, and a wired Communication module such as an ethernet, a Universal Serial Bus (USB) module, a Lightning interface (Lightning, currently Apple is used for iPhone5/5s/5c, and other devices.
The processor 901 is a control center of the AR device, connects various parts of the whole AR device using various interfaces and lines, and performs the following operations by running or executing software programs and/or modules stored in the memory 902 and calling data stored in the memory 902:
when detecting that the image information of the current scene comprises characters, identifying the character information referred by the characters;
receiving a font conversion instruction for a target character in the image information through an input module 903, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into a target font;
and displaying the target character information in the target font on the image information through an output module 904 according to the font conversion instruction and the target character information indicated by the target character.
Optionally, the processor 901 is further configured to perform:
removing the target characters in the image information;
the processor 901 executes the character information indicated by the font conversion instruction and the target character, and displaying the target character information in the target font on the image information through the output module 904 includes:
and displaying the target character information in the target font at the position corresponding to the target character in the image information through an output module 904 according to the font conversion instruction and the target character information indicated by the target character.
Optionally, after the processor 901 performs the identification of the character information to which the character refers when the image information of the current scene is detected to include the character, the processor 901 is further configured to perform:
receiving a word size setting instruction input aiming at a target character in the image information through an input module 903, wherein the word size setting instruction is used for setting the word size of the target character as a target word size;
the processor 901 executes the character information indicated by the font conversion instruction and the target character, and displaying the target character information in the target font on the image information through the output module 904 includes:
and displaying the target character information on the image information by the target font and the target font size through an output module 904 according to the font conversion instruction, the font size setting instruction and the target character information indicated by the target character.
Optionally, after the processor 901 executes the text information referred by the font conversion instruction and the target text, and the target text information is displayed in the target font on the image information through the output module 904, the processor 901 is further configured to:
sending a retrieval request to a server through a communication module 905 by taking the target text information as a keyword so that the server returns a retrieval result after receiving the retrieval request;
the search result is received and displayed through the communication module 905.
Optionally, the keyword further includes location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. An information display method applied to an AR device including an image sensor, the method comprising:
acquiring image information of a current scene through the image sensor, and detecting whether the image information of the current scene comprises characters or not;
when detecting that the image information of the current scene comprises characters, identifying the character information referred by the characters;
receiving a font conversion instruction for a target character in the image information, wherein the font conversion instruction is used for indicating that the font of the target character in the image information is converted into the target font, the font conversion comprises simplified conversion of the Chinese font, the character conversion instruction is generated by receiving a font conversion operation input by a user for the target character in the image information, or the character conversion instruction is generated by triggering after the AR equipment identifies character information referred by the character in the image information;
the target characters are all or part of the characters included in the image information, and the font conversion operation comprises the operation of selecting the target characters by a user in a display interface of the image information of the current scene and a target font in a font option pull-down menu in a menu bar;
displaying the target character information in the target font on the image information according to the font conversion instruction and the target character information referred by the target character, including: removing the target characters in the image information; rendering the background color of the image information to the region from which the target characters are removed; and displaying the target character information in the position corresponding to the target character in the image information by using the target font.
2. The method according to claim 1, wherein after identifying the text information to which the text refers when it is detected that the image information of the current scene includes the text, the method further comprises:
receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;
the displaying the target character information on the image information in the target font according to the font conversion instruction and the character information referred by the target character comprises:
and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.
3. The method according to claim 1, wherein after displaying the target text information in the target font on the image information according to the font conversion instruction and the text information to which the target text refers, the method further comprises:
sending a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request;
and receiving and displaying the retrieval result.
4. The method of claim 3, wherein the keywords further comprise location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.
5. An AR device, the AR device comprising an image sensor, comprising:
the processing unit is used for acquiring image information of a current scene through the image sensor, detecting whether characters are included in the image information of the current scene or not, and identifying character information indicated by the characters when the fact that the image information of the current scene includes the characters is detected;
a receiving unit, configured to receive a font conversion instruction for a target character in the image information, where the font conversion instruction is used to instruct to convert a font of the target character in the image information into the target font, where the font conversion includes a simplified conversion of a Chinese font, and the text conversion instruction is generated by receiving a font conversion operation input by a user for the target character in the image information, or is generated by triggering, by the AR device, text information indicated by the character in the image information after being identified;
the target characters are all or part of the characters included in the image information, and the font conversion operation comprises the operation of selecting the target characters by a user in a display interface of the image information of the current scene and a target font in a font option pull-down menu in a menu bar;
a display unit, configured to display, according to the font conversion instruction and target text information referred by the target text, the target text information in the target font on the image information, where the display unit includes: removing the target characters in the image information; rendering the background color of the image information to the region from which the target characters are removed; and displaying the target character information in the position corresponding to the target character in the image information by using the target font.
6. The AR device of claim 5,
the processing unit is further to: removing the target characters in the image information;
the display unit is further configured to: and displaying the target character information in the target font at the position corresponding to the target character in the image information according to the font conversion instruction and the target character information indicated by the target character.
7. The AR device of claim 5,
the receiving unit is further configured to: receiving a word size setting instruction input aiming at a target word in the image information, wherein the word size setting instruction is used for setting the word size of the target word as a target word size;
the display unit is further configured to: and displaying the target character information on the image information according to the target font and the target character size according to the font conversion instruction, the character size setting instruction and the target character information referred by the target character.
8. The AR device of claim 5, wherein the AR device further comprises:
the sending unit is used for sending a retrieval request to a server by taking the target character information as a keyword so that the server returns a retrieval result after receiving the retrieval request;
the receiving unit is further configured to: and receiving and displaying the retrieval result.
9. The AR device of claim 8, wherein the keyword further comprises location information; the position information is the acquired current position; and the retrieval result is the information with the highest matching degree with the keyword in the retrieved information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611123080.5A CN106650727B (en) | 2016-12-08 | 2016-12-08 | Information display method and AR equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611123080.5A CN106650727B (en) | 2016-12-08 | 2016-12-08 | Information display method and AR equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106650727A CN106650727A (en) | 2017-05-10 |
| CN106650727B true CN106650727B (en) | 2020-12-18 |
Family
ID=58819320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611123080.5A Active CN106650727B (en) | 2016-12-08 | 2016-12-08 | Information display method and AR equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106650727B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110019906B (en) * | 2017-11-22 | 2022-07-08 | 百度在线网络技术（北京）有限公司 | Method and apparatus for displaying information |
| CN112328628A (en) * | 2020-11-10 | 2021-02-05 | 山东爱城市网信息技术有限公司 | Bus real-time query method and system based on AR technology |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101057247A (en) * | 2004-11-15 | 2007-10-17 | 皇家飞利浦电子股份有限公司 | Detection and modification of text in a image |
| CN103488630A (en) * | 2013-09-29 | 2014-01-01 | 小米科技有限责任公司 | Method, device and terminal for processing picture |
| CN105631051A (en) * | 2016-02-29 | 2016-06-01 | 华南理工大学 | Character recognition based mobile augmented reality reading method and reading system thereof |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7382919B2 (en) * | 2006-06-22 | 2008-06-03 | Xerox Corporation | System and method for editing image data |
| US8144990B2 (en) * | 2007-03-22 | 2012-03-27 | Sony Ericsson Mobile Communications Ab | Translation and display of text in picture |
| CN102880595A (en) * | 2012-08-22 | 2013-01-16 | 东莞宇龙通信科技有限公司 | System and method for providing online reading |
-
2016
- 2016-12-08 CN CN201611123080.5A patent/CN106650727B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101057247A (en) * | 2004-11-15 | 2007-10-17 | 皇家飞利浦电子股份有限公司 | Detection and modification of text in a image |
| CN103488630A (en) * | 2013-09-29 | 2014-01-01 | 小米科技有限责任公司 | Method, device and terminal for processing picture |
| CN105631051A (en) * | 2016-02-29 | 2016-06-01 | 华南理工大学 | Character recognition based mobile augmented reality reading method and reading system thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106650727A (en) | 2017-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230152962A1 (en) | Techniques for image-based search using touch controls | |
| CN108496150B (en) | Screen capture and reading method and terminal | |
| CN110582078B (en) | Bluetooth pairing method and device, storage medium and electronic equipment | |
| CN106484266B (en) | Text processing method and device | |
| WO2019233212A1 (en) | Text identification method and device, mobile terminal, and storage medium | |
| US9641471B2 (en) | Electronic device, and method and computer-readable recording medium for displaying message in electronic device | |
| US11705120B2 (en) | Electronic device for providing graphic data based on voice and operating method thereof | |
| US12039791B2 (en) | Image processing method, and electronic device supporting same | |
| US20150149925A1 (en) | Emoticon generation using user images and gestures | |
| US20200402040A1 (en) | Data processing method, terminal device and data processing system | |
| WO2019105457A1 (en) | Image processing method, computer device and computer readable storage medium | |
| US9600467B2 (en) | Display apparatus and character correcting method thereof | |
| CN108958576B (en) | Content identification method and device and mobile terminal | |
| JP2021034003A (en) | Human object recognition method, apparatus, electronic device, storage medium, and program | |
| CN111709414A (en) | AR device, character recognition method and device thereof, and computer-readable storage medium | |
| US20140267384A1 (en) | Display apparatus and control method thereof | |
| CN110795007A (en) | Method and device for acquiring screenshot information | |
| CN112236767A (en) | Electronic device and method for providing information related to an image to an application through an input unit | |
| CN106650727B (en) | Information display method and AR equipment | |
| CN106200942A (en) | Information processing method and electronic equipment | |
| WO2014201953A1 (en) | Methods, apparatus, and terminal devices of image processing | |
| CN105446629A (en) | Content pane switching method, device and terminal | |
| CN110377914B (en) | Character recognition method, device and storage medium | |
| CN107479808A (en) | The generation method and electronic equipment of finger rotation angle value | |
| CN106469310B (en) | Method and device for extracting characters in picture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |