US20200042581A1 - Method and Device for Quickly Inserting Recognized Word - Google Patents

Method and Device for Quickly Inserting Recognized Word Download PDF

Info

Publication number
US20200042581A1
US20200042581A1 US16/496,080 US201816496080A US2020042581A1 US 20200042581 A1 US20200042581 A1 US 20200042581A1 US 201816496080 A US201816496080 A US 201816496080A US 2020042581 A1 US2020042581 A1 US 2020042581A1
Authority
US
United States
Prior art keywords
picture
word
required word
camera
document
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/496,080
Other languages
English (en)
Inventor
Yuejian Ou
Zhijun Huang
Yanping Gao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kingsoft Office Software Inc
Zhuhai Kingsoft Office Software Co Ltd
Guangzhou Kingsoft Mobile Technology Co Ltd
Original Assignee
Beijing Kingsoft Office Software Inc
Zhuhai Kingsoft Office Software Co Ltd
Guangzhou Kingsoft Mobile Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kingsoft Office Software Inc, Zhuhai Kingsoft Office Software Co Ltd, Guangzhou Kingsoft Mobile Technology Co Ltd filed Critical Beijing Kingsoft Office Software Inc
Assigned to ZHUHAI KINGSOFT OFFICE SOFTWARE CO., LTD., GUANGZHOU KINGSOFT MOBILE TECHNOLOGY CO., LTD., BEIJING KINGSOFT OFFICE SOFTWARE, INC. reassignment ZHUHAI KINGSOFT OFFICE SOFTWARE CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GAO, YANPING, HUANG, ZHIJUN, OU, Yuejian
Publication of US20200042581A1 publication Critical patent/US20200042581A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G06F17/24—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06K9/00442—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/14—Image acquisition
    • G06V30/148—Segmentation of character regions
    • G06V30/153—Segmentation of character regions using recognition of characters or words
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/22—Character recognition characterised by the type of writing
    • G06V30/226—Character recognition characterised by the type of writing of cursive writing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40—Document-oriented image-based pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition

Definitions

  • the present application relates to the field of electronic document editing, in particular to a method and apparatus for quickly inserting the recognized word.
  • a user edits a document using document editing software in a terminal device such as a computer and a mobile phone
  • the user sometimes is intended to insert some non-replicable texts from an external carrier into the document, such as words in a picture, words in a video, words in a non-replicable electronic document and so on.
  • the carrier is converted from a non-picture format into a picture format with format conversion software, then another existing picture recognition program is used to recognize words in the picture, and the recognized words are copied into a to-be-edited document.
  • the object of the embodiment of the present application is to provide a method and a device for quickly inserting a recognized word, so as to improve work efficiency.
  • the specific technical solutions are as follows:
  • An embodiment of the present application discloses a method and a device for quickly inserting a recognized word.
  • the method comprises:
  • the picture acquisition instruction comprises:
  • acquiring a picture containing a required word according to the picture acquisition instruction comprises:
  • acquiring a screenshot range comprises:
  • the picture acquisition instruction comprises:
  • acquiring a picture containing a required word according to the picture acquisition instruction from a user comprises:
  • moving the required word into the to-be-edited document comprises:
  • An embodiment of the present application further discloses an apparatus for quickly inserting a recognized word.
  • the apparatus comprises:
  • an opening module configured for opening a to-be-edited document
  • an instruction acquisition module configured for acquiring a picture acquisition instruction from a user
  • a picture acquisition module configured for acquiring a picture containing a required word according to the picture acquisition instruction
  • a recognition module configured for recognizing the required word in the picture in the first document editing software
  • a word moving module configured for moving the required word into the to-be-edited document.
  • the picture acquisition instruction comprises:
  • the picture acquisition module comprises:
  • a screenshot range acquisition submodule configured for acquiring a screenshot range according to the picture acquisition instruction when the picture acquisition instruction is an instruction to acquire a picture by screenshot, wherein the screenshot range contains the required word;
  • a screenshot submodule configured for capturing a picture in the screenshot range.
  • the screenshot range acquisition submodule is specifically configured for:
  • the picture acquisition instruction comprises:
  • the picture acquisition module comprises:
  • a camera activation submodule configured for activating the camera and confirming that a visible capturing area of the camera contains the required word when the picture acquisition instruction is an instruction to acquire a picture by a camera;
  • a picture capturing submodule configured for capturing a picture for the visible capturing area of the camera.
  • the word moving module is specifically configured for:
  • An embodiment of the present application further discloses an electronic device, which comprises a processor and a memory.
  • the memory is configured for storing a computer program
  • the processor is configured for preforming any of the above method for quickly inserting a recognized word when executing the program stored on the memory.
  • An embodiment of the present application further discloses a computer readable storage medium, in which a computer program is stored.
  • the computer program is configured for performing any of the above methods for quickly inserting a recognized word when executed by a processor.
  • An embodiment of the present application further discloses an executable program code which is operated to perform any of the above methods for quickly inserting a recognized word.
  • the method and device for quickly inserting a recognized word provided by the embodiment of the present application are applied when non-replicable required words need to be inserted from an external carrier.
  • a picture acquisition instruction of a user is acquired.
  • a picture containing a required word according to the picture acquisition instruction is acquired.
  • the required word in the picture is recognized in the first document editing software.
  • the required word is added into the to-be-edited document.
  • the picture containing the required word can be acquired when editing a document in the first document editing software, and the required word in the picture can be recognized and automatically inserted into the to-be-edited document.
  • a recognized word is automatically inserted merely using first document editing software, which improves work efficiency compared to the prior art in which multiple software and programs are needed and a required word is manually copied, or the prior art in which a recognized word is inserted through manual typing.
  • FIG. 1 is a schematic flowchart of a method for quickly inserting a recognized word according to an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a picture containing required words according to an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of an example based on the method shown in FIG. 1 .
  • FIG. 4 is a schematic flowchart of another example based on the method shown in FIG. 1 .
  • FIG. 5 is a schematic structural diagram of a device for quickly inserting a recognized word according to an embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of an example based on the device shown in FIG. 5 .
  • FIG. 7 is a schematic structural diagram of another example based on the device shown in FIG. 5 .
  • FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • An embodiment of the present application provides a method and apparatus for quickly inserting a recognized word, which can improve work efficiency.
  • the method according to an embodiment of the present application comprises: acquiring a picture acquisition instruction from a user, acquiring a picture containing a required word, recognizing the required word in the picture by using a first document editing software, and adding the required word into a to-be-edited document in the first document editing software. It can be seen that, in the embodiment of the present application, a recognized word is automatically inserted by only using a first document editing software, which improves work efficiency compared to the prior art in which multiple software and programs are used and the required word are required to be copied manually, or in which the recognized word is inserted through manual typing.
  • FIG. 1 a flowchart of a method for quickly inserting a recognized word according to an embodiment of the present application. The method comprises the following steps:
  • Step 101 opening a to-be-edited document.
  • the embodiment of the present application is performed by a processor of a terminal device.
  • the terminal device comprises a computer, a mobile phone, a tablet, a device capable of editing an electronic document, and the like.
  • a document can be opened by a first document editing software as a to-be-edited document. Otherwise, step 101 is not performed.
  • the first document editing software is installed in a terminal device for editing electronic documents, such as WPS Office. All of the steps in the embodiment of the present application can be implemented in the first document editing software. Alternatively, steps 102 - 103 can also be implemented by other software.
  • the first document editing software in the embodiment of the present application may comprise a screenshot function and a picture recognition function.
  • the first document editing software can be integrated with a screenshot program, through which an image in a selected area can be captured.
  • the first document editing software can be further integrated with a picture recognition program, through which the word in a picture can be recognized.
  • Step 102 acquiring a picture acquisition instruction from a user.
  • the picture acquisition instruction is an instruction that indicates one of the ways of acquiring pictures selected by the user.
  • a user selection window can be pre-established in the first document editing software. In the user selection window, a variety of options for the ways of acquiring pictures are provided for the user to select, and then a user's click operation on the options for the ways of acquiring pictures is acquired.
  • steps 101 and 102 in the embodiment of the present application may be performed in no particular order. That is to say, in an embodiment of the present application, opening a to-be-edited document can be performed before acquiring a picture acquisition instruction from a user by using a first document editing software, which normally applies for a scenario where it is required to edit a to-be-edited document at first and then acquire a required word.
  • opening a to-be-edited document can be performed after acquiring a picture acquisition instruction from a user by using a first document editing software, which normally applies for a scenario where a carrier of a required word is known and it is required to acquire a required word at first.
  • a carrier of a required word is known and it is required to acquire a required word at first.
  • multiple to-be-edited documents can be opened to insert the required word into multiple to-be-edited documents.
  • the order of steps 101 and 102 in the embodiment of the present application are determined according to user's usage habits or specific usage scenarios
  • Step 103 acquiring a picture containing a required word according to the picture acquisition instruction.
  • the picture acquisition instruction in the embodiment of the present application is related to the carrier where the required word is located.
  • the required word is a word that the user actually intends to insert into a to-be-edited document.
  • the required word may exist in an existing electronic carrier, such as a picture, a video, non-replicable electronic document, and so on.
  • the picture acquisition instruction can be an instruction for acquiring a picture by screenshot.
  • a screenshot range can be determined according to the instruction, and a picture containing the required word can be captured from the currently displayed electronic carrier according to the screenshot range.
  • the required word may also exist in an existing physical carrier external to the terminal device, such as a word in a paper book, a word in a wall poster, a word on a TV screen, etc.
  • the image acquisition instruction can be an instruction for acquiring a picture by a camera.
  • a camera is used to capture a picture of an physical carrier where a required word is located according to the instruction for acquiring a picture by a camera, so as to acquire a picture containing the required word.
  • a picture containing a required word can be acquired from a wide range of sources in the embodiment of the present application, which can be more universally used.
  • Step 104 recognizing the required word in the picture in the first document editing software.
  • the required word in the picture can be recognized by using a picture recognition program integrated in the first document editing software.
  • program interfaces can be provided in the first document editing software in advance to facilitate the interchangeable usage of multiple picture recognition programs.
  • Step 105 moving the required word into the to-be-edited document.
  • the step 105 may include adding the required word into the to-be-edited document in the first document editing software.
  • the recognized word can be added into the to-be-edited document at a preset fixed position, a random position, or a insertion position set by the user.
  • the word addition can be performed simultaneously with the picture recognition. That is to say, one word will be added into the to-be-edited document once it is recognized. This is helpful for a user to use or edit the recognized word as soon as possible.
  • the words are added as a whole after all the words are recognized. This is helpful to maintain the integrity of the required words, and is more suitable for a situation of using or editing the whole content of the required words.
  • a word in a picture can be added into a to-be-edited document in various specific ways such that the recognized word in the picture can be automatically inserted into the to-be-edited document, without any moving operation, such as manually copy, paste, drag and the like.
  • an embodiment of the present application provides a method for quickly inserting a recognized word.
  • a picture acquisition instruction is acquired from a user.
  • a picture containing the required word is acquired according to the picture acquisition instruction.
  • the required word in the picture is recognized in the first document editing software.
  • the required word is added into the to-be-edited document.
  • the picture containing the required word can be acquired when editing a document in the first document editing software, and the required word in the picture can be recognized and moved into the to-be-edited document, which enables to recognize the required word in the picture and automatically insert it into the to-be-edited document.
  • a recognized word is automatically inserted by only using a first document editing software, which improves work efficiency compared to the prior art in which multiple software and programs are needed and a required word is manually copied, or the prior art in which a recognized word is inserted through manual typing.
  • FIG. 2 is a picture containing a required word.
  • a PDF Portable Document Format
  • the user finds that some words are required words (referring to the words in the box in FIG. 2 ), and intends to insert the required words into the to-be-edited document.
  • This process needs to open document editing software, format conversion software or program, and picture recognition software or program. After recognizing all the words in the picture, the user needs to manually select and copy the required word, which lead to lower work efficiency. If other solutions in the prior art are adopted, the user is required to type manually to acquire the required words in the box, which leads to lower work efficiency.
  • a picture acquisition instruction can be acquired from the user when editing a document by using the first document editing software.
  • a plurality of options can be provided to the user in the first document editing software, and these options can correspond to various picture acquisition methods, such as acquiring pictures by screenshot or by using a camera, or the like.
  • the picture acquisition method selected by the user is determined based on the user's click operation on the plurality of options, and the picture containing the required words is acquired according to the picture acquisition method selected by the user.
  • a picture of the box portion in the PDF document is acquired by using a screenshot program integrated in the first document editing software. For example, if the user uses a mouse to select words in the box of FIG. 2 , a screenshot range is determined to include the box portion according to the user's operation. A picture containing the words in the box portion in FIG. 2 is acquired by screenshot according to this screenshot range. Then, the required words in this picture are recognized by using a picture recognition program integrated in the first document editing software, that is, the words in the box are recognized. Finally, the required words are added into the to-be-edited document. In the embodiment of the present application, the whole process is completed by only using the first document editing software, and the words in the picture are automatically recognized and inserted, which can improve work efficiency.
  • FIG. 3 is a flow chart of an example of a method shown in FIG. 1 .
  • the method comprises the following steps:
  • Step 301 opening a to-be-edited document.
  • a document can be opened by a first document editing software as a to-be-edited document. Otherwise, step 301 is not performed.
  • the first document editing software is used to open a to-be-edited document.
  • the terminal device receives from a user an instruction to open a document, such as the user's click operation on the icon of the first document editing software, the user's click operation on the icon of the to-be-edited document, the user's voice operation instructions.
  • the processor of the terminal device opens a to-be-edited document according to the instruction to open a document.
  • the processor of the terminal device opens the first document editing software, and then receives an instruction for the user to select a document. For example, after acquiring the user's selection for a document, and the document is opened as a to-be-edited document.
  • the processor of the terminal device opens the to-be-edited document by using the first document editing software, and the like.
  • the processor of the terminal device finds the document with the name “file 1 ”, and uses the first document editing software to open this document as the to-be-edited document, and the like.
  • Step 302 acquiring from the user an instruction for acquiring a picture by screenshot.
  • an option can be provided to the user in a user selection window preset in the first document editing software, so that the user can select to acquire a picture by screenshot.
  • This option can be located in the option window in the toolbar of the first document editing software or in a user dialogue window outside the toolbar of the first document editing software.
  • steps 301 and 302 in the embodiment of the present application may be performed in no particular order. That is to say, in an embodiment of the present application, opening a to-be-edited document can be performed by using the first document editing software before acquiring a user's picture acquisition instruction by screenshot. Alternatively, opening a to-be-edited document can be performed after acquiring a user's picture acquisition instruction by screenshot using the first document editing software. The order of these two steps are determined according to user's usage habits or specific usage scenarios.
  • Step 303 acquiring a screenshot range.
  • the screenshot range can be determined according to the picture acquisition instruction in step 303 .
  • the method corresponding to the type of the terminal device is used for acquiring a screenshot range.
  • the picture range selected by the mouse box is acquired as the screenshot range, i.e., the range of screenshot.
  • a mouse is used in a desktop computer.
  • the picture range selected by the mouse box is acquired as the screenshot range, i.e., the range of screenshot.
  • the screenshot range contains the required word.
  • the picture range selected by the mouse box can be a trajectory area formed by arbitrary dragging of the mouse on the electronic carrier containing the required word. This range can be rectangular, circular or arbitrary irregular shape, etc. Taking FIG. 2 as an example, a rectangular area (i.e., a rectangular box in FIG. 2 ) formed by the mouse's continuous click-and-drag operation on the PDF document can be acquired as the screenshot range, i.e., the range of screenshot.
  • the shape of the mouse box can also be preset as for example rectangle. That is to say, when a user drags the mouse, rectangular boxes of different sizes will appear. The user is only required to adjust and select the size of the rectangular box such that the required word can be contained in the box. This makes it easy to unify the criteria of the screenshot range because the screenshot can be more easily and efficiently performed when the box is in a regular form.
  • the thickness and color of the mouse box can also be preset. The thickness and color of the mouse box can be selected according to the user's usage habits or the background color of the electronic carrier, so as to be easily perceivable and easy to observe, which is convenient for the user to use.
  • the embodiment of the present application can also provide a confirmation process after acquiring the picture range selected by the mouse box. For example, a user dialog window can be provided to prompt the user to confirm, so as to avoid the user's misoperation.
  • a picture range selected by the trajectory box on the touch screen is acquired as the screenshot range, i.e., the range of screenshot.
  • the screenshot range contains the required word.
  • the picture range selected by the trajectory box on the touch screen can be a trajectory area formed by arbitrary touch and dragging of a finger or another tool on the electronic carrier containing the required word. This range can be rectangular, circular or arbitrary irregular shape, etc. Taking FIG. 2 as an example, a rectangular area (e.g., a rectangular box in FIG.
  • the picture range selected by the trajectory box on the touch screen is generally not in a regular shape, but in an embodiment of the present application, the shape of trajectory box on the touch screen can also be preset as a regular shape, such as a rectangle, a circle. That is to say, the acquired irregular trajectory box selected by the user will be transformed into a regular shape which matches with the irregular trajectory box best.
  • the shape of a user's trajectory box on the touch screen is irregular, a box of a preset regular shape (e.g., a rectangle) which contains the required word is found based on the required word contained in the user's trajectory box.
  • the thickness and color of the trajectory box on the touch screen can also be preset.
  • the thickness and color of the trajectory box on the touch screen can be selected according to the user's usage habits or the background color of the electronic carrier so as to be easily perceivable and easy to observe, which is convenient for the user to use.
  • the embodiment of the present application can also provide a confirmation process after acquiring the picture range selected by the trajectory box on the touch screen. For example, a user dialog window can be provided to prompt the user to confirm, so as to avoid the user's misoperation.
  • a picture of a whole screen can be taken by full-screen screenshot without the selection of the screenshot range, which is often applicable to a scenario where all the words in the whole picture need to be recognized as required words.
  • a corresponding full-screen screenshot mode can be set for a terminal device using a mouse or a touch screen, such as shortcut keys of full-screen screenshot for mobile phones, etc.
  • the screenshot range can be acquired directly for an existing electronic carrier containing a required word in a terminal device loaded with the first document editing software, or for an electronic carrier that is obtained from a terminal device external to the terminal device loaded with the first document editing software by means of Bluetooth transmission, Internet and other means.
  • a screenshot can be performed directly on an electronic carrier containing a required word in a terminal device external to an electronic device loaded with the first document editing software by remote connection and control over the Internet, so as to acquire a picture containing a required word, and then the subsequent steps are carried out to recognize and move the required word into the to-be-edited document in the user terminal device at a position to be inserted.
  • the screenshot range can be acquired for various electronic carriers containing required words from various sources, and it is applicable to various terminal devices using mice or touch screens.
  • the method provided by the embodiment of the present application can be widely applied and is very practicable.
  • Step 304 capturing a picture for the screenshot range.
  • the step 304 may include capturing a picture containing a required word according to the screenshot range.
  • a screenshot program in the first document editing software is used to capture a picture containing a required word based on the screenshot range determined in step 303 .
  • a picture can be captured by full-screen screenshot.
  • Step 305 recognizing the required word in the picture in the first document editing software.
  • a picture recognition program in the first document editing software is used to recognize the required word in the picture.
  • Step 306 moving the required word into the to-be-edited document at a position to be inserted.
  • step 306 the required word can be added into a to-be-edited document in the first document editing software at a position to be inserted.
  • the acquired position to be inserted is a location of the mouse cursor. If the terminal device is a terminal device using a touch screen, the acquired position to be inserted is a location of the cursor on the touch screen.
  • An embodiment of the application can also provide a confirmation process.
  • a user dialog window can be provided to prompt the user to confirm the position to be inserted and the like, so as to avoid the user's misoperation. Then, the required word is moved into the to-be-edited document at the position to be inserted.
  • the position to be inserted can be acquired after step 301 . That is to say, after a to-be-edited document is opened in step 301 , the position of a mouse cursor or the position of a cursor on the touch screen can be detected as the position to be inserted.
  • an embodiment of the present application can also provide a confirmation process after detection. For example, a user dialog window can be provided to prompt the user to confirm the position to be inserted, so as to avoid the user's misoperation. Then, the required word is directly moved into the to-be-edited document at the position to be inserted in step 306 .
  • an embodiment of the present application provides a method for quickly inserting a recognized word.
  • a user's picture acquisition instruction by screenshot is acquired.
  • a screenshot range is then acquired.
  • a picture in the screenshot range is captured.
  • a required word in the picture is recognized in first document editing software.
  • the required word is added into a to-be-edited document at a position to be inserted.
  • An embodiment of the present application is applicable to a variety of electronic carriers containing required words.
  • a picture containing a required word can be acquired by screenshot. The required word in the picture can be recognized, and can be automatically inserted into a to-be-edited document at a position to be inserted.
  • a recognized word is automatically inserted into a to-be-edited document at a position to be inserted merely using first document editing software, which improves work efficiency compared to the prior art in which multiple software and programs are needed and a required word is manually copied, or the prior art in which a recognized word is inserted through manual typing.
  • FIG. 4 is a flow chart of another example of a method shown in FIG. 1 .
  • the method comprises the following steps:
  • Step 401 opening a to-be-edited document.
  • a document may be opened by a first document editing software as a to-be-edited document. Otherwise, step 401 is not performed.
  • the first document editing software is used to open a to-be-edited document.
  • the terminal device receives from a user an instruction to open a document, such as the user's click operation on the icon of the first document editing software, the user's click operation on the icon of the to-be-edited document, the user's voice operation instructions.
  • the processor of the terminal device opens a to-be-edited document according to the instruction to open a document.
  • the processor of the terminal device first opens the first document editing software, and then receives an instruction for the user to select a document, such as acquiring the user's click operation on a document, and lastly opens the document as a to-be-edited document.
  • the processor of the terminal device opens the to-be-edited document by using the first document editing software.
  • the processor of the terminal device finds the document with the name “file 1 ”, and uses the first document editing software to open this document as the to-be-edited document.
  • Step 402 acquiring from the user an instruction for acquiring a picture by a camera.
  • an option can be provided to the user in a user selection window preset in the first document editing software, so that the user can select to obtain a picture by a camera.
  • This option can be located in the option window in the toolbar of the first document editing software or in a user dialogue window outside the toolbar of the first document editing software.
  • steps 401 and 402 in the embodiment of the present application may be performed in no particular order. That is to say, in the embodiment of the present application, opening a to-be-edited document can be performed by using the first document editing software before acquiring a user's picture acquisition instruction by a camera. Alternatively, opening a to-be-edited document can be performed after acquiring a user's picture acquisition instruction by a camera using the first document editing software. The order of these two steps are determined according to user's usage habits or specific usage scenarios.
  • Step 403 activating the camera and confirming that a visible capturing area of the camera contains a required word.
  • steps 403 and 404 a picture containing the required word is captured by the camera.
  • the camera in an embodiment of the present application may be a camera of a terminal device loaded with first document editing software, such as a camera of a user's computer, a camera of a mobile phone, etc., or a camera external to a terminal device loaded with first document editing software, such as a camera of the other user's computer or mobile phone, and a camera of a traffic monitoring system, a camera of a monitoring device in a corridor, etc.
  • first document editing software such as a camera of a user's computer, a camera of a mobile phone, etc.
  • a camera of a user terminal device can be activated.
  • another camera connected with the user terminal device can be activated by using the Internet, LAN, Bluetooth, etc.
  • the visible capturing area of the camera contains the required word as clear as possible, so as to facilitate subsequent picture capturing. If the required word is contained within the visible capturing area of the camera, or the required word is not clear enough to meet picture capturing requirements, the user can adjust the physical carrier containing the required word, or the camera. For example, the position of a paper book printed with the required word within the visible capturing area of the camera can be manually adjusted, or the parameter of the camera can be adjusted. The parameter comprises the distance from a paper book, the capturing angle of a camera, and the focal length of a camera and so on, until the required word is contained within the visible capturing area of the camera, or the required word is clear enough to meet picture capturing requirements.
  • a terminal device loaded with the first document editing software can also determine whether a current capturing area of a camera contains the required word. If so, the camera is controlled to capture a picture in the current capturing area so as to acquire a picture containing the required word. Otherwise, the position of the camera is adjusted, and the process returns to the step of determining whether the required word is contained in the current capturing area of the camera.
  • the camera can be adjusted by a terminal device loaded with the first document editing software, so that the camera can take a picture containing the required word.
  • Step 404 capturing a picture for the visible capturing area of the camera.
  • a picture of the capturing area of the camera can be captured by the camera of the user terminal device, or by another external camera connecting to the user terminal device via the Internet, LAN, Bluetooth, etc.
  • a monitoring camera in the corridor is connected to capture a picture of the visible capturing area of the camera and so on.
  • a picture can be taken by a camera for a variety of physical carriers containing required words, such as paper books, wall posters, billboards, etc.
  • the method provided by the embodiment of the present application uses a variety of physical carriers as the carrier containing required words, which can be widely applied and is very practicable.
  • Step 405 recognizing the required word in the picture in the first document editing software.
  • a picture recognition program in the first document editing software is used to recognize the required word in the picture.
  • Step 406 moving the required word into the to-be-edited document at a position to be inserted.
  • the step 406 may include adding the required word into a to-be-edited document in the first document editing software at a position to be inserted.
  • the acquired position to be inserted is a location of the mouse cursor.
  • the terminal device is a terminal device using a touch screen
  • the acquired position to be inserted is a location of the cursor on the touch screen.
  • An embodiment of the present application can also provide a confirmation process. For example, a user dialog window can be provided to prompt the user to confirm the position to be inserted and the like, so as to avoid the user's misoperation. The required word is moved into the to-be-edited document at the position to be inserted.
  • the position to be inserted can be acquired after step 401 . That is to say, after a to-be-edited document is opened in step 401 , the position of a mouse cursor or the position of a cursor on the touch screen can be detected as the position to be inserted.
  • an embodiment of the present application can also provide a confirmation process after detection. For example, a user dialog window can be provided to prompt the user to confirm the position to be inserted, so as to avoid the user's misoperation. Then, the required word is directly moved into the to-be-edited document at the position to be inserted in step 406 .
  • a device for quickly inserting a recognized word acquires a user's picture acquisition instruction by a camera. Then, a picture containing a required word is taken by the camera. A required word in the picture is recognized in first document editing software. Finally, the required word is added into a to-be-edited document at a position to be inserted.
  • the embodiment of the present application is applicable to a variety of physical carriers containing required words.
  • a recognized word is automatically inserted into a to-be-edited document at a position to be inserted merely using first document editing software, which improves work efficiency compared to the prior art in which multiple software and programs are needed and a required word is manually copied, or the prior art in which a recognized word is inserted through manual typing.
  • FIG. 5 is a structural diagram of an apparatus for quickly inserting a recognized word according to an embodiment of the present application.
  • the apparatus comprises:
  • an opening module 501 configured for opening a to-be-edited document
  • an instruction acquisition module 502 configured for acquiring a picture acquisition instruction from a user
  • a picture acquisition module 503 configured for acquiring a picture containing a required word according to the picture acquisition instruction
  • a recognition module 504 configured for recognizing the required word in the picture in the first document editing software
  • a word moving module 505 configured for moving the required word into the to-be-edited document.
  • the word moving module 505 is specifically configured for adding the required word into a to-be-edited document in the first document editing software.
  • the device for quickly inserting a recognized word provided by an embodiment of the present application firstly opens a to-be-edited document in first document editing software, then acquires a picture acquisition instruction of a user, acquires a picture containing the required word according to the picture acquisition instruction, and recognizes the required word in the picture in the first document editing software, and finally moves the required word into the to-be-edited document.
  • the picture containing the required word can be acquired when editing a document in the first document editing software, and the required word in the picture can be recognized and automatically inserted into the to-be-edited document.
  • a recognized word is automatically inserted merely using first document editing software, which is different from the prior art in which the opening of multiple software and programs and the manual copying of the required word are needed, or the prior art in which the recognized word are inserted through manual typing.
  • the device provided by the embodiment of the present application is a device applying the method for quickly inserting a recognized word described above, and all the embodiments of the method for quickly inserting a recognized word are applicable to this device and the achievable beneficial effects are the same or similar.
  • FIG. 6 is a preferred embodiment corresponding to the method shown in FIG. 3 based on FIG. 5 .
  • FIG. 6 is a structural diagram of an example based on the device shown in FIG. 5 , which comprises:
  • the picture acquisition instruction is an instruction to acquire a picture by screenshot
  • the picture acquisition module 603 comprises:
  • a screenshot range acquisition submodule 6031 configured for determining a screenshot range according to the picture acquisition instruction
  • a screenshot submodule 6032 configured for capturing a picture containing a required word according to the screenshot range.
  • the screenshot range acquisition submodule 6031 is specifically configured for:
  • the word moving module 605 is specifically configured for:
  • the device for quickly inserting a recognized word provided by an embodiment of the present application firstly opens a to-be-edited document in first document editing software, then acquires a user's picture acquisition instruction by screenshot, acquires a screenshot range, captures a picture in the screenshot range, and recognizes the required word in the picture in the first document editing software, and finally moves the required word into the to-be-edited document.
  • the embodiment of the present application is applicable to a variety of electronic carriers containing required words.
  • a picture containing a required word can be acquired by screenshot.
  • the required word in the picture can be recognized, and can be automatically inserted into a to-be-edited document at a position to be inserted.
  • a recognized word is automatically inserted into a to-be-edited document at a position to be inserted merely using first document editing software, which is different from the prior art in which multiple software and programs are needed and the manual selection of required words from the recognized words and the copying of the selected words into a to-be-edited document at positions to be inserted.
  • first document editing software which is different from the prior art in which multiple software and programs are needed and the manual selection of required words from the recognized words and the copying of the selected words into a to-be-edited document at positions to be inserted.
  • FIG. 7 is a preferred embodiment corresponding to the method shown in FIG. 4 based on FIG. 5 .
  • FIG. 7 is a structural diagram of another example based on the device shown in FIG. 5 , which comprises:
  • the picture acquisition instruction is:
  • the picture acquisition module 703 is specifically configured for capturing a picture containing a required word by a camera.
  • the picture acquisition module 703 is specifically configured for:
  • controlling the camera to capture a picture for the current capturing area so as to acquire a picture containing the required word
  • the word moving module 705 is specifically configured for:
  • the device for quickly inserting a recognized word provided by an embodiment of the present application firstly opens a to-be-edited document in first document editing software, and then acquires a user's picture acquisition instruction by a camera, activates the camera and confirms that an capturing area of the camera contains a required word, takes a picture in the capturing area of the camera, and recognizes the required word in the picture in the first document editing software, and finally moves the required word into the to-be-edited document.
  • the embodiment of the present application is applicable to a variety of physical carriers containing required words. When editing a document in first document editing software, a picture containing a required word can be acquired by a camera.
  • the required word in the picture can be recognized, and can be automatically inserted into a to-be-edited document at a position to be inserted.
  • a recognized word is automatically inserted into a to-be-edited document at a position to be inserted merely using first document editing software, which is different from the prior art in which multiple software and programs are needed and the manual selection of required words from the recognized words and the copying of the selected words into a to-be-edited document at positions to be inserted.
  • first document editing software which is different from the prior art in which multiple software and programs are needed and the manual selection of required words from the recognized words and the copying of the selected words into a to-be-edited document at positions to be inserted.
  • An embodiment of the present application also discloses an electronic device, as shown in FIG. 8 , which comprises a processor 801 and a memory 802 .
  • the memory 802 is configured for storing a computer program.
  • the processor 801 is configured for preforming any of the above methods for quickly inserting a recognized word when executing the program stored on the memory 802 .
  • An embodiment of the present application further discloses a computer readable storage medium, in which a computer program is stored.
  • the computer program is configured for performing any of the above methods for quickly inserting a recognized word when executed by a processor.
  • An embodiment of the present application further discloses an executable program code which is operated to perform any of the above methods for quickly inserting a recognized word.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Character Discrimination (AREA)
  • Character Input (AREA)
  • Document Processing Apparatus (AREA)
  • Processing Or Creating Images (AREA)
US16/496,080 2017-03-20 2018-03-19 Method and Device for Quickly Inserting Recognized Word Abandoned US20200042581A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201710165750.8A CN108628814A (zh) 2017-03-20 2017-03-20 一种快速插入识别文字的方法及装置
CN201710165750.8 2017-03-20
PCT/CN2018/079489 WO2018171560A1 (fr) 2017-03-20 2018-03-19 Procédé et dispositif d'insertion rapide de mot reconnu

Publications (1)

Publication Number Publication Date
US20200042581A1 true US20200042581A1 (en) 2020-02-06

Family

ID=63584165

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/496,080 Abandoned US20200042581A1 (en) 2017-03-20 2018-03-19 Method and Device for Quickly Inserting Recognized Word

Country Status (6)

Country Link
US (1) US20200042581A1 (fr)
EP (1) EP3605277A4 (fr)
JP (1) JP2020515996A (fr)
CN (1) CN108628814A (fr)
SG (1) SG11201908705WA (fr)
WO (1) WO2018171560A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113448461A (zh) * 2020-06-24 2021-09-28 北京新氧科技有限公司 信息处理方法、装置及设备

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109874051A (zh) * 2019-02-21 2019-06-11 百度在线网络技术（北京）有限公司 视频内容处理方法、装置及设备
CN110166621B (zh) * 2019-04-17 2020-09-15 维沃移动通信有限公司 一种文字处理方法及终端设备
CN110275667B (zh) * 2019-06-25 2021-12-17 努比亚技术有限公司 内容显示方法、移动终端及计算机可读存储介质
CN111611945A (zh) * 2020-05-25 2020-09-01 江西金格科技股份有限公司 一种通用的AutoCAD图框识别方法

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08329190A (ja) * 1995-03-24 1996-12-13 Fuji Xerox Co Ltd 文字認識装置
JP2001175572A (ja) * 1999-12-20 2001-06-29 Minolta Co Ltd 携帯電子メール端末および電子メール文書作成方法
JP2003331217A (ja) * 2002-03-08 2003-11-21 Nec Corp 文字入力装置、文字入力方法及び文字入力プログラム
EP1398726B1 (fr) * 2002-09-11 2008-07-30 Samsung Electronics Co., Ltd. Appareil et procédé de reconnaissance d'images de charactères à partir d'un écran
JP2005346628A (ja) * 2004-06-07 2005-12-15 Omron Corp 文字入力方法、文字入力装置、及びプログラム
CN1964413A (zh) * 2006-11-25 2007-05-16 王永顺 小型图书馆文字图像扫描摘录系统
CN101262513A (zh) * 2008-04-24 2008-09-10 陶建新 有微型扫描仪的拍照手机
US8373724B2 (en) * 2009-01-28 2013-02-12 Google Inc. Selective display of OCR'ed text and corresponding images from publications on a client device
JP2010205136A (ja) * 2009-03-05 2010-09-16 Fujitsu Ltd 音声読み上げ装置、携帯電話機及びコンピュータプログラム
JP2011248669A (ja) * 2010-05-27 2011-12-08 Ricoh Co Ltd 文書管理プログラム、記録媒体、情報処理装置、及び文書管理方法
CN101881999B (zh) * 2010-06-21 2012-11-21 安阳师范学院 甲骨文视频输入系统及实现方法
JP5554177B2 (ja) * 2010-08-17 2014-07-23 ヤフー株式会社 情報表示装置及び方法
JP6442336B2 (ja) * 2015-03-18 2018-12-19 セコム株式会社 異常検知端末及びプログラム
CN106156761B (zh) * 2016-08-10 2020-01-10 北京交通大学 面向移动终端拍摄的图像表格检测与识别方法
CN106445144A (zh) * 2016-09-27 2017-02-22 宇龙计算机通信科技(深圳)有限公司 一种笔记方法、装置及终端

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113448461A (zh) * 2020-06-24 2021-09-28 北京新氧科技有限公司 信息处理方法、装置及设备

Also Published As

Publication number Publication date
EP3605277A1 (fr) 2020-02-05
WO2018171560A1 (fr) 2018-09-27
EP3605277A4 (fr) 2020-04-01
JP2020515996A (ja) 2020-05-28
CN108628814A (zh) 2018-10-09
SG11201908705WA (en) 2019-10-30

Similar Documents

Publication Publication Date Title
US20200042581A1 (en) Method and Device for Quickly Inserting Recognized Word
US10146407B2 (en) Physical object detection and touchscreen interaction
JP7125834B2 (ja) 画像取得方法および装置
US20130152024A1 (en) Electronic device and page zooming method thereof
US20150277571A1 (en) User interface to capture a partial screen display responsive to a user gesture
US20090167882A1 (en) Electronic device and operation method thereof
CN108304132B (zh) 图形显示方法、装置、设备及存储介质
US10013156B2 (en) Information processing apparatus, information processing method, and computer-readable recording medium
WO2020211368A1 (fr) Procédé et appareil de surveillance d'interaction de fichiers de présentation, équipement terminal et support d'enregistrement
WO2020249044A1 (fr) Procédé de commutation de niveau de fenêtre, dispositif, équipement et support de stockage
JP2003303047A (ja) 画像入力及び表示システム、ユーザインタフェースの利用方法並びにコンピュータで使用可能な媒体を含む製品
KR20140030361A (ko) 휴대단말기의 문자 인식장치 및 방법
US10169892B2 (en) Method for generating digital content by combining photographs and text messages
CN108829686B (zh) 翻译信息显示方法、装置、设备及存储介质
US20140043255A1 (en) Electronic device and image zooming method thereof
WO2020042468A1 (fr) Procédé et dispositif de traitement de données, et dispositif permettant de traiter des données
US9509733B2 (en) Program, communication apparatus and control method
EP4329283A1 (fr) Procédé et appareil de traitement d'image, et dispositif et support de stockage
WO2023155885A1 (fr) Procédé et appareil d'agencement d'icônes et dispositif électronique
CN109388321B (zh) 电子白板的操作方法及装置
WO2023083158A1 (fr) Procédé de sélection de texte, appareil de sélection de texte et dispositif électronique
KR20150044540A (ko) 단말장치의 정보 리스트 처리장치 및 방법
CN103984462A (zh) 记录轨迹的方法及电子装置
WO2023216976A1 (fr) Procédé et appareil d'affichage, dispositif électronique et support de stockage
CN110908552B (zh) 多窗口操作控制方法、装置、设备及存储介质

Legal Events

Date Code Title Description
AS Assignment

Owner name: GUANGZHOU KINGSOFT MOBILE TECHNOLOGY CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OU, YUEJIAN;HUANG, ZHIJUN;GAO, YANPING;REEL/FRAME:050470/0971

Effective date: 20190918

Owner name: BEIJING KINGSOFT OFFICE SOFTWARE, INC., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OU, YUEJIAN;HUANG, ZHIJUN;GAO, YANPING;REEL/FRAME:050470/0971

Effective date: 20190918

Owner name: ZHUHAI KINGSOFT OFFICE SOFTWARE CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OU, YUEJIAN;HUANG, ZHIJUN;GAO, YANPING;REEL/FRAME:050470/0971

Effective date: 20190918

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION