CN112783467A - Wearable device screen capture control system and method - Google Patents

Wearable device screen capture control system and method Download PDF

Info

Publication number
CN112783467A
CN112783467A CN202011642290.1A CN202011642290A CN112783467A CN 112783467 A CN112783467 A CN 112783467A CN 202011642290 A CN202011642290 A CN 202011642290A CN 112783467 A CN112783467 A CN 112783467A
Authority
CN
China
Prior art keywords
screen capture
voice
screen
control instruction
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011642290.1A
Other languages
Chinese (zh)
Inventor
秦曙光
陈家峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Readboy Education Technology Co Ltd
Original Assignee
Readboy Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Readboy Education Technology Co Ltd filed Critical Readboy Education Technology Co Ltd
Priority to CN202011642290.1A priority Critical patent/CN112783467A/en
Publication of CN112783467A publication Critical patent/CN112783467A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The invention discloses a wearable device screen capture control system and method, which can effectively overcome the defects that a wearable device screen is small and touch screen capture is difficult to operate and realize by realizing screen capture in a voice recognition mode, and are simpler, more accurate and easier to operate. And the invention recognizes whether the voice print of the input voice command is the pre-stored user voice print when the screen is shot, which can ensure the safety of the telephone watch information and avoid the leakage.

Description

Wearable device screen capture control system and method
Technical Field
The invention relates to the technical field of wearable equipment, in particular to a screen capture control system and method of wearable equipment.
Background
At present, more and more users begin to use wearable devices such as smart bracelets, smart watches. In the process of using wearable equipment, the user often has the demand of screen capture, for example when the user wants to save the current meter step data of oneself or send to other terminals, adopt the screen capture operation just can realize the quick save and share of data.
In the prior art, the screen capture of the wearable device is similar to that of a mobile phone, namely, the screen capture is generally full screen capture, and if a user only wants to capture a certain part of a screen, namely, a local screen capture, the full screen capture can be only edited by other picture editing software. What is different from the cell-phone is that because the screen range of wearable equipment is limited, when the user carries out editing operations such as zoom, drag, tailor to the full-screen screenshot in narrow and small screen range, can have the inconvenient problem of operation, and produces the mistake very easily and touches.
Therefore, the flexibility and convenience of the screen capture of the existing wearable device are not high.
CN109885170A discloses a screen capture method, a wearable device and a computer readable storage medium, which provide a method for controlling screen capture according to non-contact gesture recognition, the method is simple and effective, but has limited operation instructions, and the scaling can only be performed according to the preset scale, and the scaling is not sensitive.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a wearable device screen capture control system and a wearable device screen capture control method.
In order to achieve the purpose, the invention adopts the following technical scheme:
a wearable device screen capture control system, comprising:
the voice acquisition and recognition module: the voice capturing module is used for capturing voice of a user, extracting voiceprint information of the captured voice and judging whether the voiceprint information is matched with prestored voiceprint information of the user, and if so, recognizing the voice, converting the voice into text and sending the text to the screen capturing control module;
the screen capture control module is used for judging the text content after receiving the text sent by the voice acquisition and recognition module, and if the text content belongs to a control instruction for triggering screen capture, capturing the current full screen interface of the screen of the wearable device as a first picture to be displayed on the screen, and displaying a screen capture frame on the first picture; if the text content belongs to the control instruction for adjusting the screen-cutting frame, on the premise that the first picture is intercepted, adjusting the screen-cutting frame and synchronously displaying the screen-cutting frame on a screen for a user to preview; and if the text content belongs to the control instruction for intercepting confirmation, correspondingly intercepting the first picture according to the current screen intercepting frame on the premise that the first picture is intercepted, and obtaining and storing the final screen intercepting picture.
Further, in the system, a control instruction text set for triggering screen capture, a control instruction text set for adjusting a screen capture frame, and a control instruction text set for intercepting a confirmation are prestored in the screen capture control module, and no intersection exists among the control instruction text set for triggering screen capture, the control instruction text set for adjusting the screen capture frame, and the control instruction text set for intercepting a confirmation; and after receiving the text sent by the voice acquisition and recognition module, the screen capture control module matches the text content in a control instruction text set triggering screen capture, a control instruction text set adjusting a screen capture frame and a control instruction text set intercepted and confirmed, and executes the text content according to the corresponding control instruction once the matching is successful.
Furthermore, in the above system, the text set of control instructions for adjusting the shape of the screen capture frame includes a text set of control instructions for adjusting the shape of the screen capture frame and a text set of control instructions for adjusting the size of the screen capture frame; the control instruction text set for adjusting the shape of the screen capture comprises a plurality of screen capture shape description texts, and the control instruction text set for adjusting the size of the screen capture comprises a plurality of screen capture enlargement ratio and screen reduction ratio description texts.
The invention also provides a wearable device screen capture control method using the system, which comprises the following specific processes:
s1, when screen capture is needed, the user sends out screen capture triggering voice to the wearable device;
s2, after the voice is collected by the voice collecting and identifying module in the wearable device, firstly extracting voice print information of the voice and comparing the voice print information with voice print information of a user prestored in the wearable device, and if the voice print information is consistent with the voice print information of the user, converting the voice into a text and sending the text to the screen capture control module;
s3, the screen capture control module judges the received text content, if the text content belongs to a control instruction for triggering screen capture, a current full screen interface of a screen of the wearable device is captured and displayed on the screen as a first picture, a screen capture frame is displayed on the first picture, and otherwise, no operation is performed;
s4, after screen capture is triggered, the user further inputs voice to adjust a screen capture frame or confirm capture, after the voice collecting and identifying module collects the voice of the user, the voice print information of the voice is firstly extracted and compared with the voice print information of the user prestored in the wearable device, and if the voice print information of the user is consistent with the voice print information of the user, the voice is converted into a text and sent to the screen capture control module; the screen capture control module judges the received text content, if the text content belongs to a control instruction for adjusting the screen capture frame, the screen capture frame is correspondingly adjusted according to the control instruction for adjusting the screen capture frame, if the text content belongs to a control instruction for confirming screen capture, the first picture is correspondingly captured according to the current screen capture frame, the final screen capture picture is obtained and stored, then the first picture is discarded, and the screen capture is finished.
Further, in the method, after the user triggers the screen capture, if the user does not input voice within a set time length to adjust the screen capture frame or confirm the screen capture, the screen capture control module discards the first picture, and the screen capture is finished.
Further, in the method, after receiving the text sent by the voice acquisition and recognition module, the screen capture control module matches the text content in the control instruction text set triggering the screen capture, the control instruction text set adjusting the screen capture frame, and the control instruction text set confirmed by capturing, and executes the matching according to the corresponding control instruction once the matching is successful.
Further, in the above method, the adjusting of the screen capture frame includes shape adjusting and size adjusting of the screen capture frame; when the user inputs voice describing the shape of the screen capture frame, the screen capture control module controls the screen capture frame to be changed into a corresponding shape after successfully matching the text obtained by converting the voice in a control instruction text set for adjusting the shape of the screen capture frame; when the user inputs voice describing the enlargement ratio or the reduction ratio of the screen capture frame, the screen capture control module controls the size of the screen capture frame to change correspondingly after successfully matching the text obtained by converting the voice in the text set of the control instruction for adjusting the size of the screen capture frame.
The invention has the beneficial effects that: the invention realizes screen capture by using a voice recognition mode, can effectively overcome the defects that a wearable device has a small screen and touch screen capture is difficult to operate and realize, and is simpler, more accurate and easy to operate. And the invention recognizes whether the voice print of the input voice command is the pre-stored user voice print when the screen is shot, which can ensure the safety of the telephone watch information and avoid the leakage.
Detailed Description
The present invention will be further described below, and it should be noted that the present embodiment is based on the technical solution, and a detailed implementation manner and a specific operation process are provided, but the protection scope of the present invention is not limited to the present embodiment.
Example 1
This embodiment provides a wearable equipment screen capture control system, includes:
the voice acquisition and recognition module: the voice capturing module is used for capturing voice of a user, extracting voiceprint information of the captured voice and judging whether the voiceprint information is matched with prestored voiceprint information of the user, and if so, recognizing the voice, converting the voice into text and sending the text to the screen capturing control module;
the screen capture control module is used for judging the text content after receiving the text sent by the voice acquisition and recognition module, and if the text content belongs to a control instruction for triggering screen capture, capturing the current full screen interface of the screen of the wearable device as a first picture to be displayed on the screen, and displaying a screen capture frame on the first picture; if the text content belongs to the control instruction for adjusting the screen-cutting frame, on the premise that the first picture is intercepted, adjusting the screen-cutting frame and synchronously displaying the screen-cutting frame on a screen for a user to preview; and if the text content belongs to the control instruction for intercepting confirmation, correspondingly intercepting the first picture according to the current screen intercepting frame on the premise that the first picture is intercepted, and obtaining and storing the final screen intercepting picture.
Further, in this embodiment, a control instruction text set for triggering screen capture, a control instruction text set for adjusting a screen capture frame, and a control instruction text set for capturing confirmation are prestored in the screen capture control module, and there is no intersection between the control instruction text set for triggering screen capture, the control instruction text set for adjusting a screen capture frame, and the control instruction text set for capturing confirmation; and after receiving the text sent by the voice acquisition and recognition module, the screen capture control module matches the text content in a control instruction text set triggering screen capture, a control instruction text set adjusting a screen capture frame and a control instruction text set intercepted and confirmed, and executes the text content according to the corresponding control instruction once the matching is successful.
Furthermore, the control instruction text set for adjusting the screen capture frame comprises a control instruction text set for adjusting the shape of the screen capture frame and a control instruction text set for adjusting the size of the screen capture frame; the control instruction text set for adjusting the shape of the screen capture comprises a plurality of description texts for describing the shape of the screen capture (such as a circle, a square and a screen), and the control instruction text set for adjusting the size of the screen capture comprises a plurality of description texts for enlarging and reducing the screen capture. Such as ten percent enlargement, five percent reduction, etc., the descriptive text may be set to enlarge N percent (N being an integer between 1 and 100) and to reduce N percent (N being an integer between 1 and 100), such that a wider range of percentage sizes are allowed for adjustment.
It should be noted that the control instruction text set for triggering screen capture may be set according to commonly used screen capture terms, such as "screen capture", and the like, and the control instruction text set for capturing confirmation may also be set according to commonly used confirmation terms, such as "complete", "confirm", "ok", and the like.
Example 2
The embodiment provides a wearable device screen capture control method using the system described in embodiment 1, which includes the following specific processes:
s1, when screen capture is needed, the user sends out screen capture triggering voice to the wearable device;
s2, after the voice is collected by the voice collecting and identifying module in the wearable device, firstly extracting voice print information of the voice and comparing the voice print information with voice print information of a user prestored in the wearable device, and if the voice print information is consistent with the voice print information of the user, converting the voice into a text and sending the text to the screen capture control module;
s3, the screen capture control module judges the received text content, if the text content belongs to a control instruction for triggering screen capture, a current full screen interface of a screen of the wearable device is captured and displayed on the screen as a first picture, a screen capture frame is displayed on the first picture, and otherwise, no operation is performed;
s4, after screen capture is triggered, the user further inputs voice to adjust a screen capture frame or confirm capture, after the voice collecting and identifying module collects the voice of the user, the voice print information of the voice is firstly extracted and compared with the voice print information of the user prestored in the wearable device, and if the voice print information of the user is consistent with the voice print information of the user, the voice is converted into a text and sent to the screen capture control module; the screen capture control module judges the received text content, if the text content belongs to a control instruction for adjusting the screen capture frame, the screen capture frame is correspondingly adjusted according to the control instruction for adjusting the screen capture frame, if the text content belongs to a control instruction for confirming screen capture, the first picture is correspondingly captured according to the current screen capture frame, the final screen capture picture is obtained and stored, then the first picture is discarded, and the screen capture is finished.
It should be noted that, after the user triggers the screen capture, if the user does not input a voice within a set time length to adjust the screen capture frame or confirm the screen capture, the screen capture control module discards the first picture, and this screen capture is finished.
In this embodiment, after receiving the text sent by the voice acquisition and recognition module, the screen capture control module matches the text content in the control instruction text set triggering the screen capture, the control instruction text set adjusting the screen capture frame, and the control instruction text set intercepted and confirmed, and executes the matching according to the corresponding control instruction once the matching is successful.
In this embodiment, the adjustment of the screen frame includes shape adjustment and size adjustment of the screen frame; when the user inputs voice (such as a circle, a square, a screen shape and the like) for describing the shape of the screen capture frame, the screen capture control module controls the screen capture frame to be changed into a corresponding shape after successfully matching the text obtained by converting the voice in a control instruction text set for adjusting the shape of the screen capture frame; when the user inputs voice describing the enlargement ratio or the reduction ratio of the screen capture frame (for example, ten percent reduction, five percent amplification and the like), the screen capture control module controls the size of the screen capture frame to change correspondingly after the text obtained by voice conversion is successfully matched in the text set of the control instruction for adjusting the size of the screen capture frame.
Various corresponding changes and modifications can be made by those skilled in the art based on the above technical solutions and concepts, and all such changes and modifications should be included in the protection scope of the present invention.

Claims (7)

1. The utility model provides a wearable equipment screen capture control system which characterized in that includes:
the voice acquisition and recognition module: the voice capturing module is used for capturing voice of a user, extracting voiceprint information of the captured voice and judging whether the voiceprint information is matched with prestored voiceprint information of the user, and if so, recognizing the voice, converting the voice into text and sending the text to the screen capturing control module;
the screen capture control module is used for judging the text content after receiving the text sent by the voice acquisition and recognition module, and if the text content belongs to a control instruction for triggering screen capture, capturing the current full screen interface of the screen of the wearable device as a first picture to be displayed on the screen, and displaying a screen capture frame on the first picture; if the text content belongs to the control instruction for adjusting the screen-cutting frame, on the premise that the first picture is intercepted, adjusting the screen-cutting frame and synchronously displaying the screen-cutting frame on a screen for a user to preview; and if the text content belongs to the control instruction for intercepting confirmation, correspondingly intercepting the first picture according to the current screen intercepting frame on the premise that the first picture is intercepted, and obtaining and storing the final screen intercepting picture.
2. The wearable device screenshot control system of claim 1, wherein the screenshot control module is pre-stored with a control instruction text set for triggering screenshot, a control instruction text set for adjusting a screenshot box, a control instruction text set for intercepting a confirmation, and no intersection exists between the control instruction text set for triggering screenshot, the control instruction text set for adjusting the screenshot box, and the control instruction text set for intercepting a confirmation; and after receiving the text sent by the voice acquisition and recognition module, the screen capture control module matches the text content in a control instruction text set triggering screen capture, a control instruction text set adjusting a screen capture frame and a control instruction text set intercepted and confirmed, and executes the text content according to the corresponding control instruction once the matching is successful.
3. The wearable device screenshot control system of claim 2, wherein the control instruction text set for adjusting the screenshot box comprises a control instruction text set for adjusting the shape of the screenshot box and a control instruction text set for adjusting the size of the screenshot box; the control instruction text set for adjusting the shape of the screen capture comprises a plurality of screen capture shape description texts, and the control instruction text set for adjusting the size of the screen capture comprises a plurality of screen capture enlargement ratio and screen reduction ratio description texts.
4. A wearable device screen capture control method using the system of any one of claims 1-3, characterized by comprising the following steps:
s1, when screen capture is needed, the user sends out screen capture triggering voice to the wearable device;
s2, after the voice is collected by the voice collecting and identifying module in the wearable device, firstly extracting voice print information of the voice and comparing the voice print information with voice print information of a user prestored in the wearable device, and if the voice print information is consistent with the voice print information of the user, converting the voice into a text and sending the text to the screen capture control module;
s3, the screen capture control module judges the received text content, if the text content belongs to a control instruction for triggering screen capture, a current full screen interface of a screen of the wearable device is captured and displayed on the screen as a first picture, a screen capture frame is displayed on the first picture, and otherwise, no operation is performed;
s4, after screen capture is triggered, the user further inputs voice to adjust a screen capture frame or confirm capture, after the voice collecting and identifying module collects the voice of the user, the voice print information of the voice is firstly extracted and compared with the voice print information of the user prestored in the wearable device, and if the voice print information of the user is consistent with the voice print information of the user, the voice is converted into a text and sent to the screen capture control module; the screen capture control module judges the received text content, if the text content belongs to a control instruction for adjusting the screen capture frame, the screen capture frame is correspondingly adjusted according to the control instruction for adjusting the screen capture frame, if the text content belongs to a control instruction for confirming screen capture, the first picture is correspondingly captured according to the current screen capture frame, the final screen capture picture is obtained and stored, then the first picture is discarded, and the screen capture is finished.
5. The method of claim 4, wherein after the user triggers the screen capture, if the user does not input voice within a set time period to adjust the screen capture frame or confirm the screen capture, the screen capture control module discards the first picture, and the screen capture is finished.
6. The method according to claim 4, wherein after the screen capture control module receives the text sent by the voice acquisition and recognition module, the text content is matched in the control instruction text set triggering the screen capture, the control instruction text set adjusting the screen capture frame and the control instruction text set confirmed by the screen capture, and once the matching is successful, the matching is executed according to the corresponding control instruction.
7. The method of claim 4, wherein the adjustment of the bezel comprises a shape adjustment and a size adjustment of the bezel; when the user inputs voice describing the shape of the screen capture frame, the screen capture control module controls the screen capture frame to be changed into a corresponding shape after successfully matching the text obtained by converting the voice in a control instruction text set for adjusting the shape of the screen capture frame; when the user inputs voice describing the enlargement ratio or the reduction ratio of the screen capture frame, the screen capture control module controls the size of the screen capture frame to change correspondingly after successfully matching the text obtained by converting the voice in the text set of the control instruction for adjusting the size of the screen capture frame.
CN202011642290.1A 2020-12-31 2020-12-31 Wearable device screen capture control system and method Pending CN112783467A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011642290.1A CN112783467A (en) 2020-12-31 2020-12-31 Wearable device screen capture control system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011642290.1A CN112783467A (en) 2020-12-31 2020-12-31 Wearable device screen capture control system and method

Publications (1)

Publication Number Publication Date
CN112783467A true CN112783467A (en) 2021-05-11

Family

ID=75753528

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011642290.1A Pending CN112783467A (en) 2020-12-31 2020-12-31 Wearable device screen capture control system and method

Country Status (1)

Country Link
CN (1) CN112783467A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102708540A (en) * 2012-04-21 2012-10-03 上海量明科技发展有限公司 Method and client side for zooming screen capturing areas
CN109085975A (en) * 2018-08-06 2018-12-25 Oppo广东移动通信有限公司 Screenshotss method, apparatus, storage medium and electronic device
CN110428832A (en) * 2019-07-26 2019-11-08 苏州蜗牛数字科技股份有限公司 A kind of method that customized voice realizes screen control
US20190391716A1 (en) * 2018-06-25 2019-12-26 Google Llc Identifying and controlling smart devices

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102708540A (en) * 2012-04-21 2012-10-03 上海量明科技发展有限公司 Method and client side for zooming screen capturing areas
US20190391716A1 (en) * 2018-06-25 2019-12-26 Google Llc Identifying and controlling smart devices
CN109085975A (en) * 2018-08-06 2018-12-25 Oppo广东移动通信有限公司 Screenshotss method, apparatus, storage medium and electronic device
CN110428832A (en) * 2019-07-26 2019-11-08 苏州蜗牛数字科技股份有限公司 A kind of method that customized voice realizes screen control

Similar Documents

Publication Publication Date Title
EP3719623A1 (en) Application icon display method, terminal, and computer readable storage medium
CN106445461B (en) Method and device for processing character information
KR20130086422A (en) Device and method for adjusting touch sensitivity in wireless terminal
CN104347049A (en) Method and device for adjusting screen refresh rate
CN102999752A (en) Method and device for quickly identifying local characters in picture and terminal
CN102546953A (en) System and method for full voice control of mobile terminal
CN103870356A (en) Information processing method and electronic equipment
CN106527945A (en) Text information extracting method and device
WO2017076017A1 (en) Method and apparatus for operating application
WO2017012378A1 (en) System for operating computer, wearable device and method for operating computer thereof
CN105184283A (en) Method and system for marking key points in human face images
CN112306220A (en) Control method and device based on limb identification, electronic equipment and storage medium
CN112672061B (en) Video shooting method and device, electronic equipment and medium
CN103076952A (en) Amplifying method and amplifying device for display contents in display interface of intelligent camera
CN111047147B (en) Automatic business process acquisition method and intelligent terminal
CN105893019A (en) User manual calling-out method and apparatus for smartphone
CN112783467A (en) Wearable device screen capture control system and method
CN103354089B (en) A kind of voice communication management method and device thereof
CN105678144A (en) Screen unlocking method and device and electronic equipment
CN103024502B (en) In intelligent television, realize the system and method for handwriting input word
CN113852756B (en) Image acquisition method, device, equipment and storage medium
CN115453903A (en) Intelligent home control method and device, wearable device and storage medium
CN112134987B (en) Information processing method and device and electronic equipment
CN102023783A (en) System and method for adjusting zooming ratio of display area and display content
CN113873168A (en) Shooting method, shooting device, electronic equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210511