CN112882643A

CN112882643A - Control method of touch pen, control method of electronic equipment and touch pen

Info

Publication number: CN112882643A
Application number: CN202110119083.6A
Authority: CN
Inventors: 付从华
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-01-28
Filing date: 2021-01-28
Publication date: 2021-06-01

Abstract

The application discloses a control method of a touch pen, a control method of electronic equipment and the touch pen, and belongs to the field of communication. The touch control pen is in communication connection with the electronic equipment, the touch control pen has an image acquisition function, and the control method of the touch control pen comprises the following steps: receiving a first input; acquiring a first image of an acquisition object in response to a first input; receiving a second input; and responding to the second input, and sending the target information of the first image to the electronic equipment for displaying. By means of the mode, the technical scheme that after the target information is copied on the acquisition object, the target information is pasted on the electronic equipment is achieved, so that the target information on the acquisition object can be rapidly and accurately displayed on the electronic equipment, and the efficiency of inputting the target information to the electronic equipment by the touch pen is improved.

Description

Control method of touch pen, control method of electronic equipment and touch pen

Technical Field

The present application belongs to the field of communications, and in particular, relates to a control method for a stylus, a control method for an electronic device, a control apparatus for a stylus, a control apparatus for an electronic device, a stylus, an electronic device, and a readable storage medium.

Background

In the related art, when a touch pen is used for performing touch operation on an electronic device, only information generated by a user through operations such as writing and drawing can be input into the electronic device, and the input efficiency is equivalent to the actual writing efficiency of paper and pen, and is low.

Disclosure of Invention

An object of the embodiments of the present application is to provide a control method for a stylus, a control method for an electronic device, a control device for a stylus, a control device for an electronic device, a stylus, an electronic device, and a readable storage medium, which can solve the problem of low input efficiency of a stylus in the related art.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a method for controlling a stylus, where the stylus is in communication connection with an electronic device, and the stylus has an image capturing function, and the method includes: receiving a first input; acquiring a first image of an acquisition object in response to a first input; receiving a second input; and responding to the second input, and sending the target information of the first image to the electronic equipment for displaying.

In a second aspect, an embodiment of the present application provides a control method for an electronic device, where the electronic device is in communication connection with a stylus, and the stylus has an image capturing function, and the control method includes: receiving a third input of the touch pen, and receiving target information sent by the touch pen; in response to a third input, target information is displayed.

In a third aspect, an embodiment of the present application provides a control device for a stylus, where the stylus is in communication connection with an electronic device, the stylus has an image capturing function, and the control device includes: a first receiving unit for receiving a first input; an acquisition unit for acquiring a first image of an acquisition object in response to a first input; a second receiving unit for receiving a second input; and the sending unit is used for responding to the second input and sending the target information of the first image to the electronic equipment for displaying.

In a fourth aspect, an embodiment of the present application provides a control apparatus for an electronic device, where the electronic device is in communication connection with a stylus, the stylus has an image capturing function, and the control apparatus includes: a third receiving unit for receiving a third input of the stylus; the fourth receiving unit is used for receiving the target information sent by the touch pen; and a display unit for displaying the target information in response to a third input.

In a fifth aspect, an embodiment of the present application provides a stylus, where the stylus is in communication connection with an electronic device, and the stylus includes: a pen body part; the pen head part is arranged at one end of the pen body part; the pen tail part is arranged at the other end of the pen body part; the image acquisition device is arranged in any one of the pen body part, the pen head part and the pen tail part and is used for acquiring a first image of an acquisition object; the processing device is arranged in any one of the pen body part, the pen head part and the pen tail part and is connected with the image acquisition device, and the processing device is used for identifying the first image to obtain target information; and the communication device is arranged in any one of the pen body part, the pen head part and the pen tail part and is used for transmitting the target information to the electronic equipment for displaying.

In a sixth aspect, embodiments of the present application provide a stylus that includes a processor, a memory, and a program or an instruction stored on the memory and executable on the processor, where the program or the instruction when executed by the processor implements the control method of the stylus according to the first aspect.

In a seventh aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the control method of the electronic device according to the second aspect.

In an eighth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, and when executed by a processor, the program or instructions implement the control method according to the first aspect or the second aspect.

In a ninth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, and the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the control method according to the first aspect or the second aspect.

In the embodiment of the application, the stylus receives a first input, responds to the first input, collects a first image of a collected object, receives a second input, responds to the second input, and sends target information of the first image to the electronic equipment for displaying. By means of the mode, the technical scheme that after the target information is copied on the acquisition object, the target information is pasted on the electronic equipment is achieved, so that the target information on the acquisition object can be rapidly and accurately displayed on the electronic equipment, and the efficiency of inputting the target information to the electronic equipment by the touch pen is improved.

Drawings

Fig. 1 is a flowchart illustrating a method for controlling a stylus according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram illustrating interaction between a stylus and an electronic device according to an embodiment of the present disclosure;

FIG. 3 is a second schematic diagram illustrating interaction between a stylus and an electronic device according to an embodiment of the present application;

FIG. 4 is a third schematic diagram illustrating interaction between a stylus and an electronic device according to an embodiment of the present application;

FIG. 5 is a fourth illustration of the interaction of the stylus with the electronic device according to the embodiment of the disclosure;

FIG. 6 is a fifth schematic diagram illustrating interaction between a stylus and an electronic device according to an embodiment of the present application;

fig. 7 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present application;

FIG. 8 is a schematic block diagram of a control device of a stylus according to an embodiment of the present application;

fig. 9 is a schematic block diagram of a control apparatus of an electronic device of an embodiment of the present application;

FIG. 10 is a block diagram schematically illustrating the structure of an electronic device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a stylus pen according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The method for controlling a stylus, the method for controlling an electronic device, the device for controlling a stylus, the device for controlling an electronic device, a stylus, an electronic device, and a readable storage medium according to the embodiments of the present application are described in detail below with reference to the accompanying drawings.

The embodiment of the application provides a control method of a touch pen, wherein the touch pen is in communication connection with an electronic device, and the touch pen has an image acquisition function. As shown in fig. 1, the control method includes:

step 102, receiving a first input;

step 104, in response to a first input, acquiring a first image of a captured object;

step 106, receiving a second input;

and step 108, responding to the second input, and sending the target information of the first image to the electronic equipment for displaying.

In this embodiment, the stylus is provided with an image capturing device capable of capturing images. A first image of the capture object is captured with the image capture device after the first input is received by the stylus, for example, after two consecutive taps with the capture object are received. Further, after the second input is received by the stylus pen, for example, after one tap with a screen of the electronic device is received, the target information of the first image is sent to the electronic device, so that the electronic device displays the target information. By means of the mode, the technical scheme that after the target information is copied on the acquisition object, the target information is pasted on the electronic equipment is achieved, so that the target information on the acquisition object can be rapidly and accurately displayed on the electronic equipment, and the efficiency of inputting the target information to the electronic equipment by the touch pen is improved.

The first input may be an input such as a sliding input, a clicking input, a double-click input, a hovering input (an input of the stylus near the touch screen), and a long-press input to a key of the stylus, or may be an input such as a sliding input, a clicking input, and a double-click input to the acquisition object by the stylus.

The second input may be a sliding input, a clicking input, a double-click input, a hovering input (an input of the stylus near the touch screen), a long-press input to a key of the stylus, or the like, to the touch screen of the stylus, or may also be a sliding input, a clicking input, a double-click input, or the like, to the electronic device, and specifically, the embodiment of the present application is not particularly limited to the manner of the second input, and may be any realizable manner.

In one embodiment of the present application, acquiring the object includes at least one of: clothing, books, electronic equipment.

In this embodiment, the collected object includes, but is not limited to, clothes, books, and electronic devices, for example, characters are printed on the clothes, and the stylus can collect images of the character portion on the clothes, so as to recognize the characters, and then send the characters to the electronic devices for displaying; for another example, a certain figure is displayed on the book, and the stylus can collect the image of the figure part on the book, further recognize the figure and send the figure to the electronic equipment for displaying; for another example, a certain picture is displayed on the first electronic device, characters are displayed on the picture, the touch pen can acquire an image of the picture on the first electronic device, and then recognize the characters, and then send the characters to the second electronic device for display, and the first electronic device and the second electronic device may be the same device or different devices.

Through the mode, the target information on various collection objects can be input to the electronic equipment to be displayed, and the flexibility of information input is improved while the information input efficiency is improved.

In one embodiment of the present application, sending target information of a first image to an electronic device for display includes: identifying the first image to obtain target information; sending the target information to the electronic equipment for displaying; wherein the target information comprises at least one of: text content, color, text font, text ground color, paragraph format, graphics, image.

In this embodiment, the stylus identifies the first image, obtains target information in the first image, and further sends the target information to the electronic device for display. It should be noted that the target information includes, but is not limited to, text content, color, text font, text background color, paragraph format, for example, when the user needs to select the same color as a certain clothes, the stylus captures an image of the clothes, identifies the color of the clothes (for example, represented by rgb (red Green blue) code), and when the stylus writes on the electronic device, the text color displayed on the electronic device is the color of the clothes. For another example, when the user needs to select a font identical to the text displayed on a certain book, the touch pen collects images of the text on the book and identifies the font of the text, and when the touch pen writes on the electronic device, the font of the text displayed on the electronic device is the font of the text displayed on the book.

By means of the mode, various target information on the collected object can be input to the electronic equipment to be displayed, and the flexibility of information input is improved while the information input efficiency is improved.

In one embodiment of the present application, sending target information of a first image to an electronic device for display includes: identifying the first image to obtain target character information; converting the target text information from a first language to a second language; and sending the target character information converted into the second language to the electronic equipment for displaying.

In this embodiment, the stylus recognizes the first image to obtain the target text information, further performs language conversion on the target text information, and sends the target text information after the language conversion to the electronic device for display. For example, the identified target text information is converted from the current English language into Chinese language, and the Chinese language is sent to the electronic equipment for display.

By the mode, the target character information can be translated while being copied and pasted, the information input efficiency is guaranteed, the flexibility of information input is improved, the practicability of the touch pen is improved, and the touch pen is convenient for a user to use.

The control method of the stylus pen will be described in detail with reference to fig. 2 to 6. The stylus includes a tip, a pressure sensor, an IMU, a processor, and an image sensor.

As shown in fig. 2, when the user taps with the pen tip on the screen of the electronic device 300 at a preset number of times and at a preset speed (e.g., two quick taps in succession, i.e., "double taps"), the pressure sensor or IMU may detect the motion and inform the processor of this detected motion by way of data communication, interrupt, or the like. The processor receives the signal and then starts the image sensor. As shown in fig. 3, when the user attaches the portion (tail) of the stylus pen 200 with the image sensor to the first book 400 (or the screen of the other electronic device 300), the characters on the first book 400 are captured by the image sensor. Further, the processor converts the image collected by the image sensor into information such as characters and the like, and realizes the character 'copying' function. Thus, when the user moves the touch pen 200 on the first book 400, the images with a series of characters are collected into the processor, and finally converted into a section of characters to form a sentence or paragraph by the processor.

After the copying is completed, as shown in fig. 4, the user brings the pen tip close to the screen of the electronic device 300 again, the screen of the electronic device 300 detects the approaching, touching, clicking and other actions of the pen tip, the touch pen 200 transmits the converted characters to the electronic device 300 through the communication module, and the electronic device 300 displays the characters in the screen area near the pen tip, thereby implementing the "paste" operation.

It should be noted that the approach, contact, and click of the pen tip on the screen of the electronic device 300 is not the only trigger of the "paste" operation. For example, the triggering of "paste" can also be realized by pressing, double-clicking, long-pressing and the like by the pen point at the position to be pasted on the screen of the electronic device 300.

In addition, when the screen of the electronic device 300 detects the approaching, touching, clicking and other actions of the pen tip, the user may be prompted to select whether to "paste" the scanned content. If the user selects "yes", the touch pen 200 transmits the converted characters to the electronic device 300 through the communication module, and the electronic device 300 displays the characters in a screen area near the pen tip, thereby implementing a "paste" operation. And if the user selects 'no', ignoring the text content.

As an example, the contents "copied" by stylus 200 may also be translated by stylus 200 from a first language to a second language and "pasted" the second language contents to the screen of electronic device 300. As shown in fig. 5, when the user attaches the portion (tail) of the stylus pen 200 provided with the image sensor to the second book 500, the text on the second book 500 is captured by the image sensor. Further, the processor converts the image collected by the image sensor into character information, and further translates English into Chinese. As shown in FIG. 6, stylus 200 "pastes" the translation directly to the screen of electronic device 300.

By the mode, functions of character copying, translation and the like can be conveniently realized, end-to-end interaction of book-electronic equipment, electronic equipment-electronic equipment and the like is realized, and the input efficiency of the touch pen is greatly improved.

The embodiment of the application further provides a control method of an electronic device, wherein the electronic device is in communication connection with a touch pen, and the touch pen has an image acquisition function. As shown in fig. 7, the control method includes:

step 702, receiving a third input of the stylus and receiving target information sent by the stylus;

step 704, in response to the third input, displaying the target information.

The target information is obtained by the touch control pen according to the collected first image recognition of the collected object.

In this embodiment, the stylus is provided with an image capturing device, which is capable of capturing a first image of a captured object, and then recognizing the first image to obtain target information. The electronic equipment receives the target information sent by the touch pen, receives the third input of the touch pen at the same time, and displays the target information after responding to the third input. For example, after the stylus pen sends the target information to the electronic device, the screen of the electronic device is tapped, and the electronic device responds to the tapping operation to display the target information. By means of the mode, the technical scheme that after the target information is copied on the acquisition object, the target information is pasted on the electronic equipment is achieved, so that the target information on the acquisition object can be rapidly and accurately displayed on the electronic equipment, and the efficiency of inputting the target information to the electronic equipment by the touch pen is improved.

The third input may be a sliding input, a clicking input, a double-clicking input, and the like of the electronic device by using a stylus, and specifically, a manner of the third input is not particularly limited in this application embodiment, and may be any realizable manner.

In one embodiment of the present application, receiving a third input from a stylus includes: receiving a third input of the touch pen in a target display area of the electronic equipment; displaying the target information specifically comprises: and displaying the target information in the target display area.

In this embodiment, the stylus performs a third input in the target display area of the electronic device, for example, when the stylus taps the target display area on the screen of the electronic device, the target information is displayed in the target display area, so that the target information is quickly and correctly displayed in the display area selected by the user, and convenience in information display is improved.

In one embodiment of the present application, in response to a third input, displaying target information includes: in response to a third input, displaying prompt information for the target information; receiving a fourth input of the prompt message; in response to a fourth input, target information is displayed.

In this embodiment, in response to the third input, the electronic device displays a prompt for the target information, and when the electronic device receives the fourth input indicating that the user confirms to display the target information, the target information is displayed. For example, in response to the third input, a prompt message of "whether to display target information" is displayed, and when the user selects "yes", the target information is displayed, and when the user selects "no", the target information is ignored.

By the method, the user can select whether the target information is displayed or not, and the target information can be directly ignored when the user does not need to display, so that the selection flexibility of displaying the target information is improved, and the user can conveniently select the target information.

When the user selects "yes" or "no", the user may input with a stylus or with a finger.

In one embodiment of the present application, in response to a third input, displaying target information includes: in response to a third input, converting the target information from the first language to a second language; and displaying the target information converted into the second language.

In this embodiment, after receiving the target information, the electronic device performs language conversion on the target information, and displays the target information after the language conversion. For example, the target information is converted from the current english language into the chinese language, and the chinese language is displayed. By the aid of the method, translation of the target information can be realized while the target information is pasted, information input efficiency is guaranteed, flexibility of information input is improved, practicability of the electronic equipment is improved, and the electronic equipment is convenient for a user to use.

In one embodiment of the present application, the target information includes at least one of: text content, color, text font, text ground color, paragraph format, graphics, image.

In this embodiment, the target information includes, but is not limited to, text content, color, text font, text background color, and paragraph format, for example, when the user needs to select the same color as a certain clothes, the stylus captures an image of the clothes, identifies the color of the clothes, and when the stylus writes on the electronic device, the text color displayed on the electronic device is the color of the clothes. For another example, when the user needs to select a font identical to the text displayed on a certain book, the touch pen collects images of the text on the book and identifies the font of the text, and when the touch pen writes on the electronic device, the font of the text displayed on the electronic device is the font of the text displayed on the book.

It should be noted that, in the control method of the stylus provided in the embodiment of the present application, the execution main body may be a control device of the stylus, or a control module in the control device of the stylus, which is used for executing the control method of the loading stylus. In the embodiment of the present application, a control method for a control device of a stylus to execute a loaded stylus is taken as an example, and the control device of the stylus provided in the embodiment of the present application is described.

In the embodiment of the application, the touch pen is in communication connection with the electronic device, and the touch pen has an image acquisition function. As shown in fig. 8, the control device 800 of the stylus pen includes:

a first receiving module 802 for receiving a first input;

an acquisition module 804 for acquiring a first image of an acquisition object in response to a first input;

a second receiving module 806, configured to receive a second input;

a sending module 808, configured to send, in response to the second input, the target information of the first image to the electronic device for display.

In an embodiment of the present application, the sending module 808 is specifically configured to: identifying the first image to obtain target information; sending the target information to the electronic equipment for displaying; wherein the target information comprises at least one of: text content, color, text font, text ground color, paragraph format, graphics, image.

In an embodiment of the present application, the sending module 808 is specifically configured to: identifying the first image to obtain target character information; converting the target text information from a first language to a second language; and sending the target character information converted into the second language to the electronic equipment for displaying.

It should be noted that, in the control method of an electronic device provided in the embodiment of the present application, the execution main body may be a control device of the electronic device, or a control module in the control device of the electronic device, which is used for executing the control method of the loaded electronic device. In this embodiment, a control device of an electronic device provided in this embodiment is described by taking a control method in which a control device of an electronic device executes a load of the electronic device as an example.

In the embodiment of the application, the electronic device is in communication connection with the touch pen, and the touch pen has an image acquisition function. As shown in fig. 9, the control device 900 of the electronic apparatus includes:

a third receiving module 902, configured to receive a third input of the stylus;

a fourth receiving module 904, configured to receive target information sent by a stylus;

a display module 906 for displaying the target information in response to a third input.

In an embodiment of the present application, the third receiving module 902 is specifically configured to: receiving a third input of the touch pen in a target display area of the electronic equipment; the display module 906 is specifically configured to: and displaying the target information in the target display area.

In an embodiment of the present application, the display module 906 is specifically configured to: in response to a third input, displaying prompt information for the target information; the control device of the electronic apparatus further includes: the fifth receiving module is used for receiving fourth input of the prompt message; the display module 906 is specifically configured to: in response to a fourth input, target information is displayed.

In an embodiment of the present application, the display module 906 is specifically configured to: in response to a third input, converting the target information from the first language to a second language; and displaying the target information converted into the second language.

The control device of the stylus pen or the control device of the electronic device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the Mobile electronic device may be a Mobile phone, a tablet Computer, a notebook Computer, a palm top Computer, an in-vehicle electronic device, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-Mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (Personal Computer, PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not limited in particular.

The control device of the stylus or the control device of the electronic device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The control device of the stylus pen provided in the embodiment of the present application can implement each process implemented in the method embodiments of fig. 1 to 6, and the control device of the electronic device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 7, and is not described here again to avoid repetition.

Optionally, an embodiment of the present application further provides a stylus, which includes a processor, a memory, and a program or an instruction stored in the memory and capable of being executed on the processor, where the program or the instruction is executed by the processor to implement each process of the above-mentioned embodiment of the control method of the stylus, and the same technical effect can be achieved, and details are not repeated here to avoid repetition.

Optionally, an electronic device is further provided in this embodiment of the present application, and includes a processor 1020, a memory 1018, and a program or an instruction stored in the memory 1018 and executable on the processor 1020, where the program or the instruction is executed by the processor 1020 to implement each process of the control method embodiment of the electronic device, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Fig. 10 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1000 includes, but is not limited to: radio frequency unit 1002, network module 1004, audio output unit 1006, input unit 1008, sensors 1010, display unit 1012, user input unit 1014, interface unit 1016, memory 1018, and processor 1020.

Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power supply (e.g., a battery) for supplying power to various components, and the power supply may be logically connected to the processor 1020 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 10 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.

The user input unit 1014 is configured to receive a third input of the stylus; an input unit 1008 for receiving target information sent by a stylus; a display unit 1012 for displaying target information in response to a third input; the target information is obtained by the touch control pen according to the collected first image recognition of the collected object.

In an embodiment of the present application, the user input unit 1014 is specifically configured to: receiving a third input of the touch pen in a target display area of the electronic equipment; the display unit 1012 is specifically configured to: and displaying the target information in the target display area.

In an embodiment of the present application, the display unit 1012 is specifically configured to: in response to a third input, displaying prompt information for the target information; a user input unit 1014, further configured to receive a fourth input of the prompt information; the display unit 1012 is specifically configured to: in response to a fourth input, target information is displayed.

It should be understood that, in the embodiment of the present application, the radio frequency unit 1002 may be configured to send and receive information or send and receive signals during a call, and in particular, receive downlink data of a base station or send uplink data to the base station. Radio frequency unit 1002 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The network module 1004 provides wireless broadband internet access to the user, such as assisting the user in emailing, browsing web pages, and accessing streaming media.

The audio output unit 1006 may convert audio data received by the radio frequency unit 1002 or the network module 1004 or stored in the memory 1018 into an audio signal and output as sound. Also, the audio output unit 1006 may also provide audio output related to a specific function performed by the electronic apparatus 1000 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 1006 includes a speaker, a buzzer, a receiver, and the like.

The input unit 1008 is used to receive audio or video signals. The input Unit 1008 may include a Graphics Processing Unit (GPU) 10082 and a microphone 10084, the Graphics processor 10082 Processing image data of still pictures or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 1012, or stored in the memory 1018 (or other storage medium), or transmitted via the radio frequency unit 1002 or the network module 1004. The microphone 10084 can receive sound and can process the sound into audio data, and the processed audio data can be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1002 in case of a phone call mode.

The electronic device 1000 also includes at least one sensor 1010, such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, a motion sensor, and others.

The display unit 1012 is used to display information input by the user or information provided to the user. The display unit 1012 may include a display panel 10122, and the display panel 10122 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.

The user input unit 1014 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 1014 includes a touch panel 10142 and other input devices 10144. The touch panel 10142 is also referred to as a touch screen and may collect touch operations by a user thereon or nearby. The touch panel 10142 can include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1020, receives a command from the processor 1020, and executes the command. Other input devices 10144 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 10142 can be overlaid on the display panel 10122, and when the touch panel 10142 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 1020 to determine the type of the touch event, and then the processor 1020 provides a corresponding visual output on the display panel 10122 according to the type of the touch event. The touch panel 10142 and the display panel 10122 may be provided as two separate components or may be integrated into one component.

The interface unit 1016 is an interface through which an external device is connected to the electronic apparatus 1000. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 1016 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 1000 or may be used to transmit data between the electronic apparatus 1000 and the external device.

Memory 1018 may be used to store software programs as well as various data. The memory 1018 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, and the like), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the mobile terminal, and the like. Additionally, memory 1018 can include high speed random access memory and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 1020 performs various functions of the electronic device 1000 and processes data by executing or executing software programs and/or modules stored in the memory 1018, as well as invoking data stored in the memory 1018, thereby monitoring the electronic device 1000 as a whole. Processor 1020 may include one or more processing units; preferably, the processor 1020 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned control method for a stylus or the control method for an electronic device, and can achieve the same technical effect, and in order to avoid repetition, the detailed description is omitted here.

The processor is the processor in the electronic device in the above embodiment. Readable storage media, including computer-readable storage media, such as Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, etc.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned control method for a stylus or the control method for an electronic device, and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

An embodiment of the present application further provides a touch pen, where the touch pen is in communication connection with an electronic device, as shown in fig. 11, the touch pen includes:

a pen body 1102;

a nib 1104 provided at one end of the body 1102;

a pen tail 1106 provided at the other end of the pen body 1102;

an image acquisition device 1108 disposed on any one of the pen body 1102, the pen head 1104 and the pen tail 1106, wherein the image acquisition device 1108 is used for acquiring a first image of an acquisition object;

the processing device 1110 is arranged on any one of the pen body 1102, the pen head 1104 and the pen tail 1106 and is connected with the image acquisition device 1108, and the processing device 1110 is used for recognizing the first image to obtain target information;

the communication device 1120 is provided in any one of the body portion 1102, the tip portion 1104, and the tail portion 1106, and the communication device 1120 is configured to transmit the target information to the electronic device for display.

In this embodiment, the stylus is made up of three parts, a body 1102, a tip 1104, and a tail 1106. The stylus further comprises an image acquisition device 1108, a processing device 1110 and a communication device 1120, the image acquisition device 1108 acquires a first image of an acquired object and then transmits the first image to the processing device 1110, the processing device 1110 identifies the first image and further obtains target information, and the communication device 1120 transmits the target information to the electronic device for displaying. By means of the mode, the technical scheme that after the target information is copied on the acquisition object, the target information is pasted on the electronic equipment is achieved, so that the target information on the acquisition object can be rapidly and accurately displayed on the electronic equipment, and the efficiency of inputting the target information to the electronic equipment by the touch pen is improved.

Note that the nib portion 1104 has a tapered shape, a wedge shape, or the like having a characteristic of a real nib, for example, a cone shape like a pencil, a wedge shape like a pen, a tip shape like a writing brush, a brush shape like a painting brush, or the like. The pen tip part 1104 internally comprises a pressure sensor 1126 and a pen tip 1128, the pen tip 1128 realizes interaction with an electronic device, on one hand, the pen tip 1128 can trigger track input of the electronic device, a track which is drawn by the pen tip 1128 near a screen of the electronic device is input into the electronic device, and the electronic device displays the track or characters and patterns represented by the track on the screen; on the other hand, the pen tip 1128 can also trigger the "click" input of the electronic device, similar to the function of clicking the screen of the electronic device by the fingers of a human hand, so as to realize the functions of menu selection, button triggering and the like. The rear of the tip 1128 is in contact with the pressure sensor 1126, and the pressure sensor 1126 may sense the force with which the tip 1128 is in contact with the electronic device screen when the tip 1128 is in contact with the electronic device screen.

The pen body 1102 is in the shape of a long and thin rod, and generally houses components such as a circuit board assembly and a power module 1122 therein. The circuit board assembly includes an Inertial Measurement Unit (IMU) 1118, a communication device 1120, a Power Management Unit (PMU) 1124, and a processing device 1110, and the Power module 1122 is typically a battery for supplying Power to the circuits such as the circuit board assembly. The PMU converts energy of the power module 1122 into electric energy required by each module, and also needs to manage (e.g., discharge and charge management) the electric quantity of the power module 1122. The Communication device 1120 is generally a carrier with a Near Field Communication function, and implements wireless Communication with an electronic device, and common Communication modes include classic Bluetooth, Low Energy Bluetooth (BLE), Radio Frequency Identification (RFID), Near Field Communication (NFC), and the like. The IMU is mainly used for monitoring information such as the posture and trajectory of the stylus, for example, the rotation state of the stylus and the tapping action of the stylus on the screen of the electronic device. The processing device 1110 controls operations, sleep, data transmission, and the like of all modules, and is typically a Micro Controller Unit (MCU) with low power consumption.

When the user writes, draws on the screen of the electronic device using the stylus, the pressure sensor 1126 senses the magnitude of the real-time pressing force of the pen tip 1128 and inputs a pressure value to the processing device 1110. The processing device 1110 informs the electronic device of the thickness of the handwriting displayed by the communication device 1120 according to the magnitude of the pressure value. For example, when a user writes heavily, the handwriting displayed by the electronic device is thicker; when the writing is light, the handwriting displayed by the electronic equipment is thinner.

In this embodiment, an image capturing device 1108 is disposed at the pen tail 1106 and is used for reading information such as text and images, and a processing device 1110 converts the read text and images into digital signals and transmits the digital signals to the electronic device through a communication device 1120. The pen tip portion 1104 interacts with the electronic device through the pen tip 1128, and controls the electronic device to "paste" the digital signal at a designated position. The digital signal may be a second language into which the processing device 1110 translates the read text from the first language, thereby implementing a one-key pasting translation function.

In one embodiment of the present application, the stylus further includes: a lens device 1112 is disposed adjacent to the image capture device 1108.

In this embodiment, the lens device 1112, on one hand, allows external light to smoothly enter the image capturing device 1108, and on the other hand, prevents the image capturing device 1108 from being exposed to the outside, thereby protecting the image capturing device 1108. The image capture device 1108 captures an image of the environment in the vicinity of the lens device 1112 by receiving external light from the other side of the lens device 1112.

In one embodiment of the present application, the stylus further includes: and a light source device 1114 disposed adjacent to the image capture device 1108, the light source device 1114 emitting a light source to the captured subject.

In this embodiment, the light source 1114 is mainly used to fill the imaging subject (i.e. the collecting subject) with light, so as to ensure that the image collecting device 1108 can capture a clear and bright image in a dark environment.

In one embodiment of the present application, as shown in fig. 11, in the case that the image capturing device 1108 is disposed at the pen tail 1106, the pen tail 1106 is provided with a capturing surface 1116, and the capturing surface 1116 is an inclined surface.

In this embodiment, the end of the pen tail 1106 is provided with a capturing surface 1116, and the capturing surface 1116 is a slope, for example, the capturing surface 1116 is wedge-shaped with a slope characteristic. The capture plane 1116 is a capture area, and the image capture device 1108, the lens device 1112, the light source device 1114, and the like are disposed therein. By setting the collecting surface 1116 to be an inclined surface, the pen holding posture of a user can be adapted, and the user can conveniently collect images.

In one embodiment of the present application, the pen tail 1106 rotates about the axis of the pen body 1102.

In this embodiment, the pen tail 1106 can rotate around the central axis of the pen body 1102, i.e., the capturing surface 1116 of the pen tail 1106 can be adjusted to any direction. Naturally keeping the acquisition face 1116 oriented towards the ground even under the influence of gravity. Therefore, the inclined plane can be quickly and conveniently oriented to the drawing surface of the collection object such as a book and an electronic device, and the pen holder does not need to be manually rotated.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A control method of a touch control pen is characterized in that the touch control pen is in communication connection with an electronic device, the touch control pen has an image acquisition function, and the control method comprises the following steps:

receiving a first input;

acquiring a first image of an acquisition object in response to the first input;

receiving a second input;

and responding to the second input, and sending the target information of the first image to the electronic equipment for displaying.

2. The method for controlling the stylus according to claim 1, wherein the sending the target information of the first image to an electronic device for displaying comprises:

identifying the first image to obtain target information;

sending the target information to the electronic equipment for display;

wherein the target information comprises at least one of: text content, color, text font, text ground color, paragraph format, graphics, image.

3. The method for controlling the stylus according to claim 1, wherein the sending the target information of the first image to an electronic device for displaying comprises:

identifying the first image to obtain target character information;

converting the target text information from a first language to a second language;

and sending the target text information converted into the second language to the electronic equipment for displaying.

4. A control method of an electronic device, wherein the electronic device is in communication connection with a touch pen, and the touch pen has an image acquisition function, the control method comprising:

receiving a third input of the touch pen, and receiving target information sent by the touch pen;

displaying the target information in response to the third input;

5. The method of controlling an electronic device according to claim 4, wherein the receiving a third input of the stylus comprises:

receiving a third input of the stylus pen in a target display area of the electronic device;

the displaying the target information specifically includes:

and displaying the target information in the target display area.

6. The method of controlling an electronic device according to claim 4, wherein said displaying the target information in response to the third input comprises:

in response to the third input, converting the target information from a first language to a second language;

displaying the target information converted into the second language.

7. A control device of a touch pen, wherein the touch pen is in communication connection with an electronic device, the touch pen has an image acquisition function, and the control device comprises:

the first receiving module is used for receiving a first input;

an acquisition module to acquire a first image of an acquisition object in response to the first input;

the second receiving module is used for receiving a second input;

and the sending module is used for responding to the second input and sending the target information of the first image to the electronic equipment for displaying.

8. A control device of an electronic device, wherein the electronic device is in communication connection with a touch pen, the touch pen having an image capturing function, the control device comprising:

a third receiving module, configured to receive a third input of the stylus;

the fourth receiving module is used for receiving the target information sent by the touch pen;

a display module to display the target information in response to the third input.

9. A stylus, wherein the stylus is communicatively coupled to an electronic device, the stylus comprising:

a pen body part;

the pen head part is arranged at one end of the pen body part;

the pen tail part is arranged at the other end of the pen body part;

the image acquisition device is arranged in any one of the pen body part, the pen head part and the pen tail part and is used for acquiring a first image of an acquisition object;

the processing device is arranged in any one of the pen body part, the pen head part and the pen tail part and is connected with the image acquisition device, and the processing device is used for identifying the first image to obtain target information;

the communication device is arranged in any one of the pen body part, the pen head part and the pen tail part and is used for sending the target information to the electronic equipment for display.

10. The stylus of claim 9, further comprising:

and the lens device is arranged adjacent to the image acquisition device.

11. The stylus of claim 9, further comprising:

and the light source device is arranged adjacent to the image acquisition device and emits light sources to the acquisition object.

12. The stylus according to any one of claims 9 to 11,

the image acquisition device is arranged on the pen tail, the pen tail is provided with an acquisition surface, and the acquisition surface is an inclined surface.

13. The stylus of claim 12,

the pen tail part rotates around the axis of the pen body part.