CN115379043B

CN115379043B - Cross-equipment text connection method and electronic equipment

Info

Publication number: CN115379043B
Application number: CN202110539423.0A
Authority: CN
Inventors: 徐文华
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-05-18
Filing date: 2021-05-18
Publication date: 2024-06-04
Anticipated expiration: 2041-05-18
Also published as: CN115379043A; WO2022242343A1

Abstract

The application provides a method for text connection across devices, which comprises the following steps: when text content is displayed on an interface of a first electronic device and the distance between the first electronic device and a second electronic device is smaller than or equal to a first threshold value, the first electronic device extracts first information, and the first information comprises information related to the text content; the first electronic device sends the first information to the second electronic device; and the second electronic equipment plays the voice corresponding to the text content according to the first information. The scheme provided by the application can realize connection among different media and cross equipment, and improves the experience of users.

Description

Cross-equipment text connection method and electronic equipment

Technical Field

The present application relates to the field of data processing, and in particular, to a method for text connection across devices and an electronic device.

Background

Along with the rapid development of mobile device hardware technology and the vigorous demands of consumers, the current intelligent devices at the front end side develop to diversity, and more electronic devices have media capabilities similar to those of smart phones, such as devices like smart speakers, watches, large screens and the like. For example, the intelligent sound box can provide better sound quality and better voice interaction capability compared with a mobile phone. The loudspeaker box equipment can be mutually complemented with other equipment to be matched with the other equipment, so that the service connection capability of the cross equipment is realized, and the use habit of a user in different scenes is met.

Aiming at the service connection capability of the cross-equipment, the playing connection of the audio can be realized at present, for example, a user listens to the music on a mobile phone music application (application, APP), the mobile phone is close to the sound box equipment, the music starts to be switched to the sound box equipment for playing, and the playing is stopped on the mobile phone; similarly, the user listens to music on the speaker device, brings the phone closer to the speaker device, switches music to play on the phone, and stops playing on the speaker device. But this approach can only enable continuation between the same media (such as the audio described above) and not across media.

At present, continuous text-to-speech playing on the same client can also be realized, which comprises the following steps: receiving a voice playing command of a user to a text; acquiring text from a corresponding digital document of a server, and simultaneously playing a middle dead point voice file; after the text is acquired, checking whether the voice file of the stop point is completely played, and if so, starting voice generation and playing from a position corresponding to the end of the voice file of the stop point in the text; when a user sends out a command for stopping the voice playing of the text, recording the current playing stopping position in the text, updating the middle point by using the position, generating a voice file corresponding to a text segment with a set length before and after the current middle point in the text, and replacing the voice file at the stopping point. The method and the device can solve the problem of too slow loading speed during voice playing of the digital document, shorten the waiting time of a user and improve the user experience. However, this approach does not enable the ability to connect between different client types.

Disclosure of Invention

The application provides a method for text connection across equipment and electronic equipment, which can realize connection between different media across equipment and promote user experience.

In a first aspect, a method of text continuation across devices is provided, the method comprising: when text content is displayed on an interface of a first electronic device and the distance between the first electronic device and a second electronic device is smaller than or equal to a first threshold value, the first electronic device extracts first information, and the first information comprises information related to the text content;

the first electronic device sends the first information to the second electronic device;

And the second electronic equipment plays the voice corresponding to the text content according to the first information.

According to the scheme provided by the application, when the text content is displayed on the interface of the first electronic device and the distance between the first electronic device and the second electronic device is smaller than or equal to the first threshold value, the first electronic device can extract the first information and send the first information to the second electronic device, so that the second electronic device can play the voice corresponding to the text content according to the first information. Because the first electronic equipment is close to the second electronic equipment, the second electronic equipment can play the text content of the first electronic equipment in the form of audio, so that connection among different media can be realized, and the experience of a user is improved.

With reference to the first aspect, in some possible implementations, the first information includes at least one of the following information:

The source address of the text content, the current offset position of the text content, and information of a user accessing the text content.

With reference to the first aspect, in some possible implementations, the method further includes:

The second electronic device sends second information to the first electronic device, wherein the second information comprises information for encryption;

the first electronic device sending the first information to the second electronic device, including:

The first electronic device encrypts the first information by using the second information;

the first electronic device sends encrypted first information to the second electronic device;

The method further comprises the steps of:

and the second electronic equipment decrypts the encrypted first information to obtain the first information.

According to the scheme provided by the application, the first information can be safely transmitted by encrypting the first information, so that the safety of information transmission can be ensured.

With reference to the first aspect, in some possible implementations, the playing, by the second electronic device, speech corresponding to the text content according to the first information includes:

The second electronic equipment requests the text content from a cloud server of the second electronic equipment according to the source address of the text content in the first information and the information of a user accessing the text content;

The cloud server of the second electronic device sends the text content to the second electronic device;

The second electronic equipment extracts target text content from the text content according to the current offset position of the text content in the first information;

The second electronic device converts the target text content into voice;

the second electronic device plays the voice.

According to the scheme provided by the application, the second electronic equipment can request the text content from the cloud server of the second electronic equipment according to the source address of the text content in the first information and the information of the user accessing the text content, and after receiving the text content, the second electronic equipment extracts the target text content from the text content according to the current offset position, and converts the target text content into voice for playing. The second electronic equipment extracts the target text content from the text content according to the current offset position, namely, the specific position read by the user before can be positioned, and the target text content is converted into voice to be played continuously, so that the connection of the text content between the second electronic equipment and the first electronic equipment can be realized, and further, the experience of the user can be improved.

the second electronic device sends the first information to a cloud server of the second electronic device;

The second electronic device plays the voice corresponding to the text content according to the first information, and the method comprises the following steps:

the cloud server of the second electronic device extracts target text content from the text content according to the current offset position in the first information;

The cloud server of the second electronic equipment converts the target text content into voice;

the cloud server of the second electronic device sends the voice to the second electronic device;

the second electronic device plays the voice.

According to the scheme provided by the application, the second electronic equipment can request the text content from the cloud server of the second electronic equipment according to the source address of the text content in the first information and the information of the user accessing the text content, and after receiving the request, the cloud server of the second electronic equipment extracts the target text content from the text content according to the current offset position, converts the target text content into voice and then sends the voice to the second electronic equipment, so that the second electronic equipment plays the voice. Because the voice received by the second electronic equipment is obtained by extracting the target text content from the text content according to the current offset position by the cloud server of the second electronic equipment and converting the target text content into the voice, the connection of the text content between the second electronic equipment and the first electronic equipment can be realized, and further, the experience of a user can be improved.

and the cloud server of the second electronic equipment caches the voice.

According to the scheme provided by the application, the cloud server of the second electronic device can buffer the converted voice, and when other users read the same text content and need to play the text content by the sound box device, the cloud server can save the time for converting the text content into the voice and can send the voice fragments buffered by the cloud server to the sound box device, so that the efficiency can be improved.

When the distance between the first electronic device and the second electronic device is smaller than or equal to the first threshold value again, the second electronic device sends third information to the first electronic device, wherein the third information is used for requesting identity information of the first electronic device;

The first electronic device sends identity information of the first electronic device to the second electronic device;

The second electronic equipment determines whether to extract the first information according to the identity information of the first electronic equipment and the identity information of the second electronic equipment.

According to the scheme provided by the application, when the distance between the first electronic device and the second electronic device is smaller than or equal to the first threshold value again, the second electronic device can send third information to the first electronic device so as to request the identity information of the first electronic device, and after receiving the identity information sent by the first electronic device, the second electronic device determines whether to extract the first information according to the information and the identity information of the second electronic device so as to trigger the second electronic device to stop playing and continue to the first electronic device to continue reading. Therefore, the connection of the text content from the second electronic equipment to the first electronic equipment can be realized, and further, the experience of a user can be improved.

With reference to the first aspect, in some possible implementations, the determining, by the second electronic device, whether to extract the first information according to the identity information of the first electronic device and the identity information of the second electronic device includes:

the second electronic equipment sends the identity information of the first electronic equipment and the identity information of the second electronic equipment to a cloud server of the second electronic equipment;

The cloud server of the second electronic device verifies the identity information of the first electronic device and the identity information of the second electronic device;

The cloud server of the second electronic device sends a checked result to the second electronic device;

and the second electronic equipment determines whether to extract the first information according to the checked result.

With reference to the first aspect, in some possible implementations, the determining, by the second electronic device, whether to extract the first information according to the checked result includes:

if the checked result is that the identity information of the first electronic equipment is not matched with the identity information of the second electronic equipment, the second electronic equipment determines that the first information is not extracted; or alternatively, the first and second heat exchangers may be,

If the checked result is that the identity information of the first electronic equipment is matched with the identity information of the second electronic equipment, the second electronic equipment determines to extract the first information;

The method further comprises the steps of:

the second electronic equipment sends the first information to the first electronic equipment;

the first electronic device receives the first information;

And the first electronic equipment determines the text position played by the second electronic equipment according to the first information.

According to the scheme provided by the application, when the identity information of the first electronic device is matched with the identity information of the second electronic device as a result of verification, the second electronic device determines to extract the first information and sends the first information to the first electronic device, so that the first electronic device can determine the text position played by the second electronic device according to the first information, the connection of text content from the second electronic device to the first electronic device can be realized, and further, the experience of a user can be improved.

In a second aspect, a method of text continuation across devices is provided, the method comprising: the second electronic equipment receives first information sent by the first electronic equipment, wherein the first information comprises information related to text content;

According to the scheme provided by the application, the second electronic equipment can play the voice corresponding to the text content according to the received first information. The second electronic device can play the text content of the first electronic device in the form of audio, so that connection among different media can be realized, and the user experience is improved.

With reference to the second aspect, in some possible implementations, the first information includes at least one of the following information:

With reference to the second aspect, in some possible implementations, the method further includes:

the second electronic device receives first information sent by the first electronic device, and the first information comprises:

The second electronic equipment receives encrypted first information sent by the first electronic equipment;

With reference to the second aspect, in some possible implementations, the playing, by the second electronic device, speech corresponding to the text content according to the first information includes:

The second electronic device receives the text content;

The second electronic device converts the target text content into voice;

the second electronic device plays the voice.

the second electronic equipment receives voice sent by a cloud server of the second electronic equipment;

the second electronic device plays the voice.

According to the scheme provided by the application, the second electronic equipment can request the text content to the cloud server of the second electronic equipment according to the source address of the text content in the first information and the information of the user accessing the text content, and after receiving the request, the cloud server of the second electronic equipment sends the voice to the second electronic equipment, so that the second electronic equipment plays the voice. The voice received by the second electronic device is obtained by processing the text content conversion by the cloud server of the second electronic device, so that connection of the text content between the second electronic device and the first electronic device can be realized, and further, user experience can be improved.

When the distance between the first electronic device and the second electronic device is smaller than or equal to a first threshold value again, the second electronic device sends third information to the first electronic device, wherein the third information is used for requesting identity information of the first electronic device;

the second electronic equipment receives the identity information of the first electronic equipment, which is sent by the first electronic equipment;

With reference to the second aspect, in some possible implementations, the determining, by the second electronic device, whether to extract the first information according to the identity information of the first electronic device and the identity information of the second electronic device includes:

And the second electronic equipment determines whether to extract the first information according to the checked result sent by the cloud server of the second electronic equipment.

With reference to the second aspect, in some possible implementations, the determining, by the second electronic device, whether to extract the first information according to a verification result sent by a cloud server of the second electronic device includes:

The method further comprises the steps of:

the second electronic device sends the first information to the first electronic device.

In a third aspect, a method of text continuation across devices is provided, the method comprising:

when the interface of the first electronic device displays text content and the distance between the first electronic device and the second electronic device is smaller than or equal to a first threshold value, the first electronic device extracts first information, and the first information comprises information related to the text content.

The first electronic device sends the first information to the second electronic device.

With reference to the third aspect, in some possible implementations, the first information includes at least one of the following information:

With reference to the third aspect, in some possible implementations, the method further includes:

the first electronic device receives second information, wherein the second information comprises information for encryption;

and the first electronic equipment sends the encrypted first information to the second electronic equipment.

The first electronic equipment receives third information, wherein the third information is used for requesting identity information of the first electronic equipment;

The first electronic device sends the identity information of the first electronic device to the second electronic device.

According to the scheme provided by the application, the first electronic equipment receives the third information sent by the second electronic equipment to request the identity information of the first electronic equipment, and the first electronic equipment sends the identity information of the first electronic equipment to the second electronic equipment, so that the second electronic equipment determines whether to extract the first information according to the information and the identity information of the second electronic equipment so as to trigger the second electronic equipment to stop playing and continue to the first electronic equipment to continue reading. Therefore, the connection of the text content from the second electronic equipment to the first electronic equipment can be realized, and further, the experience of a user can be improved.

the first electronic device receives the first information;

According to the scheme provided by the application, after the first electronic device receives the first information, the text position played by the second electronic device can be determined according to the first information, so that the connection of the text content from the second electronic device to the first electronic device can be realized, and further, the user experience can be improved.

In a fourth aspect, there is provided a system comprising:

a first electronic device for: when text content is displayed on an interface of a first electronic device, and the distance between the first electronic device and a second electronic device is smaller than or equal to a first threshold value, first information is extracted, and the first information comprises information related to the text content;

transmitting the first information to the second electronic device;

the second electronic device is configured to: and playing the voice corresponding to the text content according to the first information.

With reference to the fourth aspect, in some possible implementations, the first information includes at least one of the following information:

With reference to the fourth aspect, in some possible implementations, the second electronic device is further configured to:

transmitting second information to the first electronic device, the second information including information for encryption;

The first electronic device is further configured to:

encrypting the first information using the second information;

sending the encrypted first information to the second electronic equipment;

The second electronic device is further configured to: decrypting the encrypted first information to obtain the first information.

Requesting the text content from a cloud server of the second electronic device according to the source address of the text content in the first information and the information of the user accessing the text content;

The cloud server of the second electronic device is further configured to: transmitting the text content to the second electronic device;

the second electronic device is further configured to: extracting target text content from the text content according to the current offset position of the text content in the first information;

Converting the target text content into voice;

And playing the voice.

Sending the first information to a cloud server of the second electronic device;

The cloud server of the second electronic device is further configured to: extracting target text content from the text content according to the current offset position in the first information;

Converting the target text content into voice;

Transmitting the voice to the second electronic device;

the second electronic device is further configured to: and playing the voice.

With reference to the fourth aspect, in some possible implementations, the cloud server of the second electronic device is further configured to: the speech is buffered.

When the distance between the first electronic device and the second electronic device is smaller than or equal to the first threshold value again, third information is sent to the first electronic device, and the third information is used for requesting identity information of the first electronic device;

The first electronic device is further configured to: transmitting identity information of the first electronic device to the second electronic device;

The second electronic device is further configured to: and determining whether to extract the first information according to the identity information of the first electronic equipment and the identity information of the second electronic equipment.

The identity information of the first electronic equipment and the identity information of the second electronic equipment are sent to a cloud server of the second electronic equipment;

the cloud server of the second electronic device is further configured to: verifying the identity information of the first electronic equipment and the identity information of the second electronic equipment;

sending the checked result to the second electronic equipment;

The second electronic device is further configured to: and determining whether to extract the first information according to the checked result.

If the checked result is that the identity information of the first electronic equipment is not matched with the identity information of the second electronic equipment, determining that the first information is not extracted; or alternatively, the first and second heat exchangers may be,

If the checked result is that the identity information of the first electronic equipment is matched with the identity information of the second electronic equipment, determining to extract the first information;

Transmitting the first information to the first electronic device;

The first electronic device is further configured to: receiving the first information;

and determining the text position played by the second electronic equipment according to the first information.

The fourth aspect is described in detail in the first aspect, and will not be repeated.

In a fifth aspect, there is provided an electronic device comprising:

The communication module is used for receiving first information sent by the first electronic equipment, wherein the first information comprises information related to text content;

and the playing module is used for playing the voice corresponding to the text content according to the first information.

With reference to the fifth aspect, in some possible implementations, the first information includes at least one of the following information:

With reference to the fifth aspect, in some possible implementations, the communication module is further configured to: transmitting second information to the first electronic device, the second information including information for encryption;

receiving encrypted first information sent by the first electronic equipment;

The electronic device further includes:

and the decryption module is used for decrypting the encrypted first information to obtain the first information.

With reference to the fifth aspect, in some possible implementations, the electronic device further includes:

a request module, configured to request the text content from a cloud server of the second electronic device according to a source address of the text content in the first information and information of a user accessing the text content;

the communication module is further configured to: receiving the text content;

The electronic device further includes:

an extracting module, configured to extract target text content from the text content according to a current offset position of the text content in the first information;

The conversion module is used for converting the target text content into voice;

the playing module is further configured to: and playing the voice.

The communication module is further configured to: receiving voice sent by a cloud server of the second electronic equipment;

the playing module is further configured to: and playing the voice.

With reference to the fifth aspect, in some possible implementations, the communication module is further configured to:

When the distance between the first electronic device and the second electronic device is smaller than or equal to a first threshold value again, third information is sent to the first electronic device, and the third information is used for requesting identity information of the first electronic device;

receiving identity information of the first electronic equipment, which is sent by the first electronic equipment;

The electronic device further includes:

And the determining module is used for determining whether to extract the first information according to the identity information of the first electronic equipment and the identity information of the second electronic equipment.

The determination module is further to: and determining whether to extract the first information according to a checked result sent by the cloud server of the second electronic equipment.

With reference to the fifth aspect, in some possible implementations, the determining module is further configured to:

the communication module is further configured to:

and sending the first information to the first electronic equipment.

The fifth aspect is described in the second aspect, and is not repeated.

In a sixth aspect, there is provided an electronic device comprising:

and the extraction module is used for extracting first information when the text content is displayed on the interface of the first electronic equipment and the distance between the first electronic equipment and the second electronic equipment is smaller than or equal to a first threshold value, and the first information comprises information related to the text content.

And the communication module is used for sending the first information to the second electronic equipment.

With reference to the sixth aspect, in some possible implementations, the first information includes at least one of the following information:

With reference to the sixth aspect, in some possible implementations, the communication module is further configured to:

Receiving second information, the second information comprising information for encryption;

The electronic device further includes:

The encryption module is used for encrypting the first information by utilizing the second information;

the communication module is further configured to: and sending the encrypted first information to the second electronic equipment.

Receiving third information, wherein the third information is used for requesting identity information of the first electronic equipment;

and sending the identity information of the first electronic equipment to the second electronic equipment.

Receiving the first information;

The electronic device further includes:

And the determining module is used for determining the text position played by the second electronic equipment according to the first information.

The sixth aspect is described in the third aspect, and will not be described in detail.

In a seventh aspect, there is provided an electronic device comprising: one or more processors; a memory; one or more applications; and one or more computer programs. Wherein one or more computer programs are stored in the memory, the one or more computer programs comprising instructions. The instructions, when executed by an electronic device, cause the electronic device to perform the method in any one of the possible implementations of the second or third aspects described above.

In an eighth aspect, there is provided a system on a chip comprising at least one processor, wherein program instructions, when executed in the at least one processor, cause the functions of the method in any one of the possible implementations of the first to third aspects to be implemented on the electronic device.

In a ninth aspect, there is provided a computer storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any one of the possible implementations of the first to third aspects described above.

In a tenth aspect, there is provided a computer program product for, when run on an electronic device, causing the electronic device to perform the method in the possible designs of any of the above first to third aspects.

Drawings

Fig. 1 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Fig. 2 is a schematic software structure of an electronic device according to an embodiment of the present application.

Fig. 3 is a schematic view of a scenario in which an embodiment of the present application is applied.

FIG. 4 is a schematic diagram of a set of GUIs provided in an embodiment of the present application.

FIG. 5 is a schematic diagram of another set of GUIs provided in an embodiment of the present application.

Fig. 6 is a schematic diagram of a method for text splicing across devices according to an embodiment of the present application.

Fig. 7 is a schematic diagram of another method for text splicing across devices according to an embodiment of the present application.

Fig. 8 is a schematic diagram of yet another method for text splicing across devices provided by an embodiment of the present application.

Fig. 9 is a schematic diagram of yet another method for text splicing across devices according to an embodiment of the present application.

Fig. 10 is a schematic diagram of still another method for text splicing across devices according to an embodiment of the present application.

Fig. 11 is a schematic diagram of still another method for text splicing across devices according to an embodiment of the present application.

Fig. 12 is a schematic block diagram of another electronic device provided by an embodiment of the present application.

Fig. 13 is a schematic block diagram of still another electronic device provided by an embodiment of the present application.

Fig. 14 is a schematic block diagram of still another electronic device provided by an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" means two or more than two.

The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature.

The method for text connection across devices provided by the embodiment of the application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (augmented reality, AR)/Virtual Reality (VR) devices, notebook computers, ultra-mobile personal computer (UMPC), netbooks, personal digital assistants (personal DIGITAL ASSISTANT, PDA) and sound box devices, and the embodiment of the application does not limit the specific types of the electronic devices.

By way of example, fig. 1 shows a schematic diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a memory, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural Network Processor (NPU), etc. The extraction of the first information for text continuation across devices and the encryption of the first information in the embodiment of the present application may be implemented by the processor 110.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display 194 is used to display text, images, video, etc., as may be shown below in fig. 4 or 5. The display 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

Fig. 2 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present application. The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows (Android runtime) and system libraries, and a kernel layer, respectively. The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, APP1, APP2, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for the application of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Aiming at the service connection capability of the cross-equipment, the playing connection of the audio can be realized at present, for example, a user listens to the music on the mobile phone music APP, the mobile phone is close to the sound box equipment, the music starts to be switched to the sound box equipment for playing, and the playing is stopped on the mobile phone; similarly, the user listens to music on the speaker device, brings the phone closer to the speaker device, switches music to play on the phone, and stops playing on the speaker device. But this approach can only enable continuation between the same media (such as the audio described above) and not across media.

The application provides a method for text connection of cross-equipment, which can realize connection among different media and improve user experience.

The application takes a mobile phone and a voice box device as an example, and simply introduces the scene to which the scheme of the application can be applied.

Fig. 3 is a schematic view of a scenario in which an embodiment of the present application is applied. Wherein, APP1 on the cell-phone can be the APP of novel class, APP2 can be the APP of news information class. For text content on the mobile phone, the method can support audio playing on the sound box equipment, and simultaneously support continuous connection of sound box audio to text content on the mobile phone side for viewing by a user.

Sound box equipment: providing switching capability of normal antenna and weak antenna, and when switching to weak antenna, providing secret key for security encryption; and when switching to the normal antenna, the encrypted information can be transmitted to the mobile phone. For the speaker device, text on the mobile phone side can be supported to be connected into audio on the speaker side; while reverse support is provided for splicing the audio on the speaker side to text on the handset side.

Sound box cloud: providing the skill for acquiring the content and realizing the acquisition of the text content.

For easy understanding, the following embodiments of the present application will take an electronic device having a structure shown in fig. 1 and fig. 2 as an example, and specifically describe a method for text continuation across devices provided in the embodiments of the present application with reference to the accompanying drawings and application scenarios.

Fig. 4 shows a set of graphical user interfaces (GRAPHICAL USER INTERFACE, GUI) of the handset, where from (a) in fig. 4 to (e) in fig. 4 show a method of APP2 in the handset to connect with a speaker device and implement text continuation across devices.

Referring to the GUI shown in (a) of fig. 4, the GUI is a desktop of the mobile phone. When the mobile phone detects that the user clicks on the icon 401 of App2 on the desktop, app2 may be started, and a GUI, which may be referred to as a news home page interface, is displayed as shown in (b) of fig. 4.

Referring to the GUI shown in fig. 4 (b), a plurality of news-related information is displayed, and when the mobile phone detects an operation of clicking a certain news frame 402 by the user, the GUI shown in fig. 4 (c) may be displayed.

Referring to the GUI shown in fig. 4 (c), the interface displays content related to the news, the user may start reading the content related to the news, if the user does not want to continue reading with the mobile phone when reading the 6 th line, the mobile phone may be moved to the vicinity of the speaker device, for example, to a position within 30 cm from the speaker device, then the 6 th line and subsequent text contents may be played on the speaker device, and at this time, the mobile phone interface still displays the current page (assuming that the speaker device and the mobile phone are connected under the same Wi-Fi).

After the sound box equipment plays for a period of time, if a user wants to continue reading by the mobile phone, the mobile phone can be moved to the vicinity of the sound box equipment again, the sound box equipment stops playing text content, and meanwhile, the mobile phone interface can display the specific position of the sound box equipment playing content.

Illustratively, assuming that the speaker device plays to line 13 of the current page, the user again moves the handset to the vicinity of the speaker device, the speaker device stops playing text content while the handset interface displays a GUI as shown in (d) of fig. 4. Referring to the GUI shown in fig. 4 (d), it can be seen that the font of line 13 in the figure is darker in color than the fonts of the other lines. Thus, the user can know that the speaker device has played text content to line 13 when the handset is moved again into proximity with the speaker device so that the user can continue reading back from line 13.

Illustratively, assuming that the speaker device plays to line 3 of another page (which may be the next page or the next page, etc.), the user again moves the handset near the speaker device, the speaker device stops playing text content while the handset interface displays the GUI as shown in fig. 4 (e). Referring to the GUI shown in fig. 4 (e), it can be seen that the interface displays a refreshed page, and the 3 rd line of the drawing has a darker color than the other lines. Thus, the user can know that the speaker device has played text content to line 3 of the page when the handset is moved again into proximity with the speaker device so that the user can continue reading back from line 3 of the page.

Fig. 5 shows another set of GUIs of the handset, where from (a) in fig. 5 to (f) in fig. 5 show a method of APP2 in the handset to connect with a speaker device and achieve text continuation across devices.

Referring to the GUI shown in (a) of fig. 5, the GUI is a desktop of the mobile phone. When the mobile phone detects that the user clicks on the icon 501 of App2 on the desktop, app2 may be started, and a GUI, which may be referred to as a news home page interface, is displayed as shown in (b) of fig. 5.

Referring to the GUI shown in fig. 5 (b), a plurality of news-related information is displayed, and when the mobile phone detects an operation of clicking the icon 502 of App2 by the user, the GUI shown in fig. 5 (c) may be displayed.

Referring to the GUI shown in fig. 5 (c), the interface displays content related to the news, the user can start reading the content related to the news, and if the user does not want to continue reading with the mobile phone while reading the 6 th line, the 6 th line can be slid to the 1 st line of the mobile phone interface by hand, and the GUI shown in fig. 5 (d) is displayed. And then the mobile phone is moved to the vicinity of the sound box device, if the mobile phone is moved to a position within 30 cm from the sound box device, the 6 th line (the 1 st line of the current interface) and subsequent text contents can be played on the sound box device (assuming that the sound box device and the mobile phone are connected under the same Wi-Fi).

Illustratively, assuming that the speaker device plays to line 13 of the current page, the user again moves the handset to the vicinity of the speaker device, the speaker device stops playing text content while the handset interface displays a GUI as shown in fig. 5 (e). Referring to the GUI shown in fig. 5 (e), it can be seen that the font of line 13 in the figure is darker in color than the fonts of the other lines. Thus, the user can know that the speaker device has played text content to line 13 when the handset is moved again into proximity with the speaker device so that the user can continue reading back from line 13.

Illustratively, assuming that the speaker device plays to line 3 of another page (which may be the next page or the next page, etc.), the user again moves the handset near the speaker device, the speaker device stops playing text content while the handset interface displays the GUI as shown in fig. 5 (f). Referring to the GUI shown in fig. 5 (f), it can be seen that the interface displays a refreshed page, and the 3 rd line of the drawing has a darker color than the other lines. Thus, the user can know that the speaker device has played text content to line 3 of the page when the handset is moved again into proximity with the speaker device so that the user can continue reading back from line 3 of the page.

It should be noted that, if the user opens APP1, the text connection process is similar to the process of fig. 4 or fig. 5, and will not be repeated. Furthermore, the APP1 and APP2 shown above are only exemplary, but may be other APPs including text content, and should not be construed as limiting the application in any way.

The embodiment of the application can also be applied to dictionary pens and voice box equipment, the voice box equipment starts to play words when the dictionary pens approach or touch the voice box equipment for the first time, the voice box equipment stops playing when the dictionary pens approach or touch the voice box equipment again, and the dictionary pens acquire the index currently being played and position the current words.

The following describes the internal implementation process and judgment logic for implementing text continuation across devices in an embodiment of the present application with reference to fig. 6-8. Fig. 6 shows a schematic diagram of a method 600 for text splicing across devices according to an embodiment of the present application, where the method 600 may include steps S610-S640.

S610, the mobile phone subscribes to Wi-Fi perception service of the sound box equipment, and the user brings the mobile phone close to the sound box equipment and the sound box equipment discovers the mobile phone.

In the embodiment of the application, the Wi-Fi sensing service of the mobile phone subscription sound box equipment can be set in the mobile phone in advance, and when a user approaches the mobile phone to the sound box equipment, the sound box equipment can discover the mobile phone through Wi-Fi because the sound box equipment and the mobile phone are connected through Wi-Fi.

Wherein, above-mentioned cell-phone is close to audio amplifier equipment, and audio amplifier equipment discovers the cell-phone and can understand as: when the distance between the mobile phone and the sound box equipment is smaller than a certain threshold value, the sound box equipment can find the mobile phone. For example, assuming that the threshold is 30cm, if the handset is less than 30cm from the speaker device, the speaker device will find the handset.

S612, the sound box equipment recognizes that the mobile phone is close, the current state is a reading state, and the triggering antenna is a weak antenna.

S614, the speaker device dynamically generates an encryption key and encrypts the key using the private key.

S616, the sound box device sends the encrypted secret key to the mobile phone.

S618, after the sound box equipment transmits successfully, the antenna is switched to a normal mode.

In the embodiment of the application, when the sound box equipment recognizes that the mobile phone is approaching to the mobile phone gradually, and the mobile phone is in a reading state (such as displaying a certain news or displaying a certain section of a novel on the current interface of the mobile phone), the sound box equipment can trigger the antenna to be a weak antenna. As shown in fig. 3, when the antenna is a weak antenna, a key for secure encryption may be provided, so that the speaker device may dynamically generate a key, encrypt the key with the private key, and then send the encrypted key to the mobile phone. After the sound box equipment successfully sends the encrypted secret key to the mobile phone, the antenna is triggered to be converted into a normal mode. It should be noted that, in the normal mode, the speaker device may transmit information with the mobile phone.

S620, the mobile phone triggers a text connection request, extracts content source information and the current content offset position, and simultaneously acquires a user accessing the content source and authentication information.

In the embodiment of the present application, the step S620 of triggering the text request by the mobile phone may be executed simultaneously with any one of the steps S612, S614, S616 and S618, or may be executed after the step S618, which is not limited.

After triggering the text connection request, the mobile phone can extract a plurality of information including content source information and current content offset position, and simultaneously acquire the user accessing the content source and authentication information. The content source information may be a source address of a content currently accessed by the user, the current content offset position may be a difference value between a line number currently read by the user and a first line or a difference value between a word currently read by the user and a first word of the first line, and the user accessing the content source and the authentication information may be information related to the user, such as whether the user registers and logs in on the APP normally, that is, whether the user is legal is identified.

It should be noted that, the current content position offset may be the identification of the eyeball of the user through the camera on the mobile phone, that is, the number of lines of the page where the eyeball of the user looks at the mobile phone may be identified through the camera, as shown in (d) of fig. 4, if the user does not want to continue reading with the mobile phone when reading the 6 th line, the mobile phone may be moved to the vicinity of the speaker device, at this time, the mobile phone may capture the number of lines of the page where the user looks at through the camera, and calculate the difference between the number of lines and the 1 st line. Of course, in some embodiments, the mobile phone may also recognize the word the user's eye looks at through the camera, and calculate the difference between the word and the 1 st row 1 word.

Or the current content offset position can also be obtained directly through the processor inside the mobile phone without the camera, as shown in (d) of fig. 5, if the user does not want to continue reading by the mobile phone when reading the 6 th line, the 6 th line can be slid to the 1 st line of the mobile phone interface by hand, the mobile phone knows that the user reads the 6 th line, and thus the mobile phone can calculate that the current content offset position is the difference between the 6 th line and the 1 st line.

S622, the mobile phone decrypts the encrypted secret key to obtain the secret key, and encrypts the information by using the secret key.

S624, the encrypted information is sent.

In the embodiment of the application, after the mobile phone extracts the information (including the content source information and the current content offset position, and simultaneously obtains the user accessing the content source and the authentication information), the mobile phone can encrypt the information by using the key (which can be obtained by decryption) sent by the sound box equipment and send the encrypted information to the sound box equipment.

S626, the loudspeaker box equipment decrypts the received information and stores the decrypted information.

In the embodiment of the application, after receiving the information sent by the mobile phone, the sound box equipment can firstly decrypt the information by using the secret key, so as to obtain the content source information and the current content offset position, and simultaneously obtain the user accessing the content source and the authentication information, and store the decrypted information.

It can be understood that in step S614, the speaker device dynamically generates the encryption key and encrypts the encryption key using the private key, and since the key, the private key and the public key are generated by the speaker device and the private key and the public key are the key pair, if the encryption is performed by the private key, the decryption is required by the public key, and if the decryption is performed by the public key, the decryption is required by the private key. After receiving the encrypted secret key, the mobile phone can decrypt the secret key by using the public key to obtain the secret key, then encrypt the information by using the secret key, and after receiving the encrypted information, the sound box equipment can decrypt the information by using the secret key.

S628, request information for requesting content text is sent to the sound box cloud based on the decrypted information.

In the embodiment of the application, the sound box equipment can obtain the information (including the content source information and the current content offset position, and simultaneously obtain the user accessing the content source and the authentication information) through decryption, and can send request information to the sound box cloud by utilizing the content source information, the user accessing the content source and the authentication information, wherein the request information is used for requesting corresponding content text.

For example, if the content source information obtained after decryption is the source address of a certain piece of news, the request information is used for requesting content text related to the news from the sound box cloud; if the content source information obtained after decryption is the source address of a novel, the request information is used for requesting content text related to the novel from the sound box cloud.

And S630, verifying the user information by the sound box cloud, and if the verification is passed, acquiring the content text.

S632, the sound box cloud sends the acquired content text to the sound box device.

In the embodiment of the application, after the loudspeaker box cloud receives the request information sent by the loudspeaker box equipment, the request information can comprise content source information, a user accessing the content source and authentication information, and the loudspeaker box cloud can firstly verify the user to verify whether the user is a legal user or not. If the verification is passed, the sound box cloud requests to obtain the corresponding content text from the cloud server of the corresponding APP based on the content source information, and the corresponding content text is sent to sound box equipment after being obtained; if the verification is not passed, the sound box cloud does not request the cloud server corresponding to the APP to acquire the corresponding content text.

S634, the sound box device locates a specific position based on the content text and the decrypted information, and extracts the text to be played.

S636, the sound box device converts the extracted text into voice and plays the voice.

In the embodiment of the present application, after receiving the content text sent by the sound box cloud, the sound box device may locate the specific position read before the user based on the information "the current content offset position" obtained after decryption in step S626, extract the text after the position, and convert it into voice for playing.

If the user does not want to continue reading the mobile phone while reading the 6 th line, and can move the mobile phone to the vicinity of the speaker device, the speaker device can extract the 6 th line and the following text contents and convert them into voice for playing after obtaining the text of the content, as shown in fig. 4 (c) or fig. 5 (d).

In the embodiment of the application, when the sound box device processes the text to the voice, the text content on a certain page can be fragmented. If the content of the 6 th row to the 9 th row can be processed by voice, the content of the 10 th row to the 12 th row can be processed by voice in the process of playing the segment voice, and so on until the content of the page is completely played.

Or the sound box device can also perform voice processing on the content including the section after the 6 th row, and in the process of playing the section of voice, the voice processing can be performed on the content of the next section, and so on until the content of the page is completely played.

S638, refresh content offset.

S640, when the page content is played, triggering to acquire the next page content.

In the embodiment of the present application, if the user reads the line 6 of the 1 st page before, and the content of the 1 st page is completely played through the above steps, steps S630-S638 are continuously executed until the content read by the user is completely played.

Fig. 7 shows a schematic diagram of a method 700 for text continuation across devices provided by an embodiment of the present application, the method 700 may include steps S710-S738.

S710, the mobile phone subscribes to Wi-Fi perception service of the sound box equipment, and the user brings the mobile phone close to the sound box equipment, and the sound box equipment discovers the mobile phone.

S712, the sound box equipment recognizes that the mobile phone is close, the current state is a reading state, and the triggering antenna is a weak antenna.

S714, the speaker device dynamically generates an encryption key and encrypts the key using the private key.

S716, the sound box device sends the encrypted secret key to the mobile phone.

S718, after the sound box equipment transmits successfully, the antenna is switched to a normal mode.

S720, the mobile phone triggers a text connection request, extracts content source information and the current content offset position, and simultaneously acquires a user accessing the content source and authentication information.

S722, the mobile phone decrypts the encrypted secret key to obtain the secret key, and encrypts the information by using the secret key.

S724, sending the encrypted information.

S726, the sound box equipment decrypts the received information and stores the decrypted information.

S728, request information for requesting content text is sent to the sound box cloud based on the decrypted information.

And S730, verifying user information by the sound box cloud, and if verification is passed, acquiring a content text.

For details of steps S710-S730, reference may be made to the descriptions related to steps S610-S630, which are not repeated here.

S732, the sound box cloud locates a specific position based on the content text and the decrypted information, extracts the text to be played, and generates voice.

S734, the sound box cloud sends the generated voice fragments, and meanwhile the sound box cloud caches the generated voice.

In the embodiment of the application, after the sound box cloud acquires the related content text, the text after the position is extracted and converted into voice based on the position read by the user before the position is positioned by the information 'current content offset position' acquired after decryption in the step S726.

If the user does not want to continue reading with the mobile phone for a while reading the 6 th line, the mobile phone can be moved to the vicinity of the speaker device, as in the GUI shown in fig. 4 (c) and fig. 5 (d), the speaker cloud, after acquiring the content text, can extract the 6 th line and subsequent text contents and convert them into speech, and then can send the converted speech to the speaker device in fragments.

In the embodiment of the application, when the sound box cloud processes the text to the voice, the text content on a certain page can be subjected to the slicing process. If the content of the 6 th row to the 9 th row can be processed by voice, the content of the 10 th row to the 12 th row can be processed by voice in the process of playing the segment voice, and so on until the content of the page is completely played.

Or the sound box cloud can also carry out voice processing on the content of the section after the 6 th row, and can carry out voice processing on the content of the next section in the process of playing the section of voice, and so on until the content of the page is completely played.

Note that in the embodiment of the application, after the sound box cloud generates the corresponding voice, when the voice is sent to the sound box device through the voice segment, the voice segment can be cached to the cloud server, so that when other users read the same text content and need to play the text content by the sound box device, the sound box cloud can save the time of converting the text content into the voice, and the voice segment cached by the cloud server can be sent to the sound box device, thereby improving the efficiency.

S736, the sound box device plays the voice clip.

S738, after the playing is completed, the loop processing S728-S736 is triggered.

In the embodiment of the application, after the sound box equipment receives the voice fragments sent by the sound box cloud, the voice fragments can be played. It should be noted that, although the sound box device receives the voice segments, the voice heard by the user is continuous within the acceptable range of the human ear.

In addition, in the embodiment of the application, after the whole page of the content source information is obtained and played, the sound box cloud can trigger audio integration and store the content source information, the audio offset and the information of the content text offset mapping; if the content source information can be matched to the complete audio, directly issuing the complete audio playing address, the content source information, the audio offset, the content offset and the audio offset mapping information without executing the steps 730-S738; the sound box equipment plays the corresponding complete audio, and simultaneously caches the content source information, the content offset and the audio offset information.

The content of the mobile phone read connected to the sound box device is described above with reference to fig. 6 and 7, and the content of the sound box device played connected to the mobile phone read will be described below with reference to fig. 8.

Fig. 8 shows a schematic diagram of a method 800 for text splicing across devices according to an embodiment of the present application, where the method 800 may include steps S810-S834.

S810, the mobile phone subscribes to Wi-Fi perception service of the sound box equipment, and the user brings the mobile phone close to the sound box equipment, and the sound box equipment discovers the mobile phone.

S812, the sound box equipment recognizes that the mobile phone is close, the current state is a reading state, and the triggering antenna is a weak antenna.

S814, the speaker device dynamically generates an encryption key and encrypts the key using the private key.

S816, the sound box device sends the encrypted secret key to the mobile phone.

S818, after the sound box equipment transmits successfully, switching the antenna to a normal mode.

For details of steps S810-S818, reference may be made to the descriptions related to steps S610-S618, which are not repeated here.

S820, the sound box device triggers the text to be connected back to the mobile phone.

S822, triggering verification of the mobile phone user.

In the embodiment of the application, the voice corresponding to the text content is supposed to be played by the sound box equipment at the current moment, if the user approaches the mobile phone to the sound box equipment, the text content can be triggered to be continued back to the mobile phone, namely the sound box equipment stops playing the voice, and the text corresponding to the voice when the sound box equipment stops playing is displayed on the mobile phone interface.

In the embodiment of the application, the verification that the sound box equipment triggers the mobile phone user can be understood as follows: the speaker device sends a request for verification information to the mobile phone, where the verification information is used to request to send information related to the mobile phone, such as authentication information of an account of an APP (e.g., APP1 or APP2 in fig. 4 or fig. 5).

S824, the mobile phone returns the user credentials.

After receiving the verification request information sent by the sound box equipment, the mobile phone can send authentication information of the APP account number to the sound box equipment, for example, a character string can be sent, so that verification of sound box cloud is facilitated.

S826, the sound box equipment sends authentication information acquired from the mobile phone side and information of the sound box equipment to the sound box cloud to request identity verification.

S828, returning a check result.

In the embodiment of the application, after receiving the authentication information sent by the mobile phone, the sound box equipment can send the authentication information acquired from the mobile phone side and the authentication information of the sound box equipment to the sound box cloud. After receiving the information sent by the sound box equipment, the sound box cloud can check the two equipment and send the check result to the sound box equipment. If the authentication information of the mobile phone side and the authentication information of the sound box equipment can be matched, the sound box cloud can consider that the user holding the mobile phone is legal; if the authentication information of the mobile phone side and the authentication information of the sound box equipment are not matched, the sound box cloud can consider that the user holding the mobile phone is illegal.

And S830, after confirming the identity of the mobile phone user, extracting content source information and the current content offset position, and encrypting the content source information and the current content offset position by using the encrypted key.

S832, the encrypted information is transmitted.

In the embodiment of the application, after the sound box equipment receives the verification result sent by the sound box cloud, the next step can be performed according to the verification result. If the verification result is that the authentication information of the mobile phone side and the authentication information of the sound box equipment are matched, at the moment, the sound box equipment extracts content source information and the current content offset position, encrypts the information by using an encrypted key, and sends the encrypted information to the mobile phone; if the verification result is that the authentication information of the mobile phone side and the authentication information of the sound box equipment are not matched, the sound box equipment cannot extract relevant information.

As an example, as shown in (d) of fig. 4 or (e) of fig. 5, assuming that the speaker device plays to line 13, the user moves the mobile phone to the vicinity of the speaker device again, the speaker device stops playing the text content, at this time, the speaker device may extract the difference between the number of lines currently played and the number of lines 1, encrypt the difference, and send the encrypted difference to the mobile phone.

For another example, as in the GUI shown in fig. 4 (e) or fig. 5 (f), assuming that the speaker device plays to the 3 rd line of the other page (the other page may be the next page or the next page, etc.), the user moves the mobile phone to the vicinity of the speaker device again, the speaker device stops playing the text content, at this time, the speaker device may extract the current page and the difference between the number of lines played by the current page and the number of lines played by the 1 st line, encrypt the difference, and send the encrypted difference to the mobile phone.

Of course, in some embodiments, the speaker device may also extract the difference between the number of words currently played and the 1 st word of the 1 st row, encrypt the difference, and send the difference to the mobile phone.

S834, decrypting the received information, re-acquiring text content based on the decrypted information, and positioning to a corresponding position.

In the embodiment of the application, after receiving the information sent by the sound box equipment, the mobile phone can decrypt the information and can reposition the playing position of the previous sound box equipment based on the decrypted information, so that the mobile phone can continue reading.

Illustratively, as in the GUI shown in FIG. 4 (d) or FIG. 5 (e) above, the font at line 13 of the drawing is darker in color than the fonts at the other lines. Thus, the user can know that the speaker device has played text content to line 13 so that the user can continue reading back from line 13.

Illustratively, as shown in the GUI of fig. 4 (e) or fig. 5 (f), the interface displays a refreshed page, and the font of line 3 is darker than the fonts of the other lines. Thus, the user can know that the speaker device is playing to line 3 of the page so that the user can continue reading back from line 3.

If the decrypted information includes a difference in the number of words between the word previously played by the speaker device and the 1 st word in the 1 st row, then a word in the mobile phone interface may be blackened, so that the user may continue reading the word backwards.

In addition, in some embodiments, if the handset and the speaker device only support the continuation of text content for a single page, the text content may be delivered. If the user does not want to continue reading with the mobile phone for a while reading the 6 th line, the mobile phone can be moved to the vicinity of the speaker device, and at this time, the mobile phone can transmit the text contents of the 6 th line and later of the current page to the speaker device, so that the text contents of the 6 th line and later can be played on the speaker device.

The following describes a flow of a method for text connection across devices.

Referring to fig. 9, fig. 9 shows a schematic flow chart of a method 900 of text continuation across devices.

As shown in fig. 9, the method 900 may include:

S910, when the interface of the first electronic device displays text content and the distance between the first electronic device and the second electronic device is smaller than or equal to a first threshold value, the first electronic device extracts first information, and the first information comprises information related to the text content.

The first electronic device in the implementation of the present application may be a mobile phone in the above method 600-800, and the second electronic device may be a speaker device in the above method 600-800. The first threshold may be 30cm in the above embodiment, and when the distance between the first electronic device and the second electronic device is less than or equal to the first threshold, and the current interface of the first electronic device displays text content, the first electronic device may extract the first information.

It should be understood that the first threshold may also be other values, and should not be particularly limited to the present application.

Optionally, the first information includes at least one of the following information:

And S920, the first electronic equipment sends the first information to the second electronic equipment.

And S930, the second electronic equipment plays the voice corresponding to the text content according to the first information.

In the embodiment of the present application, the second electronic device may play the voice corresponding to the text content according to the first information, which may be understood as: the second electronic device may play the voice corresponding to the current page based on the first information. In a specific implementation, the second electronic device may start playing from the 1 st line of the current page, or the second electronic device may also start playing from the n-th line of the current page, where n is the current offset line number of the text content, that is, the line number that the user is reading when the first electronic device approaches the second electronic device.

Optionally, in some embodiments, the method 900 further comprises:

The method 900 further includes:

The second information in the implementation of the present application may be a secret key, a private key, a public key, etc. in the above-described methods 600-800. When the first electronic device receives the second information for encryption, the second information can be used for encrypting the first information, and the encrypted information is sent to the second electronic device, and the second electronic device also has the secret key, the private key, the public key and the like, so that the received encrypted first information can be decrypted, and the first information is obtained.

In the embodiment of the application, the second electronic device plays the voice corresponding to the text content according to the first information in various modes.

Mode one:

The second electronic device converts the target text content into voice;

the second electronic device plays the voice.

Mode two:

The method 900 further includes:

the second electronic device plays the voice.

Optionally, in some embodiments, the method 900 further comprises:

and the cloud server of the second electronic equipment caches the voice.

For the two ways, reference may be made to the descriptions in the methods 600 and 700, and the descriptions are not repeated here.

Furthermore, in some embodiments, the method 900 further comprises:

Optionally, in some embodiments, the determining, by the second electronic device, whether to extract the first information according to the identity information of the first electronic device and the identity information of the second electronic device includes:

Optionally, in some embodiments, the determining, by the second electronic device, whether to extract the first information according to the checked result includes:

The method further comprises the steps of:

Optionally, in some embodiments, the method 900 further comprises:

the first electronic device receives the first information;

For the above, reference may be made to the description in the method 800 described above, and no further description is given here.

Fig. 10 shows a schematic flow chart of another method 1000 of text splicing across devices.

As shown in fig. 10, the method 1000 may include:

S1010, the second electronic device receives first information sent by the first electronic device, wherein the first information comprises information related to text content.

And S1020, the second electronic equipment plays the voice corresponding to the text content according to the first information.

Optionally, in some embodiments, the first information includes at least one of:

Optionally, in some embodiments, the method 1000 further comprises:

Mode one:

The second electronic device receives the text content;

The second electronic device converts the target text content into voice;

the second electronic device plays the voice.

Mode two:

the second electronic device plays the voice.

Furthermore, in some embodiments, the method 1000 further comprises:

Optionally, in some embodiments, the determining, by the second electronic device, whether to extract the first information according to a verification result sent by the cloud server of the second electronic device includes:

The method further comprises the steps of:

Fig. 11 shows a schematic flow chart of yet another method 1100 of text splicing across devices.

As shown in fig. 11, the method 1100 may include:

s1110, when the interface of the first electronic device displays text content and the distance between the first electronic device and the second electronic device is less than or equal to a first threshold, the first electronic device extracts first information, where the first information includes information related to the text content.

S1120, the first electronic device sends the first information to the second electronic device.

Optionally, in some embodiments, the method 1100 further comprises:

the first electronic device receives the first information;

It will be appreciated that the electronic device, in order to achieve the above-described functions, includes corresponding hardware and/or software modules that perform the respective functions. The present application can be implemented in hardware or a combination of hardware and computer software, in conjunction with the example algorithm steps described in connection with the embodiments disclosed herein. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application in conjunction with the embodiments, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The present embodiment may divide the functional modules of the electronic device according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules described above may be implemented in hardware. It should be noted that, in this embodiment, the division of the modules is schematic, only one logic function is divided, and another division manner may be implemented in actual implementation.

In the case of dividing the respective functional modules with the respective functions, fig. 12 shows a schematic diagram of one possible composition of the electronic device 1200 involved in the above-described embodiment, and as shown in fig. 12, the electronic device 1200 may include: a communication module 1210 and a play module 1220.

Wherein the communication module 1210 may be used to support the electronic device 1200 to perform step S1010, etc., described above, and/or other processes for the techniques described herein.

The play module 1220 may be used to support the electronic device 1200 to perform steps S1020 or S930, etc., described above, and/or other processes for the techniques described herein.

It should be noted that, all relevant contents of each step related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein.

Fig. 13 shows a schematic diagram of one possible composition of the electronic device 1300 involved in the above embodiment, and as shown in fig. 13, the electronic device 1300 may include: an extraction module 1310 and a communication module 1320.

Wherein the extraction module 1310 may be used to support the electronic device 1300 to perform steps S1110 or S910, etc. described above, and/or for other processes of the techniques described herein.

The communication module 1320 may be used to support the electronic device 1300 to perform steps S1120 or S920, etc. described above, and/or other processes for the techniques described herein.

The electronic device provided in this embodiment is configured to perform the method of the present application, so that the same effects as those of the implementation method can be achieved.

In case an integrated unit is employed, the electronic device may comprise a processing module, a storage module and a communication module. The processing module may be configured to control and manage actions of the electronic device, for example, may be configured to support the electronic device to perform steps performed by the foregoing units. The memory module may be used to support the electronic device to execute stored program code, data, etc. And the communication module can be used for supporting the communication between the electronic device and other devices.

Wherein the processing module may be a processor or a controller. Which may implement or perform the various exemplary logic blocks, modules and circuits described in connection with this disclosure. A processor may also be a combination that performs computing functions, e.g., including one or more microprocessors, digital Signal Processing (DSP) and a combination of microprocessors, and the like. The memory module may be a memory. The communication module can be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip and other equipment which interact with other electronic equipment.

In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device according to this embodiment may be a device having the structure shown in fig. 1.

Fig. 14 shows another possible composition diagram of the electronic device 1400 according to the above embodiment, as shown in fig. 14, the electronic device 1400 may include a communication unit 1410, an input unit 1420, a processing unit 1430, an output unit (or may also be referred to as a display unit) 1440, a peripheral interface 1450, a storage unit 1460, a power supply 1470, a video decoder 1480, and an audio decoder 1490.

The communication unit 1410 is configured to establish a communication channel through which the electronic device 1400 connects to and downloads media data from a remote server. The communication unit 1410 may include a communication module such as a WLAN module, a bluetooth module, an NFC module, a baseband module, and a Radio Frequency (RF) circuit corresponding to the communication module, for performing wireless local area network communication, bluetooth communication, NFC communication, infrared communication, and/or cellular communication system communication, for example, wideband code division multiple access (wideband code division multiple access, W-CDMA) and/or high-speed downlink packet access (HIGH SPEED downlink PACKET ACCESS, HSDPA). The communication module 1410 is used to control the communication of the components in the electronic device and may support direct memory access.

The input unit 1420 may be used to enable user interaction with and/or information input into an electronic device. In a specific embodiment of the present application, the input unit may be a touch panel, or may be other man-machine interaction interfaces, such as physical input keys, a microphone, or other external information capturing devices, such as a camera.

The processing unit 1430 is a control center of the electronic device, and may connect various parts of the entire electronic device using various interfaces and lines, by running or executing software programs and/or modules stored in the storage unit, and invoking data stored in the storage unit to perform various functions of the electronic device and/or process data. Steps S626, S634, S636, S726 and the like as described above may be implemented by the processing unit 1430.

The output unit 1440 includes, but is not limited to, an image output unit and a sound output unit. The image output unit is used for outputting characters, pictures and/or videos. In the embodiment of the application, the touch panel adopted by the input unit 1420 can also be used as the display panel of the output unit 1440. For example, when the touch panel detects a gesture operation of touch or approach thereon, the gesture operation is transmitted to the processing unit to determine the type of the touch event, and then the processing unit provides a corresponding visual output on the display panel according to the type of the touch event. Although in fig. 14, the input unit 1420 and the output unit 1440 implement the input and output functions of the electronic device as two separate components, in some embodiments, the input and output functions of the electronic device may be implemented by integrating a touch panel with a display panel. For example, the image output unit may display various graphical user interfaces as virtual control components, including but not limited to windows, scroll shafts, icons, and scrapbooks, for a user to operate by touch.

The final positioning position in step S834 in the above embodiment may be implemented by the output unit 1440.

The storage unit 1460 may be used to store software programs and modules, and the processing unit executes the software programs and modules stored in the storage unit, thereby performing various functional applications of the electronic device and realizing data processing.

The audio decoder 1490 may decode the audio file to obtain audio data for text continuation.

The application also provides a system comprising the electronic device 1200 and the electronic device 1300.

The present embodiment also provides a computer storage medium having stored therein computer instructions which, when executed on an electronic device, cause the electronic device to perform the related method steps described above to implement the method for text continuation across devices in the above embodiments.

The present embodiment also provides a computer program product which, when run on a computer, causes the computer to perform the above-described related steps to implement the method of text continuation across devices in the above-described embodiments.

In addition, embodiments of the present application also provide an apparatus, which may be embodied as a chip, component or module, which may include a processor and a memory coupled to each other; the memory is configured to store computer-executable instructions, and when the apparatus is running, the processor may execute the computer-executable instructions stored in the memory, so that the chip performs the method of text continuation across devices in the above method embodiments.

The electronic device, the computer storage medium, the computer program product, or the chip provided in this embodiment are used to execute the corresponding methods provided above, so that the beneficial effects thereof can be referred to the beneficial effects in the corresponding methods provided above, and will not be described herein.

It will be appreciated by those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to perform all or part of the functions described above.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts shown as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random-access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the application is subject to the protection scope of the claims.

Claims

1. A method of text continuation across devices, comprising:

When text content is displayed on an interface of a first electronic device and the distance between the first electronic device and a second electronic device is smaller than or equal to a first threshold value, the first electronic device extracts first information, and the first information comprises information related to the text content;

the second electronic equipment plays the voice corresponding to the text content according to the first information;

The method further comprises the steps of:

2. The method of claim 1, wherein the first information comprises at least one of:

3. The method according to claim 1, wherein the method further comprises:

The method further comprises the steps of:

4. A method according to any one of claims 1 to 3, wherein the second electronic device playing the voice corresponding to the text content according to the first information, comprising:

The second electronic device converts the target text content into voice;

the second electronic device plays the voice.

5. A method according to any one of claims 1 to 3, further comprising:

the second electronic device plays the voice.

6. The method of claim 5, wherein the method further comprises:

and the cloud server of the second electronic equipment caches the voice.

7. A method according to any one of claims 1 to 3, wherein the second electronic device determining whether to extract the first information based on the identity information of the first electronic device and the identity information of the second electronic device comprises:

8. The method of claim 7, wherein the second electronic device determining whether to extract the first information based on the verified result comprises:

The method further comprises the steps of:

the first electronic device receives the first information;

9. A method of text continuation across devices, comprising:

The second electronic equipment receives first information sent by the first electronic equipment, wherein the first information comprises information related to text content;

The method further comprises the steps of:

10. The method of claim 9, wherein the first information comprises at least one of:

11. The method according to claim 9, wherein the method further comprises:

12. The method according to any one of claims 9 to 11, wherein the second electronic device playing the voice corresponding to the text content according to the first information, includes:

The second electronic device receives the text content;

The second electronic device converts the target text content into voice;

the second electronic device plays the voice.

13. The method according to any one of claims 9 to 11, wherein the second electronic device playing the voice corresponding to the text content according to the first information, includes:

the second electronic device plays the voice.

14. The method according to any one of claims 9 to 11, wherein the second electronic device determining whether to extract the first information based on the identity information of the first electronic device and the identity information of the second electronic device comprises:

15. The method of claim 14, wherein the second electronic device determining whether to extract the first information according to a verification result sent by a cloud server of the second electronic device comprises:

The method further comprises the steps of:

16. An electronic device, comprising:

One or more processors;

one or more memories;

the one or more memories store one or more computer programs comprising instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any of claims 9-15.

17. A chip system comprising at least one processor, wherein program instructions, when executed in the at least one processor, cause the functions of the method of any one of claims 9 to 15 to be carried out on the electronic device.

18. A computer storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any one of claims 9 to 15.

19. A computer program product, characterized in that the computer program product, when run on a computer, causes the computer to perform the method of any of claims 9 to 15.