CN111885404A

CN111885404A - Data transmission method, device and storage medium

Info

Publication number: CN111885404A
Application number: CN202010688686.3A
Authority: CN
Inventors: 刘国树
Original assignee: Realme Chongqing Mobile Communications Co Ltd
Current assignee: Realme Chongqing Mobile Communications Co Ltd
Priority date: 2020-07-16
Filing date: 2020-07-16
Publication date: 2020-11-03
Also published as: WO2022012153A1

Abstract

The embodiment of the invention discloses a data transmission method, data transmission equipment and a storage medium, which are applied to the technical field of data transmission and can solve the problem that the transmission of a large amount of data cannot be realized. The method comprises the following steps: the method comprises the steps that a first device collects pictures of each frame of image in a video stream played on a screen of a second device to obtain M original images, the video stream is generated by encoding first data, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in the first data, wherein M and N are integers larger than or equal to 2; the first device decodes the M original images to obtain first data.

Description

Data transmission method, device and storage medium

Technical Field

The embodiments of the present invention relate to the field of data transmission technologies, and in particular, to a data transmission method, device, and storage medium.

Background

At present, data transmission modes are various, and in common data transmission modes in life, a mode of transmitting data by using an image is utilized, for example, a two-dimensional code is used as a carrier to transmit data, but the amount of information carried by the two-dimensional code is relatively small, so that transmission of a large amount of data cannot be realized.

Disclosure of Invention

Embodiments of the present invention provide a data transmission method, a device, and a storage medium, so as to solve a problem in the prior art that transmission of a large amount of data cannot be achieved.

In order to solve the above technical problem, the embodiment of the present invention is implemented as follows:

in a first aspect, a data transmission method is provided, including:

the method comprises the steps that a first device collects pictures of each frame of image in a video stream played on a screen of a second device to obtain M original images, the video stream is generated by encoding first data, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in the first data, wherein M and N are integers larger than or equal to 2;

the first device decodes the M original images to obtain first data.

In a second aspect, a data transmission method is provided, including:

the method comprises the steps that second equipment obtains first data to be transmitted and encodes the first data to generate a video stream;

the second device plays the video stream on a screen, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, each image display area indicates one data unit in the first data, so that the first device collects a picture of each frame of image in the video stream played on the screen of the second device to obtain M original images, and decodes the M original images to obtain the first data, wherein M and N are integers greater than or equal to 2.

In a third aspect, a first device is provided, comprising:

the receiving module is used for acquiring pictures of each frame of image in a video stream played on a screen of a second device to obtain M original images, wherein the video stream is generated by encoding first data, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, and each image display area indicates one data unit in the first data;

and the processing module is used for decoding the M original images to obtain the first data.

In a fourth aspect, there is provided a second device comprising:

the processing module is used for acquiring first data to be transmitted and encoding the first data to generate a video stream;

the playing module is used for playing the video stream on a screen, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in the first data, so that a first device can collect the picture of each frame of image in the video stream played on the screen of a second device to obtain M original images, and the M original images are decoded to obtain the first data.

In a fifth aspect, there is provided a first device comprising: a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the data transmission method according to the first aspect.

In a sixth aspect, there is provided a second apparatus comprising: a processor, a memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, carries out the steps of the data transmission method according to the second aspect.

In a seventh aspect, a computer-readable storage medium is provided, comprising: the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the data transmission method according to the first aspect or the steps of the data transmission method according to the second aspect.

In the embodiment of the invention, a first device acquires a picture of each frame of image in a video stream played on a screen of a second device to obtain M original images, the video stream is generated by encoding first data, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in the first data, wherein M and N are integers greater than or equal to 2; the first device decodes the M original images to obtain first data. According to the scheme, one data unit can be indicated by the image display area in each frame of image in the video stream on the second device, so that the first device can acquire the picture of each frame of image in the video stream on the second device through the camera to acquire a large amount of information carried by the video stream, and transmission of a large amount of data between the first device and the second device can be achieved.

Drawings

Fig. 1 is a first schematic diagram of an architecture for implementing data transmission according to an embodiment of the present invention;

FIG. 2 is a diagram of lossy coding and lossless coding according to an embodiment of the present invention;

fig. 3 is a schematic diagram of an architecture for implementing data transmission according to an embodiment of the present invention

Fig. 4 is a first schematic diagram of a data transmission method according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a mobile phone screen dividing a plurality of display areas according to an embodiment of the present invention;

fig. 6 is a schematic diagram illustrating a data transmission method according to an embodiment of the present invention;

fig. 7 is a third schematic diagram of a data transmission method according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a first apparatus according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of a second apparatus according to an embodiment of the present invention;

fig. 10 is a hardware schematic diagram of a mobile phone according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first" and "second," and the like, in the description and in the claims of the present invention are used for distinguishing between different objects and not for describing a particular order of the objects. For example, the first device and the second device, etc. are for distinguishing different devices, and are not for describing a particular order of the devices.

It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

According to statistics, at least 80% of current data calculation is carried out by taking an image as a carrier, the image has the characteristics of large information carrying capacity, intuition, easiness in understanding and the like, and image processing is the necessary guarantee of the realizability and the safety of image information transmission. In the related art, as shown in fig. 1, a schematic diagram of an architecture for implementing a data transmission mode is shown, a data sending device may transmit images through internet and other modes after image acquisition, encoding compression and encryption, and a data receiving device may extract effective information contained in the images after decompression, decoding and decryption.

Further, since the image contains a large amount of information and occupies a large memory space, a 24-bit color picture of 1024 × 768 will have a size of 2.25MB if it is not encoded and compressed, but only a few tens of KB after being encoded and compressed, and the size of the image can be greatly reduced by encoding and compressing. Common coding methods include lossless coding (which can completely restore the original image after decompression without any information loss) and lossy coding (which is irreversible, and the decoded image cannot completely restore the original image without some information loss).

Optionally, the image coding format includes PNG format, JPEG format, and the like. The PNG format is a lossless encoding mode, and the JPEG format is a lossy encoding format. The encoding process of the image is a compression process of the image, and when the image is encoded, an algorithm can remove a large amount of redundant information on the image and only reserve indispensable effective information. For example, as shown in fig. 2, for lossy coding, an algorithm integrates a plurality of pixel points with little difference in pixel value into the same pixel value for storage, so that a space for storing a plurality of pixel values is needed, and only one pixel value needs to be stored after coding compression, which greatly saves a storage space, and for example, four pixel points indicated by 21 and indicated by 22 and having the same pixel value are finally integrated into one pixel point 23; the lossless coding algorithm integrates a plurality of pixels with the same pixel value into one value to be stored so as to achieve the purpose of compression, and the lossless coded image occupies a space larger than the lossy coded image, that is, four pixels indicated by 21 and indicated by 22 in fig. 2 are integrated into one pixel 24 and four pixels indicated by 22 are integrated into one pixel 25.

Although the amount of transmission data can be increased based on the above-described image compression technique, the increase in the amount of transmission data is very limited and some image information may be lost.

In order to further improve the data volume of data transmission, the data transmission method and the device can be realized by transmitting a video stream, wherein the video stream can comprise M frames of images, each frame of image can indicate one data unit in the first data to be transmitted through an image display area and is displayed on a screen, so that the first device can acquire each frame of image in the video stream on the second device through a camera to acquire a large amount of data carried by the video stream, and the transmission of a large amount of data can be realized between the first device and the second device.

The data transmission method provided in the embodiment of the present invention may be implemented by data transmission between two devices (a first device and a second device in the embodiment of the present invention), where the first device may serve as a data sending end and the second device may serve as a data receiving end, or the first device may serve as a data receiving end and the second device may serve as a data sending end.

The equipment in the embodiment of the invention can be intelligent peripheral equipment, mobile terminal equipment and non-mobile terminal equipment. The mobile terminal device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.; the non-mobile terminal device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like, and the embodiment of the present invention is not particularly limited.

Fig. 3 is a schematic diagram illustrating an architecture for implementing data transmission according to an embodiment of the present invention. The intelligent peripheral equipment comprises a plurality of pieces of equipment, wherein the equipment comprises an intelligent peripheral equipment and another intelligent mobile phone, the intelligent peripheral equipment can collect images, play video streams and receive and play audio, and the intelligent mobile phone can be installed on the intelligent peripheral equipment. The smart phone can be provided with an application program, the application program can continuously present data such as audio, pictures, videos and text files on a mobile phone screen in a video stream mode after being encrypted by a special code, an encryption key is played and sent through an audio module (namely an audio playing device or a loudspeaker), an intelligent peripheral acquires pictures of each frame of image in the video stream presented on the smart phone screen by using a camera carried by the intelligent peripheral so as to obtain an original image, meanwhile, the audio module (namely an audio receiver or a microphone) is used for receiving the audio key, and then the acquired original image is sequentially processed, decoded and decrypted by combining the audio key so as to obtain the data transmitted by the smart phone.

Further, if the smart peripheral needs to transmit information to the smart phone, the smart peripheral can play a video stream which is specially encrypted and encoded on a screen of the smart peripheral, and simultaneously play an audio key by using a speaker, the smart phone collects a picture of each frame of image in the video stream played on the screen of the smart peripheral by using a camera carried by the smart phone to obtain an original image, and simultaneously receives the audio key by using an audio receiver, and decodes and decrypts the original image to obtain data transmitted by the smart peripheral, so that the two parties can effectively transmit data to each other, and realize handshaking or instruction mutual transmission by using bluetooth, wireless fidelity (WIFI) technology and other modes, specifically realized by a bluetooth/WIFI module in the device in fig. 3), and simultaneously can use the specially modulated audio as the key in the data transmission process.

Furthermore, the intelligent peripheral can be connected with other terminals (such as the peripheral terminal shown in fig. 3) through wired cables or wireless WIFI, and the intelligent peripheral can send audio data to the sound terminal, send video data to the projector, send light control data to the light control terminal, and the like.

In the following, an exemplary description is given by taking the first device as a data receiving end and the second device as a data sending end as an example. In this embodiment of the present invention, the first device and the second device may be two devices within a certain distance range, and a distance and a position relationship between the first device and the second device may be set based on the fact that the second device may acquire a video stream on the first device through a camera.

Example one

As shown in fig. 4, an embodiment of the present invention provides a data transmission method, where the method may include:

401. the second equipment acquires first data to be transmitted and encodes the first data to generate a video stream.

In this embodiment of the present invention, the data type of the first data includes: at least one of an image data type, an audio data type, a video data type, and a text data type.

402. The video stream is played on a screen of the second device.

The method comprises the steps that M frames of images are included in a video stream, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in first data, so that first equipment can collect pictures of each frame of image in the video stream played on a screen of second equipment to obtain M original images, and the M original images are decoded to obtain the first data, wherein M and N are integers larger than or equal to 2.

Optionally, each image display area indicates one data unit in the first data by a displayed color.

The two-dimensional code is a binary code, and can indicate data by using black and white, and the two-dimensional code carries data by respectively filling black and white colors in different display areas.

Illustratively, all color classification partitions may be coded into quaternary, octal, or other binary codes. Assuming the quaternary system as an example, the quaternary system is coded with 00, 01, 10 and 11, black 00, red 01, green 10 and yellow 11 can be defined, and if coding into other systems is needed, the colors can be divided according to the needs.

Optionally, each image display area may further indicate one data unit in the first data by a shape, or indicate one data unit in the first data according to other characteristics of each image display area, which is not specifically limited in the embodiment of the present invention.

For example, the second device may be a mobile phone, as shown in fig. 5, as can be seen from the schematic diagram of the screen of the mobile phone, the screen may be divided into a plurality of small blocks, each small block is a display area, and data may be carried by displaying a color in each small block, where each small block may display different colors according to different requirements of the transmitted data.

It should be noted that, in the embodiment of the present invention, in addition to the dividing manner of the display area in the screen of the mobile phone in fig. 5, the screen of the mobile phone may also have another manner of dividing the display area, and fig. 5 is only an exemplary illustration. For example, the screen of the mobile phone may be divided into more or less display areas than those shown in fig. 5, may be divided into display areas of a plurality of rows and a column, and may be divided into display areas of a plurality of columns and a row.

403. The first device collects the pictures of each frame of image in the video stream played on the screen of the second device to obtain M original images.

The first device can acquire the pictures of each frame of image in the video stream played on the screen of the second device through the camera to obtain M original images.

Optionally, the first device may acquire a picture of each frame of image in a video stream played on a screen of the second device by using a camera of the high-speed camera, so that a faster data transmission speed may be achieved.

404. The first device decodes the M original images to obtain first data.

In the embodiment of the invention, a first device acquires the picture of each frame of image in a video stream played on a screen of a second device to obtain M original images, the video stream is generated by encoding first data, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in the first data, wherein M and N are integers greater than or equal to 2; the first device decodes the M original images to obtain first data. By the scheme, each frame of image in the video stream on the second device can indicate one data unit through the image display area and display the data unit on the screen, so that the first device can acquire the picture of each frame of image in the video stream on the second device through the camera to acquire a large amount of information carried by the video stream, and transmission of a large amount of data between the first device and the second device can be realized.

Example two

In order to ensure the security of data during data transmission, the video stream in the embodiment of the present invention may be encrypted.

Optionally, the encryption processing may refer to setting some or all data units in the first data to be another data unit according to a pre-agreed encryption rule. For example, data unit "00" is an encrypted data unit, which may be "01" or other data unit before encryption.

As shown in fig. 6, there is provided a data transmission method, including:

601. the second equipment acquires first data to be transmitted and encodes the first data to generate a video stream.

Optionally, the data type of the first data includes: at least one of an image data type, an audio data type, a video data type, and a text data type.

602. The video stream is played on a screen of the second device.

603. The first device collects the pictures of each frame of image in the video stream played on the screen of the second device to obtain M original images.

For the descriptions 601 to 603, reference may be made to the descriptions 401 to 403, and the descriptions are omitted here.

604. The first device obtains a key associated with the video stream from the second device.

In the embodiment of the invention, the second device transmits the key associated with the video stream, and correspondingly, the first device acquires the key associated with the video stream from the second device.

There are various ways of transmitting the key between the first device and the second device.

The first possible implementation manner is: the target frame image in the video stream comprises a key, and the target frame image comprises one or more frames of images; the obtaining, by the first device, the key associated with the video stream from the second device may specifically be: the first device decodes a first target image in the M original images to obtain a key, wherein the first target image is an image obtained by acquiring a picture of a target frame image in the video stream.

For example, the data information actually carried by the picture may be obtained by performing calculation on the data information indicated in the pictures of the multi-frame images. For example, the first device may calculate the data information actually carried by the video stream through a frame difference method (the data information in the previous frame or multiple frames of pictures subtracts the data information in the next frame or multiple frames of pictures), or through other algorithms, so that the actual transmitted data is obtained by continuously extracting multiple frames of pictures and then decrypting the pictures when decrypting the pictures.

In the implementation mode, the key can be carried in the video stream, so that the key and actually transmitted data are transmitted in the video stream, and the transmission equipment only needs to adopt a device for playing the video stream and a device for acquiring the video stream (namely, the sending end equipment needs to be provided with the display function module, and the receiving end equipment needs to be provided with the image acquisition module) to complete transmission, so that the realization without the cooperation of other devices is realized, the transmission mode is more concise, and the requirement on equipment hardware is lower.

A second possible implementation is: the first equipment collects the audio signals played by the second equipment through the audio playing device, analyzes the audio signals and acquires the secret key.

Alternatively, the key may be a frequency modulated audio signal, the frequency data of which is indicative of the key content. In this case, parsing the audio signal to obtain the key includes: the method comprises the steps of acquiring frequency data of an audio signal, determining key content indicated by the frequency data of the audio signal, and decrypting original data according to the key content to obtain first data.

In the implementation mode, the key can be carried in the audio signal, so that a sending end of the key can output the key through a loudspeaker, a receiving end of the key can receive the key through a microphone, data transmission is performed in a video streaming mode, the key transmission is performed in an audio signal mode, different data are transmitted in two transmission channels, and the transmission reliability can be improved.

A third possible implementation is: the second device may establish wireless communication through bluetooth technology or WIFI technology, and then the second device sends the key to the terminal device.

605. The first device decodes the M original images according to the color displayed in each of the M original images to obtain original data corresponding to the M original images.

Optionally, for the first possible implementation manner, the first device may decrypt the second target image according to the key to obtain the first data, where the second target image is an image other than the first target image in the M original images.

606. The first device decrypts the original data according to the key to obtain first data.

In the embodiment of the invention, the video stream is encrypted, so that the data transmission process is safer and more reliable, and the data transmission safety is ensured on the basis of transmitting a large amount of data.

In a possible implementation manner, the first data includes first target data obtained by decoding each original image in the M original images, the first target data includes an image sequence number, and the image sequence number is used to indicate an image corresponding to the first target dataIn thatThe order of play in the video stream. Following 606 may also include: and if the image sequence numbers included in the first data are not continuous, the first equipment sends the missing target sequence numbers to the second equipment, so that the second equipment outputs the images corresponding to the target sequence numbers and the playing sequence in the video stream again according to the target sequence numbers. Correspondingly, the second device receives the target serial number sent by the first device, and retransmits the images corresponding to the playing sequence and the target serial number in the video stream according to the target serial number.

In the above implementation manner, since the first data received by the first device includes the first target data obtained by decoding each original image, and the first target data includes the image sequence number, in a case that there is a frame of image in the video stream that is missed to be captured in the actual application, the missing image sequence numbers can be fed back to the second device to allow the second device to play back the image corresponding to the image sequence number again according to the image sequence numbers, so that the first device can capture the image again without retransmitting the entire video stream, and thus the efficiency of retransmitting the data when the data is missing can be improved.

In another possible implementation manner, optionally, the following step may be further included after the step 606:

607. the first device detects a target terminal device in communication connection with the first device.

Alternatively, the first device may detect all devices communicatively connected to the first device, and the target terminal device may be one or more terminal devices communicatively connected to the first device.

608. And detecting the data type supported by the target terminal equipment.

Exemplarily, if the target terminal device is a display device, the target terminal device may support image data, audio text data, and video data; the target terminal device, if a speaker device, may support audio data.

609. And if the first data comprises target data with the same data type as that supported by the target terminal equipment, sending the target data to the target terminal equipment.

For example, assuming that the first data includes image data and audio data, the image data may be transmitted to the display device and the audio data may be transmitted to the speaker device.

In the embodiment of the present invention, the first device may distribute data to the terminal device associated with the first device according to the data type, and send the data of the data type supported by the first device to the terminal device after determining the data type that the terminal device can support, so as to avoid wasting data transmission resources in a case that the sent data type terminal device does not support.

The 609 may specifically include the following steps:

6091. if the first data includes target data of the same data type as that supported by the target terminal device, the first device determines whether a device identifier associated with the target data is the same as that of the target terminal device.

In practical application, there may be a plurality of terminal devices that all support a certain type of data, and at this time, it may be detected whether the certain type of data is associated with a device identifier, and if there is no associated device identifier, the data of the data type supported by the terminal devices is sent to all the terminal devices; if the device identifier is associated, further determining whether the associated device identifier is the same as the device identifier of the target terminal device, and if so, sending the certain type of data (i.e., the target data) to the target terminal device.

6092. And if the equipment identifier associated with the target data is the same as the equipment identifier of the target terminal equipment, the first equipment sends the target data to the target terminal equipment.

In the embodiment of the invention, under the condition that a plurality of terminal devices support the target data, the receiving terminal device during data distribution can be further defined according to the device identification associated with the target data, and the target data is sent to the target terminal device when the device identification associated with the target data is the same as the device identification of the target terminal device, so that the accuracy of data distribution can be improved.

EXAMPLE III

Next, with reference to fig. 7, a description is given of a data transmission flow between a sender and a receiver by using the data transmission method provided in the embodiment of the present invention.

701. And starting.

702. Whether the sender and the receiver handshake is successful.

The transmission of the handshaking instruction can be carried out through the Bluetooth or WIFI technology to establish communication connection, and when the communication connection is successfully established, the handshaking success of the sender and the receiver is indicated.

If the result is successful, the following steps 703 to 715 are continuously executed, and if the result is unsuccessful, the user may be guided to establish a connection with the peer device using WIFI or bluetooth, and the above step 702 is continuously executed after a period of time.

703. The transmission order contracts the sender and the receiver.

Optionally, the instruction related in this implementation may be an instruction transmitted through bluetooth or WIFI technology.

That is, the sender and the receiver are exactly which device, and can be agreed by the two devices interacting with each other.

704. The receiver turns on the camera and the microphone.

705. The receiver informs the sender of the completion of the preparation through an instruction.

The sender can conveniently provide data in time by informing the sender of the completion of the preparation through the instruction, so that the data cannot be received too early, or the efficiency of data transmission is influenced due to too late data provision.

706. The sender starts a screen to present the first frame image of the video stream.

707. The sender informs the receiver of the completion of the preparation through an instruction.

The sender informs the receiver of the completion of the preparation through the instruction, so that the receiver can know that the sender knows that the sender is about to provide data and prepare for receiving the data.

708. The screen of the sender plays the video stream, and the loudspeaker plays the audio key.

709. The camera of the receiving party collects the pictures of the images in the video stream, and the microphone collects the audio.

710. The sender informs the receiver of the completion of the sending through the instruction.

After the sender informs the receiver of the completion of the sending through the instruction, the receiver can confirm whether the video data is complete or not based on the received data.

711. The receiver decrypts the parsed video stream by using the audio key to confirm the video data.

712. The receiver judges whether the data is complete.

If not, then execution 713 continues from 704 until after the complete data is received 714 and 715; if complete, the following 714 and 715 are performed directly.

713. The receiving side informs the sending side of retransmitting the missing part of the data through a Bluetooth instruction.

714. The receiver informs the sender of the complete data through an instruction.

715. And (6) ending.

The data transmission method can transmit a large amount of data carried by video stream transmission, can ensure the safety of the transmitted data through the audio key, and can inform the sender through an instruction when the data received by the receiver is incomplete, so that the sender can retransmit the missing data, thereby also ensuring the integrity of data transmission.

The data transmission method provided by the embodiment of the invention can also be applied to data transmission between two or more smart phones, wherein one smart phone can play a video stream obtained after first data coding on a screen, the other smart phone or the multiple smart phones simultaneously start a camera to acquire pictures of each frame of image in the video stream, and then sequentially decode original images obtained after the pictures of each frame of image are acquired to obtain first data.

The data transmission method in the embodiment of the invention can be applied to various scenes related to data transmission in actual life. Such as smart home scenes, stage control scenes, etc.

Scene one: when the data transmission method provided by the embodiment of the invention is applied to an intelligent home scene, the first device can be an intelligent door lock, and the second device can be a mobile phone.

When a user needs to unlock the intelligent door lock in an intelligent household scene, the mobile phone can play a section of video stream encrypted by specially encoding unlocking data on a screen, and play an audio signal (frequency data of the audio signal can be used for indicating key content) associated with the video stream through a loudspeaker of the mobile phone, at this time, the intelligent door lock provided with a camera can correspondingly acquire pictures of each frame of image in the video stream played on the mobile phone through the camera to obtain original data, and then the original image is decoded to obtain first data; the intelligent door lock can acquire the audio signal through the microphone, acquire key content through analyzing the frequency data of the audio signal, decrypt the key content to obtain unlocking data, and finally compare the obtained unlocking data with the unlocking data stored in advance.

In the intelligent household scene, the data transmission method provided by the embodiment of the invention is applied to unlocking, is different from the traditional unlocking mode (such as fingerprints and passwords), provides more realizable modes for the starting mode, and improves the performance of man-machine interaction in the intelligent household scene.

Furthermore, under the intelligent home scene, the intelligent door lock can also realize more functions. Exemplary, may include:

when the intelligent door lock detects that a visitor appears outside the intelligent door lock, the personal characteristic information of the visitor can be acquired;

if the personal characteristic information of the visitor is not matched with the prestored credible personal characteristic information, identifying whether a user inside the intelligent door lock belongs to a preset protected user or not; the intelligent door lock detects that a visitor out of the intelligent door lock can detect whether the operation that a user touches the intelligent door lock exists or not, and can detect whether the stay time of the user outside the door is longer than the preset time or not; wherein the protected user may be a woman, an elderly person or a child;

if the user inside the intelligent door lock belongs to a preset protected user, acquiring external confusion sound of a designated user configured for the protected user in advance, wherein the external confusion sound is used for carrying out identity confusion on a visitor so that the visitor considers that the designated user is located inside the intelligent door lock; wherein, the designated user may be a parent, a guardian or a male in the family.

And controlling the intelligent door lock to play the puzzlement sound and forbidding the intelligent door lock to execute the door opening operation.

Among the above-mentioned implementation, the intelligence lock can be in the determination have the visitor to arrive, and when being strange visitor, whether the personnel in the detection family are protection users such as women, old man or child, under the personnel in the determination family is for the protection user's the condition, can make the visitor regard as family's head of a family, guardian or male sex through the external puzzlement sound of the appointed user of broadcast to guarantee personnel's in the family safety.

Optionally, the personal feature information of the visitor includes: the method comprises the steps of obtaining face image information of a visitor and sound information of the visitor;

after the personal characteristic information of the visitor is acquired, the method further comprises the following steps:

if the personal characteristic information of the visitor is not matched with the prestored credible personal characteristic information, sending the face image information of the visitor to display equipment inside the intelligent door lock and sending the voice information of the visitor to sound box equipment inside the intelligent door lock;

the display device inside the intelligent door lock displays the face image information of a user, and the sound box device inside the intelligent door lock plays the sound information of a visitor.

Optionally, after obtaining the personal feature information of the visitor, the method further includes:

and if the personal characteristic information of the visitor is not matched with the prestored credible personal characteristic information, acquiring a monitoring picture outside the intelligent door lock, and sending the monitoring picture to display equipment inside the intelligent door lock.

In the implementation mode, when the visitor is determined to be an unfamiliar visitor, the intelligent door lock sends the relevant information of the visitor to other terminal devices (such as display devices and sound box devices) at home, so that personnel at home can know the condition of the visitor, the intelligent home equipment can provide information for the user flexibly, and the man-machine interaction performance is improved.

Optionally, after the intelligent door lock acquires the personal feature information of the visitor, the method further includes:

if the personal characteristic information of the visitor is not matched with the prestored credible personal characteristic information, judging whether terminal equipment of an emergency contact person associated with the intelligent door lock exists or not;

and if the intelligent door lock exists, acquiring a monitoring picture outside the intelligent door lock, and sending the monitoring picture outside the intelligent door lock to the terminal equipment of the emergency contact.

In the implementation mode, when the visitor is determined to be a strange visitor, the intelligent door lock can also send the relevant information of the visitor to the terminal equipment of the emergency contact person associated with the intelligent door lock, so that the emergency contact person can know the condition of the visitor, the intelligent home equipment can provide information for the user flexibly, and the man-machine interaction performance is improved.

Scene two: when the data transmission method provided by the embodiment of the invention is applied to a stage control scene, the first device may be a stage control device, the stage control device may be connected to a terminal device (e.g., a large screen, a sound device, and a lighting device) in a stage, and the second device may be a mobile terminal device (e.g., a mobile phone). The mobile phone can encode and encrypt local stage control data to generate a video stream, play the video stream in a range that can be collected by stage control equipment, the stage control equipment can collect pictures in each frame of image in the video stream through a camera, then obtain original data, analyze the original data to obtain first control data, collect audio signals (frequency data of the audio signals can be used for indicating key content) associated with the video stream through a microphone, then obtain key content through analyzing the frequency data of the audio signals, decrypt the first control data according to the key content to obtain stage control data, and then distribute the stage control data to terminal equipment connected with the stage control equipment.

Assume that stage control data includes: the image data, audio data, and light control data (i.e., light control instructions) the stage control device distributing the stage control data to its connected terminal devices may include: the stage control equipment sends the image data to the large screen so that the large screen displays the image corresponding to the image data; the stage control equipment sends the audio data to the sound equipment so that the sound equipment plays the audio signal corresponding to the audio data; the stage control equipment sends the light control instruction to the lighting equipment so as to control the change of the color and the light intensity of the lighting equipment.

When the data transmission method provided by the embodiment of the invention is applied to a stage control scene, data in mobile terminal equipment capable of moving flexibly is transmitted to stage control equipment, and the stage control equipment distributes data for large screens, sound equipment and lighting equipment in a stage, so that not only can a large amount of data transmission be realized safely, but also some general stage control data are stored in the mobile terminal equipment capable of moving flexibly, the stage control data can be carried to sites where different stage systems are located conveniently, and the data reuse is realized.

As shown in fig. 8, an embodiment of the present invention provides a first device, including:

a receiving module 801, configured to collect pictures of each frame of image in a video stream played on a screen of a second device, to obtain M original images, where the video stream is generated by encoding first data, the video stream includes M frames of images, each frame of image in the video stream includes N image display areas, and each image display area indicates one data unit in the first data;

the processing module 802 is configured to decode the M original images to obtain first data.

Alternatively, each image display region indicates one data unit in the first data by a displayed color.

Optionally, the video stream is encrypted;

the receiving module 801 is further configured to obtain a key associated with the video stream from the second device before the processing module 802 decodes the M original images to obtain the first data;

a processing module 802, specifically configured to decode, by the first device, the M original images according to the color displayed in each of the M original images, and obtain original data corresponding to the M original images;

and decrypting the original data according to the key to obtain the first data.

Optionally, the target frame image in the video stream includes a key, and the target frame image includes one or more frames of images;

a receiving module 801, configured to decode a first target image in the M original images to obtain a key, where the first target image is an image obtained by acquiring a picture of a target frame image in a video stream;

the processing module 802 is specifically configured to decrypt a second target image according to the key to obtain the first data, where the second target image is an image other than the first target image in the M original images.

Optionally, the receiving module 801 is specifically configured to collect an audio signal played by the second device through the audio playing apparatus;

and analyzing the audio signal to obtain a key.

Optionally, the key is an audio signal with modulated frequency, and frequency data of the audio signal is used to indicate key content;

a receiving module 801, specifically configured to acquire frequency data of an audio signal;

determining key content indicated by frequency data of the audio signal;

the original data is decrypted according to the content of the key to obtain first data.

Optionally, the first data includes first target data obtained after decoding each original image in the M original images, where the first target data includes an image sequence number, and the image sequence number is used to indicate a playing sequence of an image corresponding to the first target data in the video stream;

the first device further comprises:

the sending module 803, configured to, after the processing module 802 decodes the M original images to obtain the first data, further include:

and if the image sequence numbers included in the first data are not continuous, sending the missing target sequence numbers to the second equipment, so that the second equipment outputs the images corresponding to the playing sequence and the target sequence numbers in the video stream again according to the target sequence numbers.

Optionally, the data type of the first data includes: at least one of an image data type, an audio data type, a video data type, and a text data type;

a sending module 803, further configured to detect, by the first device, a target terminal device in communication connection with the first device; detecting the data type supported by the target terminal equipment; and if the first data comprises target data with the same data type as that supported by the target terminal equipment, sending the target data to the target terminal equipment.

Optionally, the sending module 803 is further configured to, if the first data includes target data of the same data type as that supported by the target terminal device, determine whether a device identifier associated with the target data is the same as the device identifier of the target terminal device;

and if the equipment identifier associated with the target data is the same as the equipment identifier of the target terminal equipment, sending the target data to the target terminal equipment.

As shown in fig. 9, an embodiment of the present invention provides a second device, including:

an obtaining module 901, configured to obtain first data to be transmitted, and encode the first data to generate a video stream;

the playing module 902 is configured to play a video stream on a screen, where the video stream includes M frames of images, each frame of image in the video stream includes N image display regions, and each image display region indicates one data unit in the first data, so that the first device acquires a picture of each frame of image in the video stream played on the screen of the second device to obtain M original images, and decodes the M original images to obtain the first data, where M and N are integers greater than or equal to 2.

Optionally, the video stream is encrypted, and the playing module 902 transmits a key associated with the video stream, so that the first device obtains the key associated with the video stream from the second device, and the first device decodes the M original images according to the color displayed in each of the M original images, and obtains original data corresponding to the M original images; and decrypting the original data according to the key to obtain the first data.

Optionally, the second device further includes: a receiving module 903, configured to receive a target sequence number sent by the first device after the playing module 902 plays the video stream on the screen, where the target sequence number is a picture of each frame of image of the video stream acquired by the first device, and a missing image sequence number in image sequence numbers included in the M original images is obtained; and resending the images corresponding to the playing sequence and the target sequence number in the video stream according to the target sequence number.

Optionally, both the first device and the second device provided by the embodiment of the present invention may be mobile phones. For example, as shown in fig. 10, the mobile phone may include: radio Frequency (RF) circuitry 1010, memory 1020, input unit 1030, display unit 1040, sensor 1050, audio circuitry 1060, wireless fidelity (WiFi) module 1070, processor 1080, and power source 1090. The radio frequency circuit 1010 includes a receiver 1010 and a transmitter 1012. Those skilled in the art will appreciate that the handset configuration shown in fig. 10 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

RF circuit 1010 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, for processing downlink information of a base station after receiving the downlink information to processor 1080; in addition, the data for designing uplink is transmitted to the base station. In general, the RF circuitry 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 1010 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), etc.

The memory 1020 can be used for storing software programs and modules, and the processor 1080 executes various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 1020 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1030 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also referred to as a touch screen, may collect touch operations by a user (e.g., operations by a user on or near the touch panel 1031 using any suitable object or accessory such as a finger, a stylus, etc.) and drive corresponding connection devices according to a preset program. Alternatively, the touch panel 1031 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1080, and can receive and execute commands sent by the processor 1080. In addition, the touch panel 1031 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 1030 may include other input devices 1032 in addition to the touch panel 1031. In particular, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, a joystick, or the like.

The display unit 1040 may be used to display information input by a user or information provided to the user and various menus of the cellular phone. The display unit 1040 may include a display panel 1041, and optionally, the display panel 1041 may be configured in the form of a Liquid Crystal Display (LCD), an organic light-Emitting diode (OLED), or the like. Further, the touch panel 1031 can cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near the touch panel 1031, the touch operation is transmitted to the processor 1080 to determine the type of the touch event, and then the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of the touch event. Although in fig. 10, the touch panel 1031 and the display panel 1041 are two separate components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated to implement the input and output functions of the mobile phone.

The handset may also include at least one sensor 1050, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1041 and/or the backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here. In the embodiment of the present invention, the terminal device may include an acceleration sensor, a depth sensor, a distance sensor, or the like.

Audio circuitry 1060, speaker 1061, microphone 1062 may provide an audio interface between the user and the handset. The audio circuit 1060 can transmit the electrical signal converted from the received audio data to the speaker 1061, and the electrical signal is converted into a sound signal by the speaker 1061 and output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1060 and converted into audio data, which is then processed by the audio data output processor 1080 and then sent to, for example, another cellular phone via the RF circuit 1010, or output to the memory 1020 for further processing.

WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help the user to send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 1070, which provides wireless broadband internet access for the user. Although fig. 10 shows the WiFi module 1070, it is understood that it does not belong to the essential constitution of the handset, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 1080 is a control center of the mobile phone, connects various parts of the whole mobile phone by using various interfaces and lines, and executes various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 1020 and calling data stored in the memory 1020, thereby integrally monitoring the mobile phone. Optionally, processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor, which handles primarily the operating system, user interfaces, applications, etc., and a modem processor, which handles primarily the wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1080.

The handset also includes a power source 1090 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 1080 via a power management system to manage charging, discharging, and power consumption via the power management system. Although not shown, the mobile phone may further include a camera, a bluetooth module, etc., which are not described herein.

In the embodiment of the present invention, the mobile phone may further include a camera, where the camera may be configured to acquire a video stream by using the camera, each frame of image in the video stream includes a plurality of image display areas, and each image display area may indicate carried data information by a displayed color;

the processes of the first device may be implemented by the processor 1080, the audio circuit 1060, the RF circuit 1010, the input unit 1030, the WiFi module 1070, the display unit 1040, or the like, or the processes of the second device may be implemented by the processor.

An embodiment of the present invention further provides a first device, where the first device may include: the first device may perform the first process according to the above-described method embodiment, and the first device may perform the first process according to the first embodiment, and may achieve the same technical effect.

An embodiment of the present invention further provides a second device, where the second device may include: the second device may perform the processes performed by the second device in the above method embodiments, and may achieve the same technical effects, and details are not described herein to avoid repetition.

An embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process performed by the first device in the foregoing method embodiments.

An embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process performed by the second device in the foregoing method embodiments.

The first device, the second device, and the storage medium provided in the embodiment of the present invention may achieve the same technical effects as the data transmission method protected in the shanghai su precaution embodiment, and for avoiding repetition, the technical effects are not described herein again.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A method of data transmission, comprising:

the first device decodes the M original images to obtain the first data.

2. The method according to claim 1, wherein each image display region indicates one data unit in the first data by a displayed color.

3. The method of claim 2, wherein the video stream is encrypted;

before the first device decodes the M original images to obtain the first data, the method further includes:

the first device obtaining a key associated with the video stream from the second device;

the first device decoding the M original images to obtain the first data, including:

the first equipment decodes the M original images according to the color displayed in each original image in the M original images to acquire original data corresponding to the M original images;

and decrypting the original data according to the key to obtain the first data.

4. The method of claim 3, wherein the key is included in a target frame image in the video stream, the target frame image comprising one or more frames of images;

the first device obtaining a key associated with the video stream from the second device, including: the first device decodes a first target image in the M original images to obtain the key, wherein the first target image is an image obtained by collecting a picture of the target frame image in the video stream;

and decrypting a second target image according to the key to obtain the first data, wherein the second target image is an image except the first target image in the M original images.

5. The method of claim 3, wherein the first device obtaining the key associated with the video stream from the second device comprises:

the first equipment collects audio signals played by the second equipment through an audio playing device;

and analyzing the audio signal to obtain the key.

6. The method of claim 5, wherein the key is a frequency modulated audio signal, frequency data of the audio signal indicating key content;

the analyzing the audio signal to obtain the key includes:

acquiring frequency data of the audio signal;

determining key content indicated by frequency data of the audio signal;

and decrypting the original data according to the key content to obtain the first data.

7. The method according to claim 1, wherein the first data includes first target data obtained by decoding each original picture in the M original pictures, and the first target data includes a picture sequence number, and the picture sequence number is used to indicate a playing order of a picture corresponding to the first target data in the video stream;

after the first device decodes the M original images to obtain the first data, the method further includes:

if the image sequence number included in the first data is not continuous, the first device sends a missing target sequence number to the second device, so that the second device outputs the image corresponding to the target sequence number in the playing sequence of the video stream again according to the target sequence number.

8. The method of any of claims 1 to 7, wherein the data type of the first data comprises: at least one of an image data type, an audio data type, a video data type, and a text data type;

the first equipment detects target terminal equipment in communication connection with the first equipment;

detecting the data type supported by the target terminal equipment;

and if the first data comprises target data with the same data type as that supported by the target terminal equipment, sending the target data to the target terminal equipment.

9. The method of claim 8, wherein if the first data includes target data of a same data type as that supported by the target terminal device, sending the target data to the target terminal device includes:

if the first data comprises target data with the same data type as that supported by the target terminal equipment, judging whether the equipment identifier associated with the target data is the same as that of the target terminal equipment or not;

10. A method of data transmission, comprising:

the method comprises the steps that the video stream is played on a screen of a second device, the video stream comprises M frames of images, each frame of image in the video stream comprises N image display areas, each image display area indicates one data unit in first data, so that the first device can collect pictures of each frame of image in the video stream played on the screen of the second device to obtain M original images, and the M original images are decoded to obtain the first data, wherein M and N are integers larger than or equal to 2.

11. The method according to claim 10, wherein each image display region indicates one data unit in the first data by a displayed color.

12. The method of claim 11, wherein the video stream is encrypted, the method further comprising:

the second device transmits a key associated with the video stream so that the first device can acquire the key associated with the video stream from the second device, and the first device decodes the M original images according to the color displayed in each of the M original images to acquire original data corresponding to the M original images; and decrypting the original data according to the key to obtain the first data.

13. The method of claim 11 or 12, wherein after the video stream is played on the screen of the second device, the method further comprises:

the second device receives a target serial number sent by the first device, wherein the target serial number is a missing image serial number in image serial numbers included in M original images acquired by the first device and used for acquiring each frame of image of the video stream;

and the second equipment retransmits the images corresponding to the playing sequence and the target sequence number in the video stream according to the target sequence number.

14. A first device, comprising:

15. A second apparatus, comprising:

16. A first device, comprising: processor, memory and a computer program stored on the memory and executable on the processor, which computer program, when being executed by the processor, carries out the steps of the data transmission method according to one of claims 1 to 9.

17. A second apparatus, comprising: processor, memory and a computer program stored on the memory and executable on the processor, which computer program, when being executed by the processor, carries out the steps of the data transmission method according to one of claims 10 to 13.

18. A data transmission system, comprising: a first device as claimed in claim 14 or 16, and a second device as claimed in claim 15 or 17.

19. A computer-readable storage medium, comprising: the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the data transmission method according to one of claims 1 to 9 or carries out the steps of the data transmission method according to one of claims 10 to 13.