CN107623871B - Video-based communication method and device - Google Patents
Video-based communication method and device Download PDFInfo
- Publication number
- CN107623871B CN107623871B CN201610562514.5A CN201610562514A CN107623871B CN 107623871 B CN107623871 B CN 107623871B CN 201610562514 A CN201610562514 A CN 201610562514A CN 107623871 B CN107623871 B CN 107623871B
- Authority
- CN
- China
- Prior art keywords
- information
- image
- frame
- transmitted
- frame image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The embodiment of the invention provides a communication method and a device based on a video, which relate to the technical field of communication.A part of single-frame images of the video are embedded with information to be transmitted in an image preprocessing mode to obtain a target video with the information to be transmitted hidden, so that a user cannot see the information to be transmitted when watching the video; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by directly displaying the information to be transmitted along with the playing of the video; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a communication method and device based on videos.
Background
When watching video advertisements, a user is often forced to watch related information such as merchant two-dimensional codes, order telephones, purchase links and the like displayed along with the playing of the video advertisements, the information often can block images and influence the video display effect, and the watching experience of the user is seriously reduced.
Therefore, a communication method and apparatus that can enable a user to obtain video related information in time without affecting the viewing experience of the user is needed.
Disclosure of Invention
The embodiment of the invention provides a communication method and device based on videos, and solves the problem of poor user experience caused by displaying information to be transmitted in the video playing process.
The embodiment of the invention provides a video-based communication method, which is executed at a display equipment end and comprises the following steps:
acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list;
embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode;
synthesizing the part of the single-frame image embedded with the information to be transmitted and other single-frame images except the part of the single-frame image in the single-frame image list into a target video corresponding to the video;
and sending the target video to enable an imaging device to acquire the target video.
The embodiment of the invention provides a communication method based on video, which is executed at an imaging device end and comprises the following steps:
acquiring a target video, acquiring a single-frame image list of the video by the target video through display equipment, selecting partial single-frame images in the single-frame image list, embedding information to be transmitted into the selected partial single-frame images in an image preprocessing mode, and synthesizing the partial single-frame images embedded with the information to be transmitted and other single-frame images except the partial single-frame images in the single-frame image list;
extracting image information of at least two single-frame images contained in the target video by an image post-processing method corresponding to the image preprocessing mode;
determining a single-frame image embedded with the information to be transmitted and a single-frame image not embedded with the information to be transmitted, which are contained in the at least two single-frame images, according to the image information;
and extracting the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted.
The embodiment of the invention provides a communication device based on video, which is positioned at a display equipment end and comprises:
the image selection module is used for acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list;
the information embedding module is used for embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode;
the video synthesis module is used for synthesizing the part of the single-frame images embedded with the information to be transmitted and other single-frame images except the part of the single-frame images in the single-frame image list into a target video corresponding to the video;
and the video sending module is used for sending the target video so as to enable the imaging equipment to obtain the target video and extract the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted.
The embodiment of the invention provides a communication device based on video, which is positioned at an imaging device end and comprises:
the video acquisition module is used for acquiring a target video, acquiring a single-frame image list of the video and selecting a part of single-frame images in the single-frame image list by the target video through a display device, embedding information to be transmitted into the selected part of single-frame images in an image preprocessing mode, and synthesizing the part of single-frame images embedded with the information to be transmitted and other single-frame images except the part of single-frame images in the single-frame image list;
the first information extraction module is used for extracting the image information of at least two single-frame images contained in the target video by an image post-processing method corresponding to the image preprocessing mode;
the image determining module is used for determining the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted in the at least two single-frame images according to the image information;
and the second information extraction module is used for extracting the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted.
According to the communication method and device based on the video, the information to be transmitted is embedded into the partial single-frame image of the video in an image preprocessing mode, so that the target video with the hidden information to be transmitted is obtained, and a user cannot see the information to be transmitted when watching the video; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by displaying the information to be transmitted in the video playing process; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a flowchart of a video-based communication method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a method for embedding information to be transmitted into the selected part of the single-frame image according to the embodiment of the present invention;
fig. 3 is a schematic diagram of a method for obtaining a list of single-frame images and selecting a part of the single-frame images according to an embodiment of the present invention;
fig. 4 is a flow chart of another video-based communication method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a video-based communication method according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a video-based communication device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of another video-based communication device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
Fig. 1 is a flowchart of a video-based communication method according to an embodiment of the present invention, as shown in fig. 1, the method is executed at a display device, and includes:
step 101: acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list;
specifically, the display device includes an electronic billboard, an electronic product screen, etc. formed by L ED or L CD, but the invention is not limited thereto;
specifically, the video is analyzed through a video analysis technology, such as video editing software, e.g., Avid media composer, Adobe Premiere, and the like, so as to obtain a single-frame image list of single-frame images constituting the video, which is not limited in the present invention;
the embodiment of the invention can determine the number of the single-frame images to be used and the positions of the single-frame images to be used in the single-frame image list according to the propagation requirement of the information to be transmitted; selecting a single-frame image in the single-frame image list according to the number of the single-frame images to be used and the position in the single-frame image list;
step 102: embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode;
specifically, the image preprocessing method includes image processing methods such as RGB modulation, high-order modulation, and brightness modulation of an image, which is not limited in the present invention;
in the embodiment of the present invention, the same information to be transmitted is embedded in each selected single frame image, and a processing policy when each single frame image is preprocessed can be determined according to the specific content of the information to be transmitted, where the processing policy may include information such as a position of information modulation and a corresponding modulation parameter, and the present invention is not limited;
according to the embodiment of the invention, the same information to be transmitted is embedded in each selected single-frame image, so that a user can acquire the single-frame image containing the information to be transmitted at a plurality of time nodes corresponding to the video by using the imaging equipment, and the user can conveniently acquire the information to be transmitted at any time.
In other embodiments of the present invention, the information to be transmitted may also be split according to the specific content of the information to be transmitted, and the split information to be transmitted is respectively embedded into different single-frame images, for example, after splitting, the split information to be transmitted is dispersedly embedded into the single-frame images of the video key part;
the information to be transmitted is split and embedded into different single-frame images, so that the imaging equipment can extract complete information to be transmitted only by acquiring the content of a preset part or all videos, and a user is facilitated to watch all videos or key parts of the videos.
Step 103: synthesizing the part of the single-frame image embedded with the information to be transmitted and other single-frame images except the part of the single-frame image in the single-frame image list into a target video corresponding to the video;
specifically, a part of single-frame images in which information to be transmitted is embedded is called information-bearing single-frame images, other single-frame images except the part of single-frame images in the single-frame image list are called standard single-frame images, and according to parameters of the videos, all the information-bearing single-frame images and the standard single-frame images are synthesized into a target video corresponding to the videos, so that the playing effect of the target video is basically the same as that of the videos; the parameters of the video include a video frame rate, and the frame rate includes a high frame (high frame complement, high frame repeat) and/or a low frame rate, which is not limited in the present invention.
Step 104: and sending the target video to enable an imaging device to acquire the target video.
Specifically, the display device displays the target video through a display screen, so that the imaging device acquires the target video by shooting the target video.
According to the communication method based on the video, the information to be transmitted is embedded into a part of single-frame images of the video in an image preprocessing mode, so that a target video with the hidden information to be transmitted is obtained, and a user cannot see the information to be transmitted when watching the video; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by displaying the information to be transmitted in the video playing process; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
Specifically, the acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list includes: the method comprises the steps of obtaining a single-frame image list of a video, and selecting a single-frame image in the single-frame image list according to the mode of selecting a single-frame image every other frame.
The single-frame images in the single-frame image list are selected in a mode of selecting one single-frame image every other frame, so that a user can conveniently acquire hidden information to be transmitted at any time point corresponding to a video, the information to be transmitted can be extracted by comparing two adjacent frame images, the operation is simple, the calculated amount is small, the information extraction speed is favorably improved, and the user experience is improved.
Specifically, fig. 2 is a schematic diagram of a method for embedding information to be transmitted into the selected part of the single-frame image according to the embodiment of the present invention, and as shown in fig. 2, the method includes:
step 201: determining modulation coordinates on the selected part of the single-frame image according to information to be transmitted;
for example, assuming that the information to be transmitted is M (0/1 squares of I rows and J columns), each frame image in the selected part of the single-frame image is divided into squares of I rows and J columns corresponding to M; the I-th line and the J-th line corresponding to M on each frame map are different modulation coordinates;
step 202: determining a modulation parameter corresponding to the modulation coordinate;
referring to the example in step 201, assume that when M isijWhen the pixel point in the coordinate is modulated when the coordinate is equal to 0, the modulation parameter is the luminance component Lij+SL(ii) a When M isijWhen the pixel point in the coordinate is modulated when the coordinate is 1, the modulation parameter is the luminance component Lij-SL；
Step 203: and according to the modulation parameters, carrying out image preprocessing on the image position corresponding to the modulation coordinate so as to embed the information to be transmitted into the selected part of the single-frame image.
For example, image preprocessing is performed on the image position corresponding to the modulation coordinate according to the modulation parameter determined in the above step, so as to embed the information to be transmitted into the selected part of the single-frame image.
And determining modulation coordinates on the selected part of the single-frame image, determining modulation parameters corresponding to the modulation coordinates, and performing image preprocessing on the image position corresponding to the modulation coordinates according to the modulation parameters, so as to conveniently embed information to be transmitted into the selected part of the single-frame image.
Example 2
Fig. 3 is a schematic diagram of a method for acquiring a list of single-frame images and selecting a part of the single-frame images according to an embodiment of the present invention, as shown in fig. 3, the method includes:
step 301: acquiring a first single-frame image list of the video;
specifically, the embodiment of the present invention obtains a first single-frame image list including all single-frame images constituting the video by analyzing the video;
in other embodiments, a first single-frame image list including a part of single-frame images constituting the video may also be obtained, which is not limited in the present invention;
step 302: copying each single-frame image in the first single-frame image list to obtain a copy of each single-frame image;
step 303: inserting copies of the single-frame images into the front or back of the single-frame image corresponding to the single-frame image in the first single-frame image list to form a second single-frame image list;
step 304: selecting a portion of the single frame images and corresponding duplicates in the second list of single frame images.
Specifically, for example, the video is split into n frames of single-frame images, the n frames of single-frame images are copied to obtain copies of each frame of single-frame image, the n frames of copies are respectively inserted before or after the corresponding single-frame image in the first single-frame image list, and a second single-frame image list containing 2n frames of single-frame images is formed;
by copying the single-frame image list of the video, image preprocessing is carried out on the same two single-frame images by using opposite modulation parameters in the subsequent step of embedding the information to be transmitted, so that the video with the video watching effect caused by the embedding of the information to be transmitted is avoided.
Correspondingly, the embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode comprises the following steps:
determining modulation coordinates on the selected part of the single-frame image and the respective corresponding copies according to information to be transmitted; determining a first modulation parameter corresponding to the modulation coordinate on the selected part of the single-frame image and a second modulation parameter corresponding to the modulation coordinate on the respective corresponding copy; according to the first modulation parameter and the second modulation parameter, image preprocessing is carried out on the image position corresponding to the modulation coordinate, so that information to be transmitted is embedded into the selected part of the single-frame image and the corresponding copy; wherein a superimposed value of the first modulation parameter and the second modulation parameter is zero.
For example, with a single frame image and its corresponding copy as a group, selecting n/2 (taking integer) groups of single frame images and corresponding copies in the second single frame image list by selecting one group every other group;
assuming that information to be transmitted is M (0/1 squares of I lines and J columns), dividing each frame image in the selected part of single-frame images into I lines and J columns of squares corresponding to M; the I-th line and the J-th line corresponding to M on each frame image are different modulation coordinates;
suppose when M isijWhen the pixel point in the coordinate is modulated when the pixel point is equal to 0, the G color component of the first frame image of each group is converted into Gij+SGThe second frame image is Gij-SG(ii) a When M isijWhen 1, the G color component of the first frame image of each group is converted into Gij-SGThe second frame image is Gij+SG；
Synthesizing all single-frame images in a second single-frame image list embedded with information to be transmitted into a target video at a frame rate which is 2 times that of the video;
in other embodiments, the first single-frame image list may be further copied for multiple times, and when synthesizing the target video, the target video is synthesized at a frame rate of the video of a corresponding multiple, which is not specifically limited in the present invention;
the image preprocessing is carried out on the same two single-frame images by using opposite modulation parameters, so that the influence on the video viewing effect caused by the embedding of the information to be transmitted is avoided.
Example 2
Fig. 4 is a flowchart of a video-based communication method according to an embodiment of the present invention, and as shown in fig. 4, the method is executed at an imaging device side, and includes:
step 401: acquiring a target video, acquiring a single-frame image list of the video by the target video through display equipment, selecting partial single-frame images in the single-frame image list, embedding information to be transmitted into the selected partial single-frame images in an image preprocessing mode, and synthesizing the partial single-frame images embedded with the information to be transmitted and other single-frame images except the partial single-frame images in the single-frame image list;
specifically, the imaging device comprises user equipment such as a mobile phone, a tablet computer and a notebook computer with camera shooting and/or photographing functions; recording a target video played by the display equipment through a display screen through a camera of the user equipment;
step 402: extracting image information of at least two single-frame images contained in the target video by an image post-processing method corresponding to the image preprocessing mode;
specifically, the image preprocessing mode includes image processing methods such as RGB modulation, high-order modulation, and brightness modulation of an image; the image information comprises RGB information, high-order information, brightness information and the like; when the image preprocessing process adopts RGB modulation, the corresponding image post-processing method comprises the steps of extracting RGB information of an image, when the image preprocessing process adopts high-order modulation, the corresponding image post-processing method comprises the steps of extracting the high-order information of the image, and when the image preprocessing process adopts brightness modulation, the corresponding image post-processing method comprises the steps of extracting the brightness information of the image;
step 403: determining a single-frame image embedded with the information to be transmitted and a single-frame image not embedded with the information to be transmitted, which are contained in the at least two single-frame images, according to the image information;
specifically, image information of at least two adjacent single-frame images included in the target video is extracted, for example, the image information of the two adjacent single-frame images is extracted first, the image information of the two extracted single-frame images is compared, whether regular difference exists between the image information of the two selected single-frame images (that is, whether one frame is preprocessed or not) is judged, and if yes, it is determined that the two selected single-frame images include the single-frame image in which the information to be transmitted is embedded and the single-frame image in which the information to be transmitted is not embedded; if there is no regular difference in the image information of the two adjacent single-frame images (i.e. no image is pre-processed or both images are pre-processed), selecting a single-frame image before or after the selected single-frame image, continuing to perform step 402 on the selected single-frame image, and then performing comparison (i.e. if a is a, then performing comparison) on the selected single-frame imagen-1And AnIf the joint analysis is unsuccessful, consider AnAnd An+1)；
The image information of two adjacent frames of images is extracted, the operation is simple, the calculated amount is small, the information extraction speed is favorably improved, and therefore the user experience is improved.
In other embodiments, the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted, which are included in the at least two single-frame images, may also be determined in other synchronization, correction, multi-frame joint detection and other manners, so as to obtain the information to be transmitted, which is not limited in the present invention;
step 404: and extracting the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted.
Specifically, according to the image information of the single-frame image embedded with the information to be transmitted and the image information of the single-frame image not embedded with the information to be transmitted, modulation coordinates and corresponding modulation parameters are determined, so that the information to be transmitted corresponding to the modulation coordinates and the corresponding modulation parameters is determined;
according to the video-based communication method provided by the embodiment of the invention, the image information of at least two single-frame images contained in the target video is extracted through an image post-processing method corresponding to the image preprocessing mode, the single-frame images embedded with the information to be transmitted and the single-frame images not embedded with the information to be transmitted contained in the at least two single-frame images are determined according to the image information, and the information to be transmitted is extracted; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by displaying the information to be transmitted in the video playing process; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
Example 3
Fig. 5 is a schematic diagram of a video-based communication method according to an embodiment of the present invention, as shown in fig. 5, the method includes:
the original video is composed of a set of frame images [ A ]1,A2…AN]Composition, obtaining each frame image A by video analysisiAnd then embedding the transmission information into the group of image alternate frames through an image preprocessing process according to the input information to be transmitted, namely only one image of the front and the back images is embedded with the information, and the other image is used as a reference frame. Thus, a set of modulated frame images is obtained
Wherein
Representing the corresponding frame image AnAn image with embedded (modulated) information;
synthesizing the modulated frame images into a video by referring to the parameters of the original video, and then sending out the video through display equipment; the display device outputs a visible light signal. Due to the pre-processing of the images in the video, the visual effect of watching the video by human eyes can be ensured not to be influenced;
the imaging equipment is utilized to carry out video acquisition on visible light signals sent by the display equipment, the image preprocessing process can effectively resist interference caused by secondary imaging, and then the acquired video is analyzed to obtain a group of frame images [ R ]1,R2,R3,R4,…RN-1,RN]And extracting information embedded in the image by performing image post-processing.
According to the communication method based on the video, the information to be transmitted is embedded into a part of single-frame images of the video in an image preprocessing mode, so that a target video with the hidden information to be transmitted is obtained, and a user cannot see the information to be transmitted when watching the video; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by displaying the information to be transmitted in the video playing process; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
Example 4
To implement the video-based communication method provided in embodiment 1, an embodiment of the present invention provides a video-based communication apparatus, and fig. 6 is a schematic structural diagram of the video-based communication apparatus provided in the embodiment of the present invention, where the apparatus is located at a display device end, and includes:
the image selection module 10 is configured to acquire a single-frame image list of a video and select a part of single-frame images in the single-frame image list;
the information embedding module 20 is connected with the image selection module 20 and is used for embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode;
the video synthesis module 30 is connected to the information embedding module 20, and configured to synthesize the partial single-frame image in which the information to be transmitted is embedded and other single-frame images in the single-frame image list except the partial single-frame image into a target video corresponding to the video;
and the video sending module 40 is connected with the video synthesizing module 30 and is used for sending the target video so that the imaging device can obtain the target video and extract the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted.
Specifically, the image acquisition module 10 includes:
the image acquisition unit is used for acquiring a single-frame image list of the video;
and the image selection unit is used for selecting the single-frame images in the single-frame image list according to the mode of selecting one single-frame image every other frame.
the coordinate determination unit is used for determining modulation coordinates on the selected part of the single-frame image according to the information to be transmitted;
the parameter determining unit is used for determining a modulation parameter corresponding to the modulation coordinate according to a preset information modulation device;
and the information embedding unit is used for carrying out image preprocessing on the image position corresponding to the modulation coordinate according to the modulation parameter so as to embed the information to be transmitted into the selected part of the single-frame image.
In a specific embodiment of the present invention, the image obtaining module 10 includes:
an image obtaining unit, configured to obtain a first single frame image list of the video, copy each single frame image in the first single frame image list to obtain a copy of each single frame image, insert the copy of each single frame image before or after the corresponding single frame image in the first single frame image list, and form a second single frame image list;
and the image selection unit is used for selecting a part of single-frame images in the second single-frame image list and the corresponding copies.
In a specific embodiment of the present invention, the information embedding module 20 includes:
the coordinate determination unit is used for determining the selected part of the single-frame image and the modulation coordinates on the respective corresponding copies according to the information to be transmitted;
the parameter determining unit is used for determining a first modulation parameter corresponding to the modulation coordinate on the selected part of the single-frame image and a second modulation parameter corresponding to the modulation coordinate on the copy corresponding to the first modulation parameter and the second modulation parameter;
the information embedding unit is used for carrying out image preprocessing on the image position corresponding to the modulation coordinate according to the first modulation parameter and the second modulation parameter so as to embed the information to be transmitted into the selected part of the single-frame image and the corresponding copy;
the superposition value of the first modulation parameter and the second modulation parameter is zero, and the information modulation method comprises a three-primary-color modulation method, a high-order modulation method and/or a brightness modulation method.
According to the communication device based on the video, the information to be transmitted is embedded into the partial single-frame image of the video in an image preprocessing mode, so that the target video with the hidden information to be transmitted is obtained, and a user cannot see the information to be transmitted when watching the video; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by displaying the information to be transmitted in the video playing process; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
Example 5
To implement the video-based communication method provided in embodiment 2, an embodiment of the present invention provides a video-based communication apparatus, and fig. 7 is a schematic structural diagram of the video-based communication apparatus provided in the embodiment of the present invention, where the apparatus is located at an imaging device end, and includes:
the video acquisition module 10' is configured to acquire a target video, where the target video acquires a single-frame image list of the video through a display device, selects a part of single-frame images in the single-frame image list, embeds information to be transmitted into the selected part of single-frame images in an image preprocessing manner, and synthesizes the part of single-frame images embedded with the information to be transmitted and other single-frame images in the single-frame image list except the part of single-frame images;
a first information extraction module 20' configured to extract image information of at least two single-frame images included in the target video by an image post-processing method corresponding to the image preprocessing method;
the image determining module 30' is configured to determine, according to the image information, a single frame image in which the information to be transmitted is embedded and a single frame image in which the information to be transmitted is not embedded, which are included in the at least two single frame images;
and the second information extraction module 40' is used for extracting the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted.
In particular, the first information extraction module 20' is configured to: and extracting image information of at least two adjacent single-frame images contained in the target video.
According to the video-based communication device provided by the embodiment of the invention, the image information of at least two single-frame images contained in the target video is extracted through an image post-processing method corresponding to the image preprocessing mode, the single-frame images embedded with the information to be transmitted and the single-frame images not embedded with the information to be transmitted contained in the at least two single-frame images are determined according to the image information, and the information to be transmitted is extracted; the method hides the information to be transmitted in the target video by utilizing the difference between the human eye channel and the imaging channel, thereby avoiding the problem of poor user experience caused by displaying the information to be transmitted in the video playing process; when a user is interested in video content, the target video can be obtained through imaging equipment, information to be transmitted is extracted by comparing a single-frame image in which the information to be transmitted is embedded with a single-frame image in which the information to be transmitted is not embedded in the target video, and the user can obtain the information to be transmitted through user equipment with an imaging function at any time and any place, so that the transmission and diffusion of the information to be transmitted are facilitated.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (4)
1. A video-based communication method, implemented at a display device, comprising:
acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list;
embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode;
synthesizing the part of the single-frame image embedded with the information to be transmitted and other single-frame images except the part of the single-frame image in the single-frame image list into a target video corresponding to the video;
sending the target video to enable an imaging device to acquire the target video;
the acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list includes:
acquiring a first single-frame image list of the video;
copying each single-frame image in the first single-frame image list to obtain a copy of each single-frame image;
inserting copies of the single-frame images into the front or back of the single-frame image corresponding to the single-frame image in the first single-frame image list to form a second single-frame image list;
selecting a part of single-frame images and corresponding copies in the second single-frame image list by selecting one group from every other group by taking a single-frame image and a corresponding copy thereof as a group;
the embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode comprises the following steps:
determining modulation coordinates on the selected part of the single-frame image and the respective corresponding copies according to information to be transmitted;
determining a first modulation parameter corresponding to the modulation coordinate on the selected part of the single-frame image and a second modulation parameter corresponding to the modulation coordinate on the respective corresponding copy;
according to the first modulation parameter and the second modulation parameter, image preprocessing is carried out on the image position corresponding to the modulation coordinate, so that information to be transmitted is embedded into the selected part of the single-frame image and the corresponding copy;
wherein a superimposed value of the first modulation parameter and the second modulation parameter is zero.
2. A video-based communication method, implemented at an imaging device, for use with the video-based communication method of claim 1, comprising:
acquiring a target video, acquiring a single-frame image list of the video by the target video through display equipment, selecting partial single-frame images in the single-frame image list, embedding information to be transmitted into the selected partial single-frame images in an image preprocessing mode, and synthesizing the partial single-frame images embedded with the information to be transmitted and other single-frame images except the partial single-frame images in the single-frame image list;
extracting image information of at least two single-frame images contained in the target video by an image post-processing method corresponding to the image preprocessing mode;
determining a single-frame image embedded with the information to be transmitted and a single-frame image not embedded with the information to be transmitted, which are contained in the at least two single-frame images, according to the image information;
extracting the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted;
wherein the extracting image information of at least two single-frame images contained in the target video includes:
firstly, extracting image information of two adjacent single-frame images, comparing the extracted image information of the two single-frame images, judging whether the image information of the two selected single-frame images has regular difference, and if so, determining that the two selected single-frame images contain the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted; and if no regular difference exists between the image information of the two adjacent single-frame images, selecting a single-frame image before or after the two selected single-frame images, extracting the image information, and then comparing.
3. A video-based communication apparatus on a display device side, comprising:
the image selection module is used for acquiring a single-frame image list of a video and selecting a part of single-frame images in the single-frame image list;
the information embedding module is used for embedding the information to be transmitted into the selected part of the single-frame image in an image preprocessing mode;
the video synthesis module is used for synthesizing the part of the single-frame images embedded with the information to be transmitted and other single-frame images except the part of the single-frame images in the single-frame image list into a target video corresponding to the video;
the video sending module is used for sending the target video so as to enable the imaging equipment to obtain the target video and extract the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted;
wherein the image selection module comprises:
an image obtaining unit, configured to obtain a first single frame image list of the video, copy each single frame image in the first single frame image list to obtain a copy of each single frame image, insert the copy of each single frame image before or after the corresponding single frame image in the first single frame image list, and form a second single frame image list;
the image selection unit is used for selecting a part of single-frame images and corresponding copies in the second single-frame image list in a mode of selecting one group every other group by taking one single-frame image and the corresponding copy as one group;
the information embedding module comprises:
the coordinate determination unit is used for determining the selected part of the single-frame image and the modulation coordinates on the respective corresponding copies according to the information to be transmitted;
the parameter determining unit is used for determining a first modulation parameter corresponding to the modulation coordinate on the selected part of the single-frame image and a second modulation parameter corresponding to the modulation coordinate on the copy corresponding to the first modulation parameter and the second modulation parameter;
the information embedding unit is used for carrying out image preprocessing on the image position corresponding to the modulation coordinate according to the first modulation parameter and the second modulation parameter so as to embed the information to be transmitted into the selected part of the single-frame image and the corresponding copy;
wherein a superimposed value of the first modulation parameter and the second modulation parameter is zero.
4. A video-based communication apparatus, located at an imaging device, for use with the video-based communication apparatus of claim 3, comprising:
the video acquisition module is used for acquiring a target video, acquiring a single-frame image list of the video and selecting a part of single-frame images in the single-frame image list by the target video through a display device, embedding information to be transmitted into the selected part of single-frame images in an image preprocessing mode, and synthesizing the part of single-frame images embedded with the information to be transmitted and other single-frame images except the part of single-frame images in the single-frame image list;
the first information extraction module is used for extracting the image information of at least two single-frame images contained in the target video by an image post-processing method corresponding to the image preprocessing mode;
the image determining module is used for determining the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted in the at least two single-frame images according to the image information;
the second information extraction module is used for extracting the information to be transmitted according to the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted;
the first information extraction module extracts image information of two adjacent single-frame images, the image determination module compares the extracted image information of the two single-frame images, judges whether the image information of the two selected single-frame images has regular difference, and determines that the two selected single-frame images contain the single-frame image embedded with the information to be transmitted and the single-frame image not embedded with the information to be transmitted if the image information of the two selected single-frame images has regular difference; and if no regular difference exists between the image information of the two adjacent single-frame images, selecting a single-frame image before or after the two selected single-frame images, extracting the image information, and then comparing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610562514.5A CN107623871B (en) | 2016-07-15 | 2016-07-15 | Video-based communication method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610562514.5A CN107623871B (en) | 2016-07-15 | 2016-07-15 | Video-based communication method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107623871A CN107623871A (en) | 2018-01-23 |
| CN107623871B true CN107623871B (en) | 2020-07-28 |
Family
ID=61087555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610562514.5A Active CN107623871B (en) | 2016-07-15 | 2016-07-15 | Video-based communication method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107623871B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120325A (en) * | 2015-09-15 | 2015-12-02 | 中国人民解放军信息工程大学 | Information transmission method and information transmission system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6563937B1 (en) * | 2001-11-28 | 2003-05-13 | Sony Corporation | Method and apparatus to detect watermark that are resistant to arbitrary deformations |
-
2016
- 2016-07-15 CN CN201610562514.5A patent/CN107623871B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120325A (en) * | 2015-09-15 | 2015-12-02 | 中国人民解放军信息工程大学 | Information transmission method and information transmission system |
Non-Patent Citations (2)
| Title |
|---|
| "Multiflexing Full-Frame Visible Communication Channel for Humans and Devices";Anran Wang et al.;《Proceedings of the 13th ACM Workshop on Hot Topics in Networks》;20141028;1-7 * |
| 基于可见光通信的隐式信息服务系统;朱环宇 等;《光学学报》;20150930;0906008:1-6 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107623871A (en) | 2018-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108322788B (en) | Advertisement display method and device in live video | |
| US10368123B2 (en) | Information pushing method, terminal and server | |
| CN109803180B (en) | Video preview generation method and device, computer equipment and storage medium | |
| JP5325267B2 (en) | Object display device, object display method, and object display program | |
| CN104081765B (en) | Image processing apparatus and image processing method thereof | |
| CN101291392B (en) | Apparatus and method of processing image as well as apparatus and method of generating reproduction information | |
| EP2109313A1 (en) | Television receiver and method | |
| Pinson et al. | Selecting scenes for 2D and 3D subjective video quality tests | |
| US10834379B2 (en) | 2D-to-3D video frame conversion | |
| CN112954450B (en) | Video processing method and device, electronic equipment and storage medium | |
| EP3681144A1 (en) | Video processing method and apparatus based on augmented reality, and electronic device | |
| US20210118403A1 (en) | Display method and display device, visible light communication transmission method and device | |
| CN111985281A (en) | Image generation model generation method and device and image generation method and device | |
| CN112565653A (en) | Video frame insertion method, system, electronic equipment and storage medium | |
| CN111246196A (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| CN113038185B (en) | Bullet screen processing method and device | |
| CN116761037B (en) | Method, device, equipment and medium for video implantation of multimedia information | |
| KR20140126529A (en) | Physical Movement of Object on Reality-Augmented Reality Interaction System and Implementation Method for Electronic book | |
| CN113573044A (en) | Video data processing method and device, computer equipment and readable storage medium | |
| CN107623871B (en) | Video-based communication method and device | |
| KR20190028046A (en) | Historical studies method and system using augmented reality | |
| Lin et al. | Video exhibition with adjustable augmented reality system based on temporal psycho-visual modulation | |
| KR101663042B1 (en) | Photo fusing apparatus | |
| KR20180100873A (en) | Electronic apparatus for playing substitutional advertisement and method for controlling method thereof | |
| CN113379582A (en) | Information adding method, information extracting device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |