WO2014089881A1

WO2014089881A1 - Picture touch and read playing system and method

Info

Publication number: WO2014089881A1
Application number: PCT/CN2012/087417
Authority: WO
Inventors: 张肃
Original assignee: Zhang Su
Priority date: 2012-12-10
Filing date: 2012-12-25
Publication date: 2014-06-19
Also published as: CN103035134A; CN103035134B

Abstract

Disclosed are a picture touch and read playing system and method. The system comprises: a touch and read pen, used for collecting an optical image of a picture printed with an optical identification code, and transmitting the optical image in a wireless manner; and an intelligent processing terminal, used for data processing, audio playing, video playing and wireless communication. The touch and read pen collects the optical image of the picture printed with the optical identification code, processes the optical image to obtain transmission data, and sends the transmission data to the intelligent processing terminal in a wireless communication manner. The intelligent processing terminal receives and processes the transmission data, and plays an audio and a video corresponding to the transmission data in a synchronous manner. When the present invention is applied in early childhood education, after the picture provided with the optical identification code is touched and read, the audio and video corresponding to the picture are played on the intelligent processing terminal; therefore, a better teaching effect can be obtained, and the user experience is good. The present invention can be widely applied in the field of early childhood education.

Description

Image point reading and playing system and method

Technical field

The invention relates to a point reading and playing system and method, in particular to an image point reading and playing system and method.

Background technique

The reading pen is a reading and learning tool developed by using photoelectric recognition technology combined with advanced digital voice technology. OID is Optical The abbreviation of Identification is a kind of optical identification code. OID sets up the latest and most convenient interface bridge between cold printing and digital systems. Each OID coded picture is composed of many subtle and difficult-to-resolve points according to specific rules and corresponds to a specific set of values. The biggest difference from other optical identification codes is that the minimized bottom code is not only confidential. The low visual interference characteristics are more concealed under the color pattern of the printed matter. OID is a low-cost solution that can be achieved by simply using ordinary printing inks. Then, the voices obtained by reading the invisible barcodes on the memory or the memory card are played, and the speakers are played by the pens of the pens, and only the pens are used. The tip of the type tool is lightly clicked on the printed plain book, and the small speaker or earphone of the pen body emits a clear and loud voice or scene sound, making the reading vivid and interesting, and filling the boring learning. Have fun with entertainment. The existing photoelectric point reading pen scans the invisible two-dimensional code in the printed matter through the optical head, and finds the corresponding pronunciation content in the data after identifying the corresponding encoding, and plays the same.

For young children, the use of a point reading pen is mainly used to identify images on a book and perform various kinds of learning, for example, learning to recognize various animals, plants, and the like. The current point reading pen has a single function and can only play sounds. The child can only have a rough concept of the image and cannot learn visually.

Summary of the invention

In order to solve the above technical problem, an object of the present invention is to provide an image point reading and playing system capable of playing video by wireless transmission and having good user experience. Another object of the present invention is to provide a wireless transmission. The way to play the video image point read playback method.

The technical solution adopted by the present invention to solve the technical problem thereof is:

An image point reading and playing system comprises: a point reading pen for wirelessly transmitting an image after printing an optical identification code, and an intelligent processing terminal for performing data processing, audio playing, video playing and wireless communication The point pen and the intelligent processing terminal are connected by a wireless connection;

The point reading pen performs optical image acquisition on the image printed with the optical identification code to obtain transmission data, and transmits the transmission data to the intelligent processing terminal by wireless communication, and the intelligent processing terminal receives the transmission data and performs the transmission data. Processing, and then synchronously playing and transmitting audio and video corresponding to the data;

The transmission data includes an optical image, an optical identification code, or playback information corresponding to the optical identification code.

Further, the dot reading pen includes an optical identification module for performing optical image acquisition on an image printed with an optical identification code, and an output of the optical identification module is sequentially connected with an analog to digital conversion module, an image processing module, and a first control. a module, the output end of the image processing module is connected to the first input end of the first control module, and the first control module is sequentially connected with the first modem module and the first wireless communication module, the first control module Also connected to the first storage module;

The analog-to-digital conversion module is configured to convert the collected optical image into a digital signal, and the image processing module is configured to extract a corresponding optical identification code from the digital signal converted into the optical image;

The intelligent processing terminal includes a second wireless communication module, and the second wireless communication module is sequentially connected with a second modulation and demodulation module, a second control module, and a second storage module, and the first output end of the second control module a video decoding module and a display module are sequentially connected, and the second output end of the second control module is sequentially connected with an audio decoding module and an audio playing module;

The first wireless communication module and the second wireless communication module are connected by a wireless connection.

Further, the optical identification module includes a lens and an optical sensor, an output end of the lens is connected to an input end of the optical sensor, and an output end of the optical sensor is connected to an input end of the image processing module;

The lens is for amplifying an image printed with an optical identification code for optical image acquisition of the enlarged image with the optical identification code printed thereon.

Further, the point pen further includes a button module and/or an optical identification code component, and an output end of the button module is connected to a second input end of the first control module.

Further, the point reading pen further includes a first expansion module for externally connecting the mobile storage device, and an output end of the first expansion module is connected to an input end of the first control module;

The intelligent processing terminal further includes a second expansion module for externally connecting the mobile storage device, the video playback device or the audio playback device, and the output end of the second expansion module is connected to the input end of the second control module.

Further, the server further includes a server for storing a play database corresponding to the optical identification code, and the smart processing terminal further includes a communication module for communicating with the server, and the communication module is connected to the second control module.

Another technical solution adopted by the present invention to solve the technical problems thereof is:

An image point reading and playing method includes:

S1: The optical image of the image is collected by the optical recognition module and then converted into a digital signal by an analog-to-digital conversion module, and the digital signal converted by the optical image is processed by the image processing module to obtain an optical identification code of the image, and sent to the first a control module;

S2. After receiving the optical identification code, the first control module reads the play information corresponding to the optical identification code from the first storage module.

S3, modulating the playing information, and sending the information to the intelligent processing terminal through the first wireless communication module;

S4. After receiving the modulated play information, the second wireless communication module demodulates the broadcast information and sends the information to the second control module.

S5. The second control module reads the corresponding play data from the second storage module according to the demodulated play information, and sends the play data to the audio decoding module for audio decoding, and then plays the play data simultaneously. Synchronous playback after video decoding by the video decoding module.

Further, the step S1 includes:

S11. After the image printed with the optical identification code is amplified by the lens of the optical identification module, the optical image of the image is collected by using an optical sensor, and converted into a digital signal by the analog-to-digital conversion module;

S12, using an image processing module to perform gray scale conversion, histogram equalization, denoising, sharpening, and edge pre-processing on the digital signal converted by the optical image;

S13. Perform binarization processing on the preprocessed signal according to a single threshold segmentation algorithm to obtain a binarized image;

S14. Perform shape detection on the obtained binarized image by using Hough transform, and perform screening, and select multiple candidate positioning patterns according to the shape factor;

S15. Decode the selected candidate positioning graphics into data information, and then obtain an optical identification code, and send the optical identification code to the first control module.

Further, before the step S1, the method further includes the following steps:

S0, the point reading pen generates a synchronization code through the first control module, modulates and transmits to the intelligent processing terminal through the first wireless communication module, and the intelligent processing terminal receives the synchronization code through the second wireless communication module, performs demodulation and performs pairing The code, if the code is successful, establishes a connection with the point pen, and then performs step S1.

Further, after the step S5, the method further includes the following steps:

S6. The input information of the detection button module and/or the optical identification code component is read, the corresponding control information is read from the first storage module according to the input information, and the control information is modulated and sent to the intelligent processing terminal;

After receiving the modulated control information, the second wireless communication module demodulates and transmits the control information to the second control module, and the second control module controls the playback of the audio and video according to the demodulated control information.

The invention has the beneficial effects that the image point reading and playing system of the invention can perform point reading on the image containing the optical identification code, and send the corresponding playing information of the image to the intelligent processing terminal by wireless means, and intelligently process The terminal reads the corresponding audio data and video data according to the playback information, and simultaneously performs audio playback and video playback, and is applied to the teaching of the child. After reading the image containing the optical identification code, the terminal can play the image on the intelligent processing terminal. The audio and video corresponding to the image can achieve better teaching effects and user experience.

Another advantageous effect of the present invention is: an image point reading and playing method of the present invention, which can perform point reading on an image containing an optical identification code, and send the corresponding playback information of the image to the intelligent processing terminal by wireless means, The intelligent processing terminal reads the corresponding audio data and video data according to the playback information, and simultaneously performs audio playback and video playback, and is applied to the teaching of the child, and can be read on the intelligent processing terminal after reading the image containing the optical identification code. Playing the audio and video corresponding to the image can achieve better teaching effects and user experience.

DRAWINGS

The invention will now be further described with reference to the accompanying drawings and embodiments.

1 is a structural block diagram of Embodiment 1 of an image dot reading playback system of the present invention;

2 is a structural block diagram of a second embodiment of an image dot reading playback system of the present invention;

3 is a flow chart of an image dot reading playback method of the present invention.

detailed description

In order to facilitate the following description, the following terms are first explained:

OID (Optical Identification), a type of optical identification code;

Wifi: A wireless connection.

The invention provides an image point reading and playing system, comprising: a point reading pen for performing optical image acquisition on an image printed with an optical identification code, and for performing data processing, audio playing, video playing and wireless communication Intelligent processing terminal; the point reading pen and the intelligent processing terminal are connected by a wireless connection;

The transmission data includes an optical image, an optical identification code, or playback information corresponding to the optical identification code. After reading the optical image, the reading pen can be directly sent to the intelligent processing terminal for processing through the wireless communication mode; or the optical image can be collected for processing to obtain the optical identification code, and then sent to the intelligent processing terminal for processing through the wireless communication mode; The optical image is processed to obtain an optical identification code, and the playback information corresponding to the optical identification code is acquired, and the playback information is sent to the intelligent processing terminal for processing.

Further, as a preferred embodiment, referring to FIG. 1 , the dot reading pen includes an optical recognition module for performing optical image acquisition on an image printed with an optical identification code, and an output of the optical recognition module is sequentially connected with analog to digital conversion. a module, an image processing module, and a first control module, wherein an output end of the image processing module is connected to a first input end of the first control module, and the first control module is sequentially connected with the first modem module and the first wireless a communication module, the first control module is further connected to the first storage module;

Here, the analog to digital conversion module is configured to convert the collected optical image into a digital signal;

The image processing module is configured to extract a corresponding optical identification code from the digital signal converted into the optical image;

The first storage module is configured to store playback information corresponding to different optical identification codes;

The first modem module is configured to modulate a signal such as playing information sent by the point reading pen, and demodulate the signal received by the point reading pen;

The first control module is configured to read related play information from the first storage module according to the optical identification code sent by the received image processing module, and perform modulation by the first modem module, and then pass the first wireless communication module. Send it out.

The first wireless communication module and the second wireless communication module are used for realizing wireless communication between the point reading pen and the intelligent processing terminal, and can communicate by means of infrared, Bluetooth and wifi;

The second modem module is configured to demodulate the received broadcast information and the like, and to modulate the signal to be sent to the point pen;

The second storage module is configured to store the play data corresponding to the play information corresponding to the different optical identification codes, where the play data includes the audio data and the video data at the same time; generally, the play data here adopts the all-round corresponding to the image recognized by the point read. Video data and synchronized audio data, so that children can learn more intuitively;

The audio decoding module is configured to decode the audio data in the playing data, and send the audio data to the audio playing module for playing; where the audio playing module includes a speaker for playing the sound and converting the decoded audio data into an analog signal. Digital to analog conversion module;

The video decoding module is configured to decode the video data in the playing data and send it to the display module for playing;

The second control module is configured to perform corresponding play control according to the received play information, including reading the corresponding play data from the second storage module, respectively performing audio decoding and video decoding, and then playing.

The optical identification code can be OID code, which can be realized by using ordinary printing ink, which can save cost. In use, the image is printed with ordinary printing inks with OID codes that do not prevent the human eye from recognizing the image. Each OID code is composed of a number of subtle points according to specific rules and corresponds to a specific set of information. After the OID code information is collected by the optical recognition module, after the data processing module analyzes and processes, the OID code on the image can be extracted and sent to the first control module for related operations.

The intelligent processing terminal can adopt a specially designed playing screen for playing audio and video, or can be realized by a smart terminal such as a tablet computer that can install third-party software, as long as the corresponding program is programmed to realize the reading and playing of the image. The function of the system. Direct use of intelligent terminals such as tablet computers, without the need to purchase additional audio and video playback equipment, can greatly reduce production costs, and is easy to use and easy to carry. Children can use the combination of point pens and portable smart terminals to play, entertain or learn anytime, anywhere. For example, before the children go to sleep, parents can use this image to read and play the system to interact with the children, play videos, and play stories for children. Or children's songs, children fall asleep.

Further as a preferred embodiment, the optical recognition module includes a lens and an optical sensor, an output end of the lens is connected to an input end of the optical sensor, and an output end of the optical sensor is connected to an input end of the image processing module;

Further as a preferred embodiment, the point reading pen further comprises a button module and/or an optical identification code component, and an output end of the button module is connected to a second input end of the first control module.

The button module is used to control the playback function and mode, for example, playing again, adjusting the volume, or aborting the video being played.

The optical identification component can also implement the function of the button module, that is, the optical identification code is used to control the playback function and mode. Here, the optical identification code component refers to a card, a book, and the like printed with an optical identification code, and icons for representing different control information are printed on the component, and each icon is printed with a different optical identification code, and different optical identification codes are printed. The corresponding control information is stored in the first storage module. When the different icons are read by the dot reading pen, different optical identification codes are selected, processed by the image processing module and sent to the first control module, and the first control module is received from the first storage module according to the received optical identification code. Read the corresponding control information, perform related playback functions and mode control, for example, play again, adjust the volume or terminate the video being played. Preferably, the optical identification code here uses an OID code.

Further as a preferred embodiment, the reading pen further includes a first expansion module for externally connecting the mobile storage device, and an output end of the first expansion module is connected to an input end of the first control module;

The first expansion module may be a USB interface or a card reading module for reading a memory card, and is mainly used for externally related instructions.

Preferably, the second expansion module may be a USB interface or a card reading module for reading the memory card, and the second expansion module reads the mobile storage device, and the playback data corresponding to the different optical identification codes may be stored in the mobile storage. The device needs to access the intelligent processing terminal when it is used, which not only saves the storage space of the intelligent processing terminal, but also can be accessed into different intelligent processing terminals for use, and the operation is more convenient. It can realize one point reading pen corresponding to multiple intelligent processing terminals, which is convenient and fast.

Preferably, the second expansion module can also be used for an external video player such as a television or a projector to realize a large-screen video playback, and can also be used for an audio playback device such as an external speaker or a speaker to directly perform audio playback.

Further, as a preferred implementation, the server further includes a server for storing a play database corresponding to the optical identification code, and the smart processing terminal further includes a communication module for communicating with the server, where the communication module is connected to the second control module.

After the server is connected, after receiving the playback information, the second control module can directly play the corresponding playing data from the server through the communication module, and can also read and store the newly added playing database to the second storage in time. In the module.

Further, as a preferred implementation manner, the wireless connection manner of the first wireless communication module and the second wireless communication module includes any one of infrared, Bluetooth, and wifi.

Referring to FIG. 3, the present invention also provides an image point reading and playing method, including:

S5. The second control module reads the corresponding play data from the second storage module according to the demodulated play information, and sends the play data to the audio decoding module for audio decoding, and then plays the play data simultaneously. Synchronous playback after video decoding by the video decoding module. Here, the synchronization of audio playback and video playback can be controlled by the control of the clock.

The above method is only a preferred embodiment of the present invention, and the solution of the present invention further includes an implementation method of directly transmitting the optical image through the wireless communication mode to the intelligent processing terminal for processing, and also includes the point pen to collect the optical image. After performing the processing to obtain the optical identification code, the method is sent to the intelligent processing terminal for processing by the wireless communication mode; and the point reading pen collects the optical image for processing to obtain the optical identification code, and the playback information corresponding to the optical identification code is obtained, The playback information is sent to an intelligent processing terminal for processing. Other processing steps such as image processing steps and the like employ the same processing as the above method.

Further, as a preferred implementation, the step S1 includes:

Here, the positioning graphic may be a square, a rectangle or a circle, and is decoded according to the arrangement of the plurality of positioning patterns, and the data information represented by the combination of the plurality of positioning patterns is obtained, which is generally a binary code, and the data information obtained here is The optical identification code of the image is acquired.

Further as a preferred embodiment, the step S1 further includes the following steps:

By using the present invention to perform dot-reading playback of images, in order to avoid signal interference or garbled caused by operation of one intelligent processing terminal or simultaneous operation of multiple intelligent processing terminals by one dot reading machine at the same time, Here, before the official use of the point reading pen, the automatic code matching step S0 is added, and if the automatic code matching fails, the related operation of the reading pen is rejected. The synchronization code may be a random code or a sequence code set in advance to the point reading pen and the intelligent processing terminal. For example, if the point reading pen and the intelligent processing terminal set a certain symbol as a synchronization code, when performing the code operation, If the synchronization codes are the same, a connection is established. The synchronization code may also be a status code. For example, when the point reading pen or the intelligent processing terminal does not establish a connection, it is a first status code, and when the connection is established with the intelligent processing terminal or the point reading pen, the status is changed to the second status. When the code and the synchronization code are the second status code, the code operation cannot be performed again, and the situation that signal interference occurs due to repeated connection establishment is avoided.

Further, as a preferred implementation, the step S5 further includes the following steps:

Preferably, when the point read transmission is confidential data, an encryption step may be added between steps S2 and S3, and a decryption step is added between steps S4 and S5. For example, in the encryption step, 128 is used. The bit group symmetric encryption algorithm encrypts the play information; in the decryption step, the demodulated play information is decrypted by using a corresponding decryption algorithm.

In the image point reading and playing system and method of the present invention, the image referred to is not limited to a picture, and may also include various characters, because for the system, whether it is a text or a picture, the optical recognition module collects the optical. An image in the form of an image.

The above is a detailed description of the preferred embodiments of the present invention, but the present invention is not limited to the embodiments, and various equivalent modifications or substitutions can be made by those skilled in the art without departing from the spirit of the invention. These equivalent variations or alternatives are intended to be included within the scope of the claims.

Claims

An image point reading and playing system, comprising: a point reading pen for performing optical image acquisition on an image printed with an optical identification code, and for performing data processing, audio playing, video playing, and wireless communication Intelligent processing terminal; the point reading pen and the intelligent processing terminal are connected by a wireless connection;

The point reading pen performs optical image acquisition on the image printed with the optical identification code to obtain transmission data, and transmits the transmission data to the intelligent processing terminal by wireless communication, and the intelligent processing terminal receives the transmission data and performs the transmission data. Processing, and then synchronously playing and transmitting audio and video corresponding to the data;

The transmission data includes an optical image, an optical identification code, or playback information corresponding to the optical identification code.
An image dot reading playback system according to claim 1, wherein said dot reading pen comprises an optical recognition module for optical image acquisition of an image printed with an optical identification code, said optical recognition module The output end is connected with an analog-to-digital conversion module, an image processing module and a first control module. The output end of the image processing module is connected to the first input end of the first control module, and the first control module is sequentially connected with the first a modem module and a first wireless communication module, wherein the first control module is further connected to the first storage module;

The analog-to-digital conversion module is configured to convert the collected optical image into a digital signal, and the image processing module is configured to extract a corresponding optical identification code from the digital signal converted into the optical image;

The intelligent processing terminal includes a second wireless communication module, and the second wireless communication module is sequentially connected with a second modulation and demodulation module, a second control module, and a second storage module, and the first output end of the second control module a video decoding module and a display module are sequentially connected, and the second output end of the second control module is sequentially connected with an audio decoding module and an audio playing module;

The first wireless communication module and the second wireless communication module are connected by a wireless connection.
The image point reading and playback system according to claim 2, wherein the optical recognition module comprises a lens and an optical sensor, an output end of the lens is connected to an input end of the optical sensor, and an output of the optical sensor The end is connected to the input end of the image processing module;

The lens is for amplifying an image printed with an optical identification code for optical image acquisition of the enlarged image with the optical identification code printed thereon.
The image dot reading playback system according to claim 2, wherein the dot reading pen further comprises a button module and/or an optical identification code component, and an output end of the button module and a first control module Two input connections.
The image point reading and playback system according to claim 2, wherein the point reading pen further comprises a first expansion module for externally connecting the mobile storage device, and the output end of the first expansion module is first The input of the control module is connected;

The intelligent processing terminal further includes a second expansion module for externally connecting the mobile storage device, the video playback device or the audio playback device, and the output end of the second expansion module is connected to the input end of the second control module.
An image dot reading playback system according to claim 2, further comprising a server for storing a play database corresponding to the optical identification code, the intelligent processing terminal further comprising a communication module for communicating with the server The communication module is connected to the second control module.
An image point reading and playing method, comprising:

The point reading pen performs optical image acquisition on the image with the optical identification code and processes the data to obtain the transmission data, and transmits the transmission data to the intelligent processing terminal through wireless communication, and the intelligent processing terminal receives the transmission data and performs processing. And then synchronously playing and transmitting audio and video corresponding to the data;

The transmission data includes an optical image, an optical identification code, or playback information corresponding to the optical identification code;

The method is specifically:

S1: The optical image of the image is collected by the optical recognition module and then converted into a digital signal by an analog-to-digital conversion module, and the digital signal converted by the optical image is processed by the image processing module to obtain an optical identification code of the image, and sent to the first a control module;

S2. After receiving the optical identification code, the first control module reads the play information corresponding to the optical identification code from the first storage module.

S3, modulating the playing information, and sending the information to the intelligent processing terminal through the first wireless communication module;

S4. After receiving the modulated play information, the second wireless communication module demodulates the broadcast information and sends the information to the second control module.

S5. The second control module reads the corresponding play data from the second storage module according to the demodulated play information, and sends the play data to the audio decoding module for audio decoding, and then plays the play data simultaneously. Synchronous playback after video decoding by the video decoding module.
The image point reading and playing method according to claim 7, wherein the step S1 comprises:

S11. After the image printed with the optical identification code is amplified by the lens of the optical identification module, the optical image of the image is collected by using an optical sensor, and converted into a digital signal by the analog-to-digital conversion module;

S12, using an image processing module to perform gray scale conversion, histogram equalization, denoising, sharpening, and edge pre-processing on the digital signal converted by the optical image;

S13. Perform binarization processing on the preprocessed signal according to a single threshold segmentation algorithm to obtain a binarized image;

S14. Perform shape detection on the obtained binarized image by using Hough transform, and perform screening, and select multiple candidate positioning patterns according to the shape factor;

S15. Decode the selected candidate positioning graphics into data information, and then obtain an optical identification code, and send the optical identification code to the first control module.
The image dot reading and playing method according to claim 7, wherein the step S1 further comprises the steps of:

S0, the point reading pen generates a synchronization code through the first control module, modulates and transmits to the intelligent processing terminal through the first wireless communication module, and the intelligent processing terminal receives the synchronization code through the second wireless communication module, performs demodulation and performs pairing The code, if the code is successful, establishes a connection with the point pen, and then performs step S1.
The image point reading and playing method according to claim 7, wherein the step S5 further comprises the following steps:

S6. The input information of the detection button module and/or the optical identification code component is read, the corresponding control information is read from the first storage module according to the input information, and the control information is modulated and sent to the intelligent processing terminal;

After receiving the modulated control information, the second wireless communication module demodulates and transmits the control information to the second control module, and the second control module controls the playback of the audio and video according to the demodulated control information.