CN108762507B - Image tracking method and device - Google Patents
Image tracking method and device Download PDFInfo
- Publication number
- CN108762507B CN108762507B CN201810542151.8A CN201810542151A CN108762507B CN 108762507 B CN108762507 B CN 108762507B CN 201810542151 A CN201810542151 A CN 201810542151A CN 108762507 B CN108762507 B CN 108762507B
- Authority
- CN
- China
- Prior art keywords
- image
- eyeball
- reader
- book content
- radio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/04—Electrically-operated educational appliances with audible presentation of the material to be studied
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides an image tracking method and device. The method comprises the following steps: the intelligent bracelet detects radio frequency signals of a radio frequency chip on a current page of the intelligent book in real time and sends the radio frequency signals to the voice broadcast terminal; the image tracker tracks and shoots eyeball images of readers in real time and sends the eyeball images to the voice broadcast terminal; the voice broadcast terminal acquires the book content being read by the reader based on the radio frequency signal and the eyeball image, and carries out voice broadcast on the book content being read according to preset rules. Therefore, the image tracking method and the image tracking device are convenient to use, can automatically analyze the book content being read by the child without any operation, and can automatically broadcast the book content by voice, so that the learning effect is greatly improved, the interestingness is high, and the preschool elementary education is facilitated.
Description
Technical Field
The invention relates to the field of image tracking, in particular to an image tracking method and device.
Background
At present, with the increasing development of various books and reading materials, especially the urgent need of children education, the technical requirements for various books are higher and higher. In the known art, existing books, including children's reading, are mainly bound after printing text or/and drawings on paper. Reading is needed, books are turned over, but to teenagers or children who need to read characters with pictures, people are more needed to help reading, most of the current products are reading pens or automatic full-text broadcasting, but the operation of the reading pens is troublesome, the pertinence of automatic full-text broadcasting is poor, the focus of attention of children cannot be known, learning is boring, the effect is poor, and the use is inconvenient.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention aims to provide an image tracking method and device, which are convenient to use, can automatically analyze the book content being read by a child without any operation, and automatically broadcast the book content by voice, greatly improve the learning effect, have strong interest and are beneficial to preschool elementary education.
In order to achieve the above purpose, the embodiment of the present invention adopts the following technical solutions:
in a first aspect, an embodiment of the present invention provides an image tracking method applied to an image tracking system, where the image tracking system includes an intelligent bracelet, an image tracker, an intelligent book, and a voice broadcast terminal in communication connection with the intelligent bracelet and the image tracker, where the image tracker is disposed in a monitoring area of the intelligent book, a radio frequency chip is disposed on each page of the intelligent book, and the intelligent bracelet performs signal interaction with the radio frequency chip, and the method includes:
the intelligent bracelet detects radio frequency signals of a radio frequency chip on the current page of the intelligent book in real time and sends the radio frequency signals to the voice broadcast terminal;
the image tracker tracks and shoots eyeball images of readers in real time and sends the eyeball images to the voice broadcast terminal;
the voice broadcast terminal acquires the book content being read by the reader based on the radio frequency signal and the eyeball image, and carries out voice broadcast on the book content being read according to preset rules.
Optionally, the voice broadcast terminal stores therein a book page identifier of each page of the smart book and corresponding book content, and the voice broadcast terminal acquires the book content being read by the reader based on the radio frequency signal and the eyeball image, and performs voice broadcast on the book content being read according to preset rules, including:
the voice broadcasting terminal analyzes the radio frequency signal to obtain a book page identification corresponding to the radio frequency signal;
searching the book content of the current page of the intelligent book based on the book page identification, and carrying out image analysis on the eyeball image in real time to obtain the eyeball watching position of the reader;
and extracting the book content which is being read by the reader from the current page according to the eyeball watching position, and carrying out voice broadcast on the book content which is being read according to a preset rule.
Optionally, the step of performing image analysis on the eyeball image in real time to obtain the eyeball gaze position of the reader includes:
and carrying out real-time coordinate position of the eyeball pupil of the reader on the current page in the eyeball image so as to obtain the eyeball watching position of the reader.
Optionally, the step of extracting, in the current page, the book content that the reader is reading according to the eyeball gaze position includes:
taking the eyeball fixation position as a center of a circle or a center, and combining a preset eyeball observation radius or eyeball observation line number and eyeball observation word number to obtain a reading area;
and analyzing the book content corresponding to the reading area from the current page as the book content being read by the reader.
Optionally, the step of performing voice broadcast on the book content being read according to a preset rule includes:
analyzing a content type of the book content being read;
and performing voice broadcast on the book content being read according to the voice broadcast mode corresponding to the content type.
Optionally, after the step of obtaining, by the voice broadcast terminal, the book content being read by the reader based on the radio frequency signal and the eyeball image, and performing voice broadcast on the book content being read according to a preset rule, the method further includes:
the intelligent bracelet acquires the motion information of a reader in real time and sends the motion information to the voice broadcasting terminal;
the voice broadcasting terminal judges whether the reader is in an active state or not according to the motion information;
and stopping broadcasting the book content when the reader is judged to be in the active state.
Optionally, after the step of obtaining, by the voice broadcast terminal, the book content being read by the reader based on the radio frequency signal and the eyeball image, and performing voice broadcast on the book content being read according to a preset rule, the method further includes:
the intelligent bracelet acquires the voice information of the reader in real time and sends the voice information to the voice broadcasting terminal;
the voice broadcasting terminal judges whether the reader is in a conversation state according to the voice information;
and stopping broadcasting the book content when the reader is judged to be in the talking state.
Optionally, after the step of obtaining, by the voice broadcast terminal, the book content being read by the reader based on the radio frequency signal and the eyeball image, and performing voice broadcast on the book content being read according to a preset rule, the method further includes:
the intelligent bracelet acquires the voice information of the reader in real time and sends the voice information to the voice broadcasting terminal;
and the voice broadcast terminal generates corresponding interactive voice according to the voice information of the reader and the book content being read, and carries out voice broadcast on the interactive voice.
In a second aspect, an embodiment of the present invention further provides an image tracking method, which is applied to a voice broadcast terminal, where the voice broadcast terminal is in communication connection with an intelligent bracelet and an image tracker, where the image tracker is disposed in a monitoring area of an intelligent book, and the intelligent bracelet performs signal interaction with a radio frequency chip disposed on each page of the intelligent book, and the method includes:
receiving radio frequency signals of a radio frequency chip on a current page of the intelligent book, which are detected by the intelligent bracelet in real time;
receiving eyeball images of readers, which are tracked and shot by the image tracker in real time;
and acquiring the book content being read by the reader based on the radio frequency signal and the eyeball image, and carrying out voice broadcast on the book content being read according to a preset rule.
In a third aspect, an embodiment of the present invention further provides an image tracking apparatus, which is applied to a voice broadcast terminal. Voice broadcast terminal and intelligent bracelet, image tracker communication connection, wherein, image tracker sets up in the monitoring area of intelligent books, the intelligent bracelet with the radio frequency chip that sets up on every page in the intelligent books carries out the signal interaction, the device includes:
the first receiving module is used for receiving the radio-frequency signal of the radio-frequency chip on the current page of the intelligent book, which is detected by the intelligent bracelet in real time;
the second receiving module is used for receiving eyeball images of the reader, which are tracked and shot by the image tracker in real time;
and the voice broadcasting module is used for acquiring the book content being read by the reader based on the radio frequency signal and the eyeball image and carrying out voice broadcasting on the book content being read according to a preset rule.
Compared with the prior art, the invention has the following beneficial effects:
according to the image tracking method and device provided by the embodiment of the invention, the radio frequency signal of the radio frequency chip on the current page of the intelligent book is detected in real time through the intelligent bracelet, the radio frequency signal is sent to the voice broadcast terminal, and meanwhile, the eyeball image of a reader is tracked and shot in real time through the image tracker and sent to the voice broadcast terminal. The voice broadcast terminal acquires the book content being read by the reader based on the radio frequency signal and the eyeball image, and carries out voice broadcast on the book content being read according to preset rules. Therefore, the image tracking method and the image tracking device are convenient to use, can automatically analyze the book content being read by the child without any operation, and can automatically broadcast the book content by voice, so that the learning effect is greatly improved, the interestingness is high, and the preschool elementary education is facilitated.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is an interactive schematic diagram of an image tracking system according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of an image tracking method according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of an image tracking method according to an embodiment of the present invention;
fig. 4 is a schematic block diagram of a voice broadcast terminal for implementing the image tracking method according to an embodiment of the present invention.
Icon: 10-an image tracking system; 100-smart bracelet; 200-an image tracker; 300-a voice broadcast terminal; 310-a memory; 320-a processor; 330-image tracking means; 331-a first receiving module; 332-a second receiving module; 333-voice broadcast module; 400-smart book; 450-radio frequency chip.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
Referring to fig. 1, which is an interaction schematic diagram of an image tracking system 10 according to an embodiment of the present invention, the image tracking system 10 may include an intelligent bracelet 100, an image tracker 200, an intelligent book 400, and a voice broadcast terminal 300 communicatively connected to the intelligent bracelet 100 and the image tracker 200. Wherein, the image tracker 200 sets up in the monitoring area of smart book 400, be provided with radio frequency chip 450 on every page in the smart book 400, smart bracelet 100 with radio frequency chip 450 carries out signal interaction.
In the embodiment of the present invention, the smart bracelet 100 may be a smart bracelet 100 with watchbands on two sides to realize fixation. Can be provided with microphone module, acceleration sensor and radio frequency detection module in the intelligence bracelet 100, radio frequency detection module can be used for detecting the radio frequency signal that radio frequency chip 450 sent, the microphone can be used for acquireing the speech information that the reader sent, acceleration sensor can be used for acquireing the motion information of reader. Of course, the above is only an example, and in further embodiments, the smart band 100 may further include more module components.
Referring to fig. 2, a flowchart of an image tracking method according to an embodiment of the present invention is shown, where the method is executed by the image tracking system 10 shown in fig. 1. It should be noted that the image tracking method provided by the embodiment of the present invention is not limited by the specific sequence described in fig. 2 and below. The method comprises the following specific steps:
step S110, the smart band 100 detects the radio frequency signal of the radio frequency chip 450 on the current page of the smart book 400 in real time, and sends the radio frequency signal to the voice broadcast terminal 300.
In the embodiment of the present invention, the rf chip 450 may be configured to transmit a corresponding rf signal, and the rf signal transmitted by the rf chip 450 on each page of the smart book 400 may be used to represent the identifier of the page, i.e. the page number.
In this embodiment, when the reader (children) opens when the smart book 400 goes up, because the smart book 400 generally turns left from the right, in an implementation mode, the pages on the left of the smart book 400 are all provided with the radio frequency chip 450, and this smart bracelet 100 is worn on the left hand of the reader, from this, the smart bracelet 100 only needs to survey the radio frequency signal of the radio frequency chip 450 on the current page of the smart book 400 in real time, and will the radio frequency signal sends for the voice broadcast terminal 300, and follow-up alright judge the page number that the current smart book 400 turned over.
In step S120, the image tracker 200 tracks and shoots an eyeball image of the reader in real time, and sends the eyeball image to the voice broadcast terminal 300.
In the embodiment of the present invention, the image tracker 200 may be configured to track the movement of the eyeball of the reader, so as to capture the eyeball image. In one embodiment, the image tracker 200 may include an infrared light source and an eye tracking camera, and may be used to capture eye image information of the reader to obtain eye movements of the user, such as movement, gaze, rotation, pupil enlargement, and the like. The eyeball tracking camera is an infrared camera and can be a visible light source camera capable of sensing infrared wavelength. The infrared light source may be one or more infrared light emitting diodes or infrared laser diodes for illuminating the user's eye to facilitate capturing the pupil location of the user's eye.
In step S130, the voice broadcast terminal 300 obtains the book content being read by the reader based on the radio frequency signal and the eyeball image, and performs voice broadcast on the book content being read according to a preset rule.
As an implementation manner, the voice broadcast terminal 300 may perform signal analysis on the radio frequency signal to obtain a book page identifier corresponding to the radio frequency signal, then search the book content of the current page of the smart book 400 based on the book page identifier, perform image analysis on the eyeball image in real time, and obtain the eyeball gaze position of the reader. And then, extracting the book content which is being read by the reader from the current page according to the eyeball watching position, and carrying out voice broadcast on the book content which is being read according to a preset rule.
Optionally, the voice broadcast terminal 300 may perform real-time coordinate positioning of an eyeball pupil of the reader on the current page in the eyeball image, so as to obtain an eyeball fixation position of the reader. Then, with the eyeball fixation position as a center of circle or a center, a reading area is obtained by combining a preset eyeball observation radius (e.g., 3cm) or an eyeball observation line number (e.g., 3 lines) and an eyeball observation word number (e.g., 20 words), and the book content corresponding to the reading area is analyzed from the current page as the book content being read by the reader. The preset eyeball observation radius or the eyeball observation line number and the eyeball observation word number can be preset according to actual requirements, and are not limited herein.
Then, the voice broadcast terminal 300 analyzes the content type of the book content being read before the voice broadcast is prepared, and then performs voice broadcast on the book content being read according to the voice broadcast mode corresponding to the content type. For example, if the content type of the book content being read is a text type, the corresponding text type may be directly broadcasted by voice. For another example, if the book content being read is a single image, the information to be expressed by the image can be broadcasted in voice.
Therefore, the image tracking method provided by the embodiment can automatically analyze the book content being read by the child without any operation, and automatically broadcast the book content by voice, so that the learning effect is greatly improved, the interestingness is high, and the preschool elementary education is facilitated.
Optionally, in the voice broadcasting process, the smart band 100 may further obtain the motion information of the reader in real time, for example, the motion information of the reader may be obtained through an acceleration sensor, and the motion information is sent to the voice broadcasting terminal 300. The voice broadcast terminal 300 judges whether the reader is in an active state according to the motion information, and stops broadcasting the book content when judging that the reader is in the active state. Therefore, the reader can be prevented from missing the reading study when doing other things.
Optionally, in the voice broadcasting process, the smart band 100 may further obtain the voice information of the reader in real time, for example, the voice information of the reader may be obtained through a microphone module, and the voice information is sent to the voice broadcasting terminal 300. The voice broadcast terminal 300 judges whether the reader is in a conversation state according to the voice information, and stops broadcasting the book content when judging that the reader is in the conversation state. Therefore, the situation that the reader misses the reading and learning during the conversation can be avoided.
Optionally, in the voice broadcasting process, the reader may further interact with the book content, and in detail, the smart band 100 may further obtain the voice information of the reader in real time and send the voice information to the voice broadcasting terminal 300. The voice broadcast terminal 300 generates corresponding interactive voice according to the voice information of the reader and the book content being read, and performs voice broadcast on the interactive voice. For example, if the book content being read is "bright moon before window, suspected frosting on the ground", and the voice message of the reader is "what is the meaning of this sentence? "then the interactive voice may be" meaning that the moon is bright and shines through a window on the ground, giving the person the idea of being frost ". Therefore, the reader can conveniently interact with the book content in the learning process, the learning effect is further improved, the interestingness is high, and preschool elementary education is facilitated.
Further, referring to fig. 3, an embodiment of the present invention further provides an image tracking method, which is different from the above embodiment, the image tracking method is executed by the voice broadcast terminal 300, it can be understood that steps involved in the image tracking method to be described next have been described in the above embodiment, specific details of each step can be described with reference to the above embodiment, and only the steps executed by the voice broadcast terminal 300 will be briefly described below.
Step S210, receiving the radio frequency signal of the radio frequency chip 450 on the current page of the smart book 400 detected by the smart band 100 in real time.
Step S220, receiving an eyeball image of the reader captured by the image tracker 200 in real time.
And step S230, acquiring the book content being read by the reader based on the radio frequency signal and the eyeball image, and carrying out voice broadcast on the book content being read according to a preset rule.
Further, please refer to fig. 4, which is a schematic diagram of a voice broadcast terminal 300 for implementing the image tracking method according to an embodiment of the present invention. In this embodiment, the voice broadcast terminal 300 includes an image tracking device 330, a memory 310, and a processor 320. In the embodiment of the present invention, the image tracking apparatus 330 includes at least one software functional module which can be stored in the memory 310 in the form of software or Firmware (Firmware) or is fixed in an Operating System (OS) of the voice broadcast terminal 300. The processor 320 is used to execute executable software modules stored in the memory 310, such as software functional modules and computer programs included in the image tracking device 330. In this embodiment, the image tracking apparatus 330 may also be integrated into the operating system as a part of the operating system. Specifically, the image tracking apparatus 330 may include:
the first receiving module 331 is configured to receive the radio frequency signal of the radio frequency chip 450 on the current page of the smart book 400, which is detected by the smart band 100 in real time.
A second receiving module 332, configured to receive an eyeball image of the reader that is captured by the image tracker 200 in real time.
The voice broadcasting module 333 is configured to obtain the book content being read by the reader based on the radio frequency signal and the eyeball image, and perform voice broadcasting on the book content being read according to a preset rule.
Further, corresponding to the image tracking method in fig. 3, an embodiment of the present invention further provides a readable storage medium, on which a computer program is stored, and the computer program is executed by the processor 320 to perform the steps of the image tracking method.
Specifically, the readable storage medium can be a general storage medium, such as a mobile disk, a hard disk, and the like, and when a computer program on the storage medium is executed, the image tracking method can be executed, so that the problems of boring learning, poor effect and inconvenience in use of children at present are solved, the learning effect can be greatly improved, the interestingness is high, and the preschool enlightenment education is facilitated.
In summary, according to the image tracking method and apparatus provided by the embodiments of the present invention, the radio frequency signal of the radio frequency chip on the current page of the smart book is detected in real time by the smart bracelet, and the radio frequency signal is sent to the voice broadcast terminal, and meanwhile, the eyeball image of the reader is tracked and shot in real time by the image tracker, and the eyeball image is sent to the voice broadcast terminal. The voice broadcast terminal acquires the book content being read by the reader based on the radio frequency signal and the eyeball image, and carries out voice broadcast on the book content being read according to preset rules. Therefore, the image tracking method and the image tracking device are convenient to use, can automatically analyze the book content being read by the child without any operation, and can automatically broadcast the book content by voice, so that the learning effect is greatly improved, the interestingness is high, and the preschool elementary education is facilitated.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus and method embodiments described above are illustrative only, as the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
Alternatively, all or part of the implementation may be in software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (10)
1. The utility model provides an image tracking method, its characterized in that is applied to image tracking system, image tracking system include intelligent bracelet, image tracker, intelligent books and with intelligent bracelet with image tracker communication connection's voice broadcast terminal, wherein, image tracker sets up in the monitoring area of intelligent books, be provided with the radio frequency chip on every page in the intelligent books, intelligent bracelet with the radio frequency chip carries out signal interaction, the method includes:
the intelligent bracelet detects radio frequency signals of a radio frequency chip on the current page of the intelligent book in real time and sends the radio frequency signals to the voice broadcast terminal;
the image tracker tracks and shoots eyeball images of readers in real time and sends the eyeball images to the voice broadcast terminal;
the voice broadcast terminal acquires the book content being read by the reader based on the radio frequency signal and the eyeball image, and carries out voice broadcast on the book content being read according to preset rules.
2. The image tracking method according to claim 1, wherein a book page identifier of each page of the smart book and a corresponding book content are stored in the voice broadcast terminal, and the step of obtaining the book content being read by the reader based on the radio frequency signal and the tracked eyeball image and performing voice broadcast on the book content being read according to a preset rule by the voice broadcast terminal comprises the steps of:
the voice broadcasting terminal analyzes the radio frequency signal to obtain a book page identification corresponding to the radio frequency signal;
searching the book content of the current page of the intelligent book based on the book page identification, and carrying out image analysis on the eyeball image in real time to obtain the eyeball watching position of the reader;
and extracting the book content which is being read by the reader from the current page according to the eyeball watching position, and carrying out voice broadcast on the book content which is being read according to a preset rule.
3. The image tracking method according to claim 2, wherein the step of performing image analysis on the eyeball image in real time to obtain the eyeball gaze position of the reader comprises:
and carrying out real-time coordinate position of the eyeball pupil of the reader on the current page in the eyeball image so as to obtain the eyeball watching position of the reader.
4. The image tracking method according to claim 2, wherein the step of extracting the book contents being read by the reader in the current page according to the eyeball gaze position comprises:
taking the eyeball fixation position as a center of a circle or a center, and combining a preset eyeball observation radius or eyeball observation line number and eyeball observation word number to obtain a reading area;
and analyzing the book content corresponding to the reading area from the current page as the book content being read by the reader.
5. The image tracking method according to claim 2, wherein the step of voice broadcasting the book contents being read according to a preset rule comprises:
analyzing a content type of the book content being read;
and performing voice broadcast on the book content being read according to the voice broadcast mode corresponding to the content type.
6. The image tracking method according to claim 1, wherein after the step of obtaining, by the voice broadcast terminal, the book content being read by the reader based on the radio frequency signal and the eyeball image, and performing voice broadcast on the book content being read according to a preset rule, the method further comprises:
the intelligent bracelet acquires the motion information of a reader in real time and sends the motion information to the voice broadcasting terminal;
the voice broadcasting terminal judges whether the reader is in an active state or not according to the motion information;
and stopping broadcasting the book content when the reader is judged to be in the active state.
7. The image tracking method according to claim 1, wherein after the step of obtaining, by the voice broadcast terminal, the book content being read by the reader based on the radio frequency signal and the eyeball image, and performing voice broadcast on the book content being read according to a preset rule, the method further comprises:
the intelligent bracelet acquires the voice information of the reader in real time and sends the voice information to the voice broadcasting terminal;
the voice broadcasting terminal judges whether the reader is in a conversation state according to the voice information;
and stopping broadcasting the book content when the reader is judged to be in the talking state.
8. The image tracking method according to claim 1, wherein after the step of obtaining, by the voice broadcast terminal, the book content being read by the reader based on the radio frequency signal and the eyeball image, and performing voice broadcast on the book content being read according to a preset rule, the method further comprises:
the intelligent bracelet acquires the voice information of the reader in real time and sends the voice information to the voice broadcasting terminal;
and the voice broadcast terminal generates corresponding interactive voice according to the voice information of the reader and the book content being read, and carries out voice broadcast on the interactive voice.
9. The utility model provides an image tracking method, its characterized in that is applied to the voice broadcast terminal, voice broadcast terminal and intelligent bracelet, image tracker communication connection, wherein, the image tracker sets up in the monitoring area of intelligent books, the intelligent bracelet with the radio frequency chip that sets up on every page in the intelligent books carries out signal interaction, the method includes:
receiving radio frequency signals of a radio frequency chip on a current page of the intelligent book, which are detected by the intelligent bracelet in real time;
receiving eyeball images of readers, which are tracked and shot by the image tracker in real time;
and acquiring the book content being read by the reader based on the radio frequency signal and the eyeball image, and carrying out voice broadcast on the book content being read according to a preset rule.
10. The utility model provides an image tracking device, its characterized in that is applied to the voice broadcast terminal, voice broadcast terminal and intelligent bracelet, image tracker communication connection, wherein, image tracker sets up in the monitoring area of intelligent books, the intelligent bracelet with the radio frequency chip that sets up on every page in the intelligent books carries out signal interaction, the device includes:
the first receiving module is used for receiving the radio-frequency signal of the radio-frequency chip on the current page of the intelligent book, which is detected by the intelligent bracelet in real time;
the second receiving module is used for receiving eyeball images of the reader, which are tracked and shot by the image tracker in real time;
and the voice broadcasting module is used for acquiring the book content being read by the reader based on the radio frequency signal and the eyeball image and carrying out voice broadcasting on the book content being read according to a preset rule.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810542151.8A CN108762507B (en) | 2018-05-30 | 2018-05-30 | Image tracking method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810542151.8A CN108762507B (en) | 2018-05-30 | 2018-05-30 | Image tracking method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108762507A CN108762507A (en) | 2018-11-06 |
| CN108762507B true CN108762507B (en) | 2021-05-04 |
Family
ID=64004384
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810542151.8A Active CN108762507B (en) | 2018-05-30 | 2018-05-30 | Image tracking method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108762507B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109982041A (en) * | 2019-03-29 | 2019-07-05 | 辽东学院 | A kind of image procossing tracking system and its image tracking method |
| CN111081090B (en) * | 2019-06-09 | 2022-05-03 | 广东小天才科技有限公司 | Information output method and learning device in point-to-read scene |
| CN110579879B (en) * | 2019-09-17 | 2021-11-02 | 中国第一汽车股份有限公司 | Vehicle-mounted head-up display system and control method thereof |
| CN110673729A (en) * | 2019-09-24 | 2020-01-10 | 广东以诺通讯有限公司 | Point reading method and system based on terminal and storage medium |
| CN111158507B (en) * | 2019-10-18 | 2024-03-19 | 广东小天才科技有限公司 | Specified content determining method and electronic equipment |
| CN111062242A (en) * | 2019-10-27 | 2020-04-24 | 魏嘉臻 | Interactive information prompting method and system |
| CN111176439A (en) * | 2019-11-19 | 2020-05-19 | 广东小天才科技有限公司 | Reading control method based on visual tracking, intelligent glasses and system |
| CN113126762B (en) * | 2021-04-21 | 2022-08-16 | 惠东县人民医院 | Medical data checking device and method for monitoring medical behaviors |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203773763U (en) * | 2013-01-25 | 2014-08-13 | 陈旭 | Book reader |
| CN104318934A (en) * | 2014-09-11 | 2015-01-28 | 小米科技有限责任公司 | Method, terminal, wearable device and play device for closing multimedia file |
| CN106778608A (en) * | 2010-07-06 | 2017-05-31 | 星火有限公司 | Method and system for lifting reading experience |
| CN107728770A (en) * | 2017-09-26 | 2018-02-23 | 努比亚技术有限公司 | Screen luminance of terminal method of adjustment, mobile terminal and computer-readable recording medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9417692B2 (en) * | 2012-06-29 | 2016-08-16 | Microsoft Technology Licensing, Llc | Deep augmented reality tags for mixed reality |
-
2018
- 2018-05-30 CN CN201810542151.8A patent/CN108762507B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106778608A (en) * | 2010-07-06 | 2017-05-31 | 星火有限公司 | Method and system for lifting reading experience |
| CN203773763U (en) * | 2013-01-25 | 2014-08-13 | 陈旭 | Book reader |
| CN104318934A (en) * | 2014-09-11 | 2015-01-28 | 小米科技有限责任公司 | Method, terminal, wearable device and play device for closing multimedia file |
| CN107728770A (en) * | 2017-09-26 | 2018-02-23 | 努比亚技术有限公司 | Screen luminance of terminal method of adjustment, mobile terminal and computer-readable recording medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108762507A (en) | 2018-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108762507B (en) | Image tracking method and device | |
| US20230063920A1 (en) | Content navigation with automated curation | |
| US20180314390A1 (en) | User Interface, Method and System for Crowdsourcing Event Notification Sharing Using Mobile Devices | |
| US9519924B2 (en) | Method for collective network of augmented reality users | |
| US8611601B2 (en) | Dynamically indentifying individuals from a captured image | |
| US11520824B2 (en) | Method for displaying information, electronic device and system | |
| CN110020009B (en) | Online question and answer method, device and system | |
| KR101832693B1 (en) | Intuitive computing methods and systems | |
| US20120230548A1 (en) | Vehicle recognition | |
| KR20180017606A (en) | Method for providing parking location information of a vehicle and electronic device thereof | |
| KR101626874B1 (en) | Mobile terminal and method for transmitting contents thereof | |
| CN105814587A (en) | Local real-time facial recognition | |
| JP2017509090A (en) | Image classification method and apparatus | |
| CN110929176A (en) | Information recommendation method and device and electronic equipment | |
| CN112291614A (en) | Video generation method and device | |
| CN111739535A (en) | Voice recognition method and device and electronic equipment | |
| CN111639158B (en) | Learning content display method and electronic equipment | |
| KR20170098113A (en) | Method for creating image group of electronic device and electronic device thereof | |
| CN108241678B (en) | Method and device for mining point of interest data | |
| CN113761986A (en) | Text acquisition method, text live broadcast equipment and storage medium | |
| US10943117B2 (en) | Translation to braille | |
| CN112309389A (en) | Information interaction method and device | |
| CN111444813A (en) | Method, device, equipment and storage medium for identifying attribute classification of target object | |
| CN112004033B (en) | Video cover determining method and device and storage medium | |
| CN113220258B (en) | Voice message previewing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |