CN102736886A - Vision assistant system - Google Patents

Vision assistant system Download PDF

Info

Publication number
CN102736886A
CN102736886A CN2011100909330A CN201110090933A CN102736886A CN 102736886 A CN102736886 A CN 102736886A CN 2011100909330 A CN2011100909330 A CN 2011100909330A CN 201110090933 A CN201110090933 A CN 201110090933A CN 102736886 A CN102736886 A CN 102736886A
Authority
CN
China
Prior art keywords
module
information
bright
vision
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011100909330A
Other languages
Chinese (zh)
Inventor
吴冠廷
陈勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DEXIN INTERACTION TECHNOLOGY (BEIJING) Co Ltd
Original Assignee
DEXIN INTERACTION TECHNOLOGY (BEIJING) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DEXIN INTERACTION TECHNOLOGY (BEIJING) Co Ltd filed Critical DEXIN INTERACTION TECHNOLOGY (BEIJING) Co Ltd
Priority to CN2011100909330A priority Critical patent/CN102736886A/en
Publication of CN102736886A publication Critical patent/CN102736886A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a vision assistant system comprising a predefining module, a monitoring module and a reading module, wherein the predefining module is used for defining the position information of a user attention region on a display screen; the monitoring module is used for monitoring whether the system receives a reading command; and the reading module is used for reading the character contents in the region corresponding to the information in an image currently displayed on the display screen according to the position information stored in the predefining module when the monitoring module monitors the situation that the system receives the reading command. The technical scheme provided by the invention can enable a user to conveniently obtain the character contents of the user attention region in the image currently displayed on the display screen, so that the vision assistant system is very practical.

Description

Vision-aided system
Technical field
The present invention relates to a kind of vision technique, particularly relate to a kind of vision-aided system.
Background technology
Electronic equipment such as computing machine and game machine is provided with display screen, can demonstrate pictures such as recreation, webpage and text through display screen.
The inventor finds in realizing process of the present invention: when far away and display screen was big inadequately apart from the position of display screen, may there be a little problems in the content of some in the picture displayed on the display screen if want to see clearly the user; For example; When the game player plays somatic sensation television game; The game player understands one meter of distance display screen or farther distance usually, if display screen below 20 cun, then game player's Word message of wanting to see clearly in the game picture that shows on the display screen tends to exist certain difficulty.
Because the defective that above-mentioned existing display mode exists; The inventor is based on being engaged in this type of product design manufacturing abundant for many years practical experience and professional knowledge; And cooperate the utilization of studying the science, actively study innovation, in the hope of founding a kind of vision-aided system of new structure; Can overcome the problem that existing display mode exists, make it have more practicality.Through constantly research, design, and, found out the present invention of true tool practical value finally through after studying sample and improvement repeatedly.
Summary of the invention
The objective of the invention is to; Overcome the defective that existing display mode exists; And a kind of vision-aided system of new structure is provided; Technical matters to be solved is, makes the user can know the word content in the user's region-of-interest in the current institute of the display screen images displayed easily, is very suitable for practicality.
The object of the invention and solve its technical matters and can adopt following technical scheme to realize.
According to a kind of vision-aided system that the present invention proposes, said system comprises: the predefine module is used to define the positional information of user's region-of-interest on the display screen; Monitoring module is used for monitoring said system and whether receives bright reading instruction; Bright read through model when being used for receiving bright reading instruction in the said monitoring module system of monitoring, is read aloud the word content in this positional information corresponding region in the current images displayed of display screen according to the positional information of storing in the said predefine module.
The object of the invention and solve its technical matters and can also adopt following technical measures to come further to realize.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: interface module is used to receive the key information that external transmission is come; First memory module is used to store the predefined said bright corresponding key information that reads instruction; First comparison module is used for the key information that the key information and first memory module of said interface module reception are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, said monitoring module comprises: the sound acquisition module is used to pick up sound, and exports the sound signal of this sound; Second memory module is used to store the predefined bright corresponding text formatting information that reads instruction; Sound identification module is used for converting said sound signal into text formatting information; Second comparison module is used for the text formatting information and the said second memory module stored text format information of said sound identification module output are compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: interface module is used to receive the sound signal that external transmission is come; Second memory module is used to store the predefined bright corresponding text formatting information that reads instruction; Sound identification module is used for converting the sound signal that said interface module receives into text formatting information; Second comparison module is used for the text formatting information and the said second memory module stored text format information of said sound identification module output are compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, said monitoring module comprises: the sound acquisition module is used to pick up sound, and exports the sound signal of this sound; The 3rd memory module is used to store the predefined said bright corresponding audio signal that reads instruction; The 3rd comparison module is used for the sound signal that the sound signal and said the 3rd memory module of said sound acquisition module output are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: interface module is used to receive the sound signal that external transmission is come; The 3rd memory module is used to store the predefined said bright corresponding audio signal that reads instruction; The 3rd comparison module is used for the sound signal that the sound signal and the 3rd memory module of said interface module output are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: photographing module is used for pickup image; The 4th memory module is used to store the predefined bright corresponding motion images that reads instruction; First image processing module is used for from the image of the image intercepting control side of said photographing module picked-up; The 4th comparison module is used for the motion images that the image and the 4th memory module of the output of first image processing module are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: interface module is used to receive the image information that external transmission is come; The 4th memory module is used to store the predefined bright corresponding motion images that reads instruction; First image processing module is used for from the image of the image information intercepting control side that interface module receives; The 4th comparison module is used for the motion images that the first image processing module truncated picture and the 4th memory module are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: photographing module is used for pickup image; The 5th memory module is used to store the predefined bright corresponding framework information that reads instruction; Second image processing module is used for obtaining from the image of photographing module picked-up the framework information of control side; The 5th comparison module, the framework information that framework information that is used for second image processing module is obtained and the 5th memory module are stored compares, and when coupling, confirms that system receives bright reading instruction.
Preferable, aforesaid vision-aided system, wherein, monitoring module comprises: interface module is used to receive the image information that external transmission is come; The 5th memory module is used to store the predefined bright corresponding framework information that reads instruction; Second image processing module is used for obtaining from the image information that interface module receives the framework information of control side; The 5th comparison module, the framework information that framework information that is used for second image processing module is obtained and the 5th memory module are stored compares, and when coupling, confirms that system receives bright reading instruction.
By technique scheme; Vision-aided system of the present invention has advantage and beneficial effect at least: because bright read through model can be according to the monitoring of the definition of predefine module and monitoring module with bright the reading out of word content in the zone in the precalculated position in the current images displayed of display screen; Therefore; The user can be known the word content in the user's region-of-interest in the current institute images displayed on the display screen easily; Like the Word message in the game picture or the Word message in the chat record or the like, thereby improved the experience of user to electronic equipments such as computing machine and game machines.
In sum, the present invention has obvious improvement technically, has tangible good effect, really is the new design of a novelty, progress, practicality.
Above-mentioned explanation only is the general introduction of technical scheme of the present invention; Understand technological means of the present invention in order can more to know; And can implement according to the content of instructions, and for let of the present invention above-mentioned with other purposes, feature and advantage can be more obviously understandable, below special act preferred embodiment; And conjunction with figs., specify as follows.
Description of drawings
Fig. 1 is a vision-aided system synoptic diagram of the present invention;
Fig. 2 is the synoptic diagram of the positional information of definition user region-of-interest of the present invention.
Embodiment
Reach technological means and the effect that predetermined goal of the invention is taked for further setting forth the present invention; Below in conjunction with Fig. 1 and preferred embodiment; To embodiment, structure, characteristic and the effect thereof of each vision-aided system of proposing according to the present invention, specify as after.
Fig. 1 shows a kind of vision-aided system of the specific embodiment of the invention.This vision-aided system can be arranged at computing machine or game machine etc. to have in the electronic equipment of display screen, but this vision-aided system can show as the client of an isolated operation in computing machine or the game machine.
Vision-aided system shown in Fig. 1 can comprise: predefine module 10, monitoring module 20 and bright read through model 30.
Predefine module 10 is mainly used in the positional information of user's region-of-interest on the definition display screen.This positional information can be one or more position range value.This position range value as * OK * row one * OK * row.A position range value can be expressed the rectangle frame of a predefine size, the rectangle frame that dots out that is positioned at the display screen lower left corner shown in accompanying drawing 2, and this rectangle frame is user's region-of-interest.
Predefine module 10 performed positional information defining operations can be carried out before concrete application commencement of commercial operation, also can in the concrete operational process of using, carry out.Specifically use like Games Software, video software or chat software etc.Need to prove that the client that vision-aided system of the present invention showed as can be distinguished independent operating with concrete application, certainly, this client also can be embedded in certain concrete application.
Predefine module 10 is carried out a concrete example of defining operation: the Word message of certain online game is usually located at the position, lower right corner of display screen; Then the user can be before playing this online game; Move vision-aided system of the present invention; And be user's region-of-interest through predefine module 10 with display screen lower right corner location definition, predefine module 10 writes down the positional information of user's region-of-interest in the display screen lower right corner.The example that another is concrete: the Word message of certain online game is usually located at the position, lower right corner of display screen; The user did not move vision-aided system before playing this online game; Then the user can be in the process of playing this online game; Move vision-aided system of the present invention, and be user's region-of-interest through predefine module 10 with display screen lower right corner location definition, predefine module 10 writes down the positional information of user's region-of-interest in the display screen lower right corner.
Predefine module 10 can utilize default setting numerical value to define the positional information of the image of user's region-of-interest; A concrete example; Not starting predefine module 10 the user carries out under the situation of positional information definition; Predefine module 10 can user's region-of-interest positional information be set to default position information, and the positional information of storage after being provided with.The present invention does not limit the concrete implementation of predefine module 10 executing location information definitions operation.
Monitoring module 20 is mainly used in the monitoring vision-aided system and whether receives bright reading instruction.Monitor vision-aided system at monitoring module 20 and receive under the bright situation about reading instruction, the user's region-of-interest in the current display frame of display screen is activated.
Monitoring module 20 can be monitored vision-aided system based on push button signalling and whether received bright reading instruction; Monitoring module 20 also can be monitored vision-aided system based on sound signal and whether received bright reading instruction, and monitoring module 20 can also be monitored vision-aided system based on vision signal and whether received bright reading instruction.That is to say; Whether monitoring module 20 can receive bright reading instruction based on vision-aided system is monitored in the analysis of push button signalling; Whether monitoring module 20 also can receive bright reading instruction based on vision-aided system is monitored in the analysis of image, and whether monitoring module 30 can also receive bright reading instruction based on vision-aided system is monitored in the analysis of audio frequency.Monitoring module 20 can adopt existing monitoring technique to monitor vision-aided system and whether receive bright reading instruction.The present invention does not limit monitoring module 20 monitoring vision-aided systems and whether receives the bright concrete implementation that reads instruction.
Bright read through model 30 is mainly used at monitoring module 20 and monitors vision-aided system when receiving bright reading instruction, and reads aloud the Word message in the user's region-of-interest in the current images displayed according to the positional information of storage in the predefine module 10.
With the mode of giving an example nine kinds of monitoring module 20 different implementations are described one by one below.
Whether implementation one, receive under the bright situation about reading instruction based on push button signalling monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: interface module, first memory module and first comparison module.
Interface module is mainly used in and receives the key information that external transmission is come.Concrete, interface module can receive game paddle, serve as the mobile phone of game paddle or the key information that the transmission of other telechiric device comes.
Interface module in this implementation can be wave point or wireline interface.Wave point is as based on the wave point of bluetooth, or based on the wave point of 2.4GHz, or based on the wave point of WIFI, or based on infrared wave point etc.Wireline interface such as USB interface, or mini USB interface etc.
First memory module is mainly used in the predefined bright corresponding key information that reads instruction of storage.The bright corresponding key information that reads instruction can be provided with by the user.The bright corresponding key information that reads instruction can be the key information of a button or the key information of a plurality of buttons.Generally; The bright corresponding key information that reads instruction should be different with required all key informations that use in the concrete application of actual motion; For example; In certain online game, do not represent the order of any game control by button that makes progress and downward button simultaneously, then the key information of user's button that can make progress and downward button is set to the bright corresponding key information that reads instruction.
First comparison module is mainly used in the key information of storing in the key information that interface module is received and first memory module and compares; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction, otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation should be to mate fully, rather than fuzzy matching.
Whether implementation two, receive under the bright situation about reading instruction based on audio frequency monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: sound acquisition module, second memory module, sound identification module and second comparison module.
The sound acquisition module is mainly used in and picks up sound, and exports the sound signal that it picks up sound.This sound acquisition module can be specially elements such as microphone.
Second memory module is mainly used in the text formatting information of the predefined bright corresponding audio signal that reads instruction of storage; For example, can store the text formatting information an of phrase (like " reading aloud ") or a word (like " open sesame ") in second memory module.Can realize under the situation of acoustic control in concrete application; The text formatting information of required all acoustic controls orders that use was different during the text formatting information of the bright corresponding audio signal that reads instruction should be used with being somebody's turn to do of actual motion is concrete; For example; In certain recreation, " open sesame " do not represented any one game control signal, then can " open sesame " be set to the text formatting information of the bright corresponding audio signal that reads instruction.
The sound signal that sound identification module is mainly used in the output of sound acquisition module converts text formatting information into.Sound identification module can be carried out the denoising operation to the sound signal of sound acquisition module output before changing, certainly, the denoising operation also can be carried out by the sound acquisition module.Sound identification module can be given second comparison module with the text formatting information transmission after its conversion, and sound identification module also can be chosen keyword from the text formatting information after its conversion, and keyword is transferred to second comparison module.
The text formatting information that second comparison module is mainly used in the sound signal of storing in the text formatting information of sound identification module output and second memory module compares; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction; Otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation is preferably mated fully.
Whether implementation three, receive under the bright situation about reading instruction based on audio frequency monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: interface module, second memory module, sound identification module and second comparison module.
Interface module is mainly used in and receives the sound signal that external transmission is come.Concrete, interface module can receive game paddle, serve as the mobile phone of game paddle or the sound signal that the transmission of other telechiric device comes.
Interface module in this implementation can be wave point or wireline interface.Wave point is as based on the wave point of bluetooth, or based on the wave point of 2.4GHz, or based on the wave point of WIFI, or based on infrared wave point etc.Wireline interface such as USB interface, or mini USB interface etc.
Second memory module is mainly used in the text formatting information of the predefined bright corresponding audio signal that reads instruction of storage; For example, can store the text formatting information an of phrase (like " reading aloud ") or a word (like " open sesame ") in second memory module.Can realize under the situation of acoustic control in concrete application; The text formatting information of required all acoustic controls orders that use was different during the text formatting information of the bright corresponding audio signal that reads instruction should be used with being somebody's turn to do of actual motion is concrete; For example; In certain recreation, " open sesame " do not represented any one game control signal, then can " open sesame " be set to the text formatting information of the bright corresponding audio signal that reads instruction.
Sound identification module is mainly used in the sound signal that interface module is received and converts text formatting information into.Sound identification module can the docking port module before changing the sound signal of output carry out the denoising operation, certainly, the denoising operation also can be carried out by interface module.Sound identification module can be given second comparison module with the text formatting information transmission after its conversion, and sound identification module also can be chosen keyword from the text formatting information after its conversion, and keyword is transferred to second comparison module.
The text formatting information that second comparison module is mainly used in the sound signal of storing in the text formatting information of sound identification module output and second memory module compares; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction; Otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation is preferably mated fully.
Whether implementation four, receive under the bright situation about reading instruction based on audio frequency monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: sound acquisition module, the 3rd memory module and the 3rd comparison module.
The sound acquisition module is mainly used in and picks up sound, and exports the sound signal of the sound that picks up.This sound acquisition module can be specially elements such as microphone.
The 3rd memory module is mainly used in the predefined bright corresponding audio signal that reads instruction of storage, i.e. the content of the 3rd memory module storage is the information of audio format.For example, can store the information of the audio format an of phrase (like " reading aloud ") or a word (like " open sesame ") in the 3rd memory module.Can realize under the situation of acoustic control in concrete application; The information of the audio format of required all acoustic controls orders that use was different during the information of the bright corresponding audio form that reads instruction should be used with being somebody's turn to do of actual motion is concrete; As in certain online game; " open sesame " do not represented any one game control signal, then can " open sesame " be set to the information of the bright corresponding audio form that reads instruction.
The 3rd comparison module is mainly used in the sound signal of storing in the sound signal of sound acquisition module output and the 3rd memory module is compared; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction; Otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation can be fuzzy matching.
Whether implementation five, receive under the bright situation about reading instruction based on audio frequency monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: interface module, the 3rd memory module and the 3rd comparison module.
Interface module is mainly used in and receives the sound signal that external transmission is come, and is concrete, and interface module can receive game paddle, serve as the mobile phone of game paddle or the sound signal that the transmission of other telechiric device comes.
Interface module in this implementation can be wave point or wireline interface.Wave point is as based on the wave point of bluetooth, or based on the wave point of 2.4GHz, or based on the wave point of WIFI, or based on infrared wave point etc.Wireline interface such as USB interface, or mini USB interface etc.
The 3rd memory module is mainly used in the predefined bright corresponding audio signal that reads instruction of storage, i.e. the content of the 3rd memory module storage is the information of audio format.For example, can store the information of the audio format an of phrase (like " reading aloud ") or a word (like " open sesame ") in the 3rd memory module.Can realize under the situation of acoustic control in concrete application; The information of the audio format of required all acoustic controls orders that use was different during the information of the bright corresponding audio form that reads instruction should be used with being somebody's turn to do of actual motion is concrete; As in certain online game; " open sesame " do not represented any one game control signal, then can " open sesame " be set to the information of the bright corresponding audio form that reads instruction.
The 3rd comparison module is mainly used in the sound signal of storing in sound signal that interface module is received and the 3rd memory module and compares; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction, otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation can be fuzzy matching.
Whether implementation six, receive under the bright situation about reading instruction based on video monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: photographing module, the 4th memory module, first image processing module and the 4th comparison module.
Photographing module is mainly used in pickup image, and the image of output picked-up.This photographing module can be specially equipment such as camera or video camera; A concrete example, photographing module can comprise: at least one in RGB colour imagery shot and the 3D degree of depth inductor.The 3D degree of depth inductor here can specifically comprise: RF transmitter and infrared C MOS video camera etc., this 3D degree of depth inductor also can specifically comprise: generating laser and laser camera etc.This photographing module can integratedly be arranged in the electronic equipment at vision-aided system place.
The 4th memory module is mainly used in the predefined bright corresponding motion images that reads instruction of storage, i.e. the content of the 4th memory module storage is the information of picture format.Information like the picture format of waving to move that can store the user in the 4th memory module.Can realize in concrete application under the situation such as video control; The information of the bright corresponding picture format that reads instruction should be different with the information of the picture format of required all video control commands that use in the concrete application of actual motion; As in certain recreation; Any one game control signal is not represented in user's the action of waving, then can be with the user wave to move the information that is set to the bright corresponding picture format that reads instruction.
First image processing module is mainly used in the image of intercepting control side from the image of photographing module picked-up, and output.First image processing module can utilize the image of existing technology intercepting control side from the image of picked-up, and for example, first image processing module can adopt existing technology that the side of control is taken out from background image.
The information that the 4th comparison module is mainly used in image stored form in the image information of first image processing module output and the 4th memory module compares; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction; Otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation can be fuzzy matching.
Whether implementation seven, receive under the bright situation about reading instruction based on video monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: interface module, the 4th memory module, first image processing module and the 4th comparison module.
Interface module is mainly used in and receives the image information that external transmission is come, and is concrete, and interface module can receive the image information that external camera head transmission comes.
Interface module in this implementation can be wave point or wireline interface.Wave point is as based on the wave point of bluetooth, or based on the wave point of 2.4GHz, or based on the wave point of WIFI, or based on infrared wave point etc.Wireline interface such as USB interface, or mini USB interface etc.
The 4th memory module is mainly used in the predefined bright corresponding motion images that reads instruction of storage, i.e. the content of the 4th memory module storage is the information of picture format.Information like the picture format of waving to move that can store the user in the 4th memory module.Can realize in concrete application under the situation such as video control; The information of the bright corresponding picture format that reads instruction should be different with the information of the picture format of required all video control commands that use in the concrete application of actual motion; As in certain recreation; Any one game control signal is not represented in user's the action of waving, then can be with the user wave to move the information that is set to the bright corresponding picture format that reads instruction.
First image processing module is mainly used in the image of intercepting control side from the image that interface module receives, and output.First image processing module can utilize the image of existing technology intercepting control side from the image that interface module receives, and for example, first image processing module can adopt existing technology that the side of control is taken out from background image.
The information that the 4th comparison module is mainly used in image stored form in the image information of first image processing module output and the 4th memory module compares; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction; Otherwise, confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation can be fuzzy matching.
Whether implementation eight, receive under the bright situation about reading instruction based on video monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: photographing module, the 5th memory module, second image processing module and the 5th comparison module.
Photographing module is mainly used in pickup image, and the image of output picked-up.This photographing module can be specially equipment such as camera or video camera; A concrete example, photographing module can comprise: at least one in RGB colour imagery shot and the 3D degree of depth inductor.The 3D degree of depth inductor here can specifically comprise: RF transmitter and infrared C MOS video camera etc., this 3D degree of depth inductor also can specifically comprise: generating laser and laser camera etc.This photographing module can integratedly be arranged in the electronic equipment at vision-aided system place.
The 5th memory module is mainly used in the predefined bright corresponding framework information that reads instruction of storage, and this framework information can be the information of picture format, also can be the information of text formatting.Framework information like the picture format of waving to move that can store the user in the 5th memory module.
Second image processing module is mainly used in the framework information that from the image of photographing module picked-up, obtains control side, and output.Second image processing module can utilize the framework information of existing technology intercepting control side from the image of picked-up, and for example, second image processing module can adopt kine t technology to obtain the framework information of control side.
The 5th comparison module is mainly used in the framework information of storing in the framework information of second image processing module output and the 5th memory module is compared; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction, otherwise confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation can be fuzzy matching.
Whether implementation nine, receive under the bright situation about reading instruction based on video monitoring vision-aided system at monitoring module 20, monitoring module 20 comprises: interface module, the 5th memory module, second image processing module and the 5th comparison module.
Interface module is mainly used in and receives the image information that external transmission is come, and is concrete, and interface module can receive the image information that external camera head transmission comes.
Interface module in this implementation can be wave point or wireline interface.Wave point is as based on the wave point of bluetooth, or based on the wave point of 2.4GHz, or based on the wave point of WIFI, or based on infrared wave point etc.Wireline interface such as USB interface, or mini USB interface etc.
The 5th memory module is mainly used in the predefined bright corresponding framework information that reads instruction of storage, and this framework information can be the information of picture format, also can be the information of text formatting.Framework information like the picture format of waving to move that can store the user in the 5th memory module.
Second image processing module is mainly used in the framework information that from the image that interface module receives, obtains control side, and output.Second image processing module can utilize the framework information of existing technology intercepting control side from the image of picked-up, and for example, second image processing module can adopt the kinet technology to obtain the framework information of control side.
The 5th comparison module is mainly used in the framework information of storing in the framework information of second image processing module output and the 5th memory module is compared; When result relatively is coupling; Confirm that vision-aided system receives bright reading instruction, otherwise confirm that vision-aided system does not receive bright reading instruction.Coupling in this implementation can be fuzzy matching.
The above only is preferred embodiment of the present invention; Be not that the present invention is done any pro forma restriction; Though the present invention discloses as above with preferred embodiment, yet be not that any professional and technical personnel of being familiar with is not in breaking away from technical scheme scope of the present invention in order to qualification the present invention; When the technology contents of above-mentioned announcement capable of using is made a little change or is modified to the equivalent embodiment of equivalent variations; In every case be the content that does not break away from technical scheme of the present invention, to any simple modification, equivalent variations and modification that above embodiment did, all still belong in the scope of technical scheme of the present invention according to technical spirit of the present invention.

Claims (10)

1. a vision-aided system is characterized in that, said system comprises:
The predefine module is used to define the positional information of user's region-of-interest on the display screen;
Monitoring module is used for monitoring said system and whether receives bright reading instruction;
Bright read through model when being used for receiving bright reading instruction in the said monitoring module system of monitoring, is read aloud the word content in this positional information corresponding region in the current images displayed of display screen according to the positional information of storing in the said predefine module.
2. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Interface module is used to receive the key information that external transmission is come;
First memory module is used to store the predefined said bright corresponding key information that reads instruction;
First comparison module is used for the key information that the key information and first memory module of said interface module reception are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
3. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
The sound acquisition module is used to pick up sound, and exports the sound signal of this sound;
Second memory module is used to store the predefined bright corresponding text formatting information that reads instruction;
Sound identification module is used for converting said sound signal into text formatting information;
Second comparison module is used for the text formatting information and the said second memory module stored text format information of said sound identification module output are compared, and when coupling, confirms that said system receives bright reading instruction.
4. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Interface module is used to receive the sound signal that external transmission is come;
Second memory module is used to store the predefined bright corresponding text formatting information that reads instruction;
Sound identification module is used for converting the sound signal that said interface module receives into text formatting information;
Second comparison module is used for the text formatting information and the said second memory module stored text format information of said sound identification module output are compared, and when coupling, confirms that said system receives bright reading instruction.
5. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
The sound acquisition module is used to pick up sound, and exports the sound signal of this sound;
The 3rd memory module is used to store the predefined said bright corresponding audio signal that reads instruction;
The 3rd comparison module is used for the sound signal that the sound signal and said the 3rd memory module of said sound acquisition module output are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
6. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Interface module is used to receive the sound signal that external transmission is come;
The 3rd memory module is used to store the predefined said bright corresponding audio signal that reads instruction;
The 3rd comparison module is used for the sound signal that the sound signal and the 3rd memory module of said interface module output are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
7. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Photographing module is used for pickup image;
The 4th memory module is used to store the predefined bright corresponding motion images that reads instruction;
First image processing module is used for from the image of the image intercepting control side of said photographing module picked-up;
The 4th comparison module is used for the motion images that the image and the 4th memory module of the output of first image processing module are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
8. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Interface module is used to receive the image information that external transmission is come;
The 4th memory module is used to store the predefined bright corresponding motion images that reads instruction;
First image processing module is used for from the image of the image information intercepting control side that interface module receives;
The 4th comparison module is used for the motion images that the first image processing module truncated picture and the 4th memory module are stored is compared, and when coupling, confirms that said system receives bright reading instruction.
9. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Photographing module is used for pickup image;
The 5th memory module is used to store the predefined bright corresponding framework information that reads instruction;
Second image processing module is used for obtaining from the image of photographing module picked-up the framework information of control side;
The 5th comparison module, the framework information that framework information that is used for second image processing module is obtained and the 5th memory module are stored compares, and when coupling, confirms that system receives bright reading instruction.
10. vision-aided system as claimed in claim 1 is characterized in that monitoring module comprises:
Interface module is used to receive the image information that external transmission is come;
The 5th memory module is used to store the predefined bright corresponding framework information that reads instruction;
Second image processing module is used for obtaining from the image information that interface module receives the framework information of control side;
The 5th comparison module, the framework information that framework information that is used for second image processing module is obtained and the 5th memory module are stored compares, and when coupling, confirms that system receives bright reading instruction.
CN2011100909330A 2011-04-12 2011-04-12 Vision assistant system Pending CN102736886A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100909330A CN102736886A (en) 2011-04-12 2011-04-12 Vision assistant system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100909330A CN102736886A (en) 2011-04-12 2011-04-12 Vision assistant system

Publications (1)

Publication Number Publication Date
CN102736886A true CN102736886A (en) 2012-10-17

Family

ID=46992455

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100909330A Pending CN102736886A (en) 2011-04-12 2011-04-12 Vision assistant system

Country Status (1)

Country Link
CN (1) CN102736886A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016197430A1 (en) * 2015-06-11 2016-12-15 中兴通讯股份有限公司 Information output method, terminal, and computer storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001067227A1 (en) * 2000-03-10 2001-09-13 Seungheon Baek Apparatus and method for displaying sentence in order to study foreign languages
CN1339904A (en) * 2000-08-11 2002-03-13 索尼公司 Information read equipment and information read method
JP2004222167A (en) * 2003-01-17 2004-08-05 Daikin Ind Ltd Information processor, method and program
US20090034843A1 (en) * 2005-08-18 2009-02-05 Koninklijke Philips Electronics, N.V. Device for and method of displaying user information in a display
CN101656061A (en) * 2009-07-01 2010-02-24 宇龙计算机通信科技(深圳)有限公司 Method for displaying terminal content and display terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001067227A1 (en) * 2000-03-10 2001-09-13 Seungheon Baek Apparatus and method for displaying sentence in order to study foreign languages
CN1339904A (en) * 2000-08-11 2002-03-13 索尼公司 Information read equipment and information read method
JP2004222167A (en) * 2003-01-17 2004-08-05 Daikin Ind Ltd Information processor, method and program
US20090034843A1 (en) * 2005-08-18 2009-02-05 Koninklijke Philips Electronics, N.V. Device for and method of displaying user information in a display
CN101656061A (en) * 2009-07-01 2010-02-24 宇龙计算机通信科技(深圳)有限公司 Method for displaying terminal content and display terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016197430A1 (en) * 2015-06-11 2016-12-15 中兴通讯股份有限公司 Information output method, terminal, and computer storage medium

Similar Documents

Publication Publication Date Title
US9319632B2 (en) Display apparatus and method for video calling thereof
US20200099960A1 (en) Video Stream Based Live Stream Interaction Method And Corresponding Device
EP2355490A2 (en) Image capturing apparatus having remote control function
KR20090001667A (en) Apparatus and method for embodying contents using augmented reality
EP2627073B1 (en) Terminal apparatus
CN103136746A (en) Image processing device and image processing method
TW201337830A (en) Information processing apparatus, information processing method, and program
CN202166980U (en) Hand-held terminal
CN114710699A (en) Display device and method for controlling display of display device
EP1811431A1 (en) Information processing system, and information processing method
CN106775561B (en) Question intercepting method and device and intelligent equipment
US20150169197A1 (en) Screen generation device, remote operation device, remote control device, screen generation method, and screen generation program
CN103986933A (en) Dynamic picture displaying method and device
KR20170011841A (en) Display apparatus and method for controlling a screen of display apparatus
CN202168129U (en) Handheld terminal
CN109068063B (en) Three-dimensional image data processing and displaying method and device and mobile terminal
CN103946871A (en) Image processing device, image recognition device, image recognition method, and program
CN103298530B (en) Information processing device
CN102736727A (en) Visual auxiliary system
CN110519503A (en) A kind of acquisition methods and mobile terminal of scan image
CN108401173A (en) Interactive terminal, method and the computer readable storage medium of mobile live streaming
CN102736886A (en) Vision assistant system
CN104536713A (en) Method and device for displaying characters in image
US10722795B2 (en) Storage medium, information processing apparatus and information processing method
WO2023284798A1 (en) Video playback method and apparatus, and electronic device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned

Effective date of abandoning: 20151209

C20 Patent right or utility model deemed to be abandoned or is abandoned