CN104951145A - Information processing method and apparatus - Google Patents
Information processing method and apparatus Download PDFInfo
- Publication number
- CN104951145A CN104951145A CN201410109978.1A CN201410109978A CN104951145A CN 104951145 A CN104951145 A CN 104951145A CN 201410109978 A CN201410109978 A CN 201410109978A CN 104951145 A CN104951145 A CN 104951145A
- Authority
- CN
- China
- Prior art keywords
- image information
- input operation
- operating body
- display interface
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses an information processing method and an apparatus, and belongs to the field of terminal equipment. The method comprises: a display interface is projected via a projection unit so that the display interface can be presented at a supporting body; M image information can be acquired via an image acquisition unit, wherein M is the integer more than or equal to 1; input operation of an operation body on the display interface is obtained according to the M image information; a first sound signal is obtained via a sound acquisition unit; whether the first sound signal and the preset first audio characteristic information are matched or not is determined; and when the first sound signal is matched with the preset audio characteristic information, it is determined that the input operation is contacted with the supporting body for presenting the display interface. By employing the information processing method and the apparatus, the accuracy of triggering interface operation can be improved.
Description
Technical field
The present invention relates to field of terminal equipment, particularly a kind of information processing method and device.
Background technology
Along with the development of terminal technology, increasing computing machine is equipped with touch-screen, and user can trigger interface operation by touch-screen, as click, dragging etc.In a lot of occasion, terminal is not equipped with touch-screen, but user but has the demand of touch control operation, like this, just needs to arrange the touch control operation that a kind of mechanism has been come this terminal.
General, for the terminal not being equipped with touch-screen, can perform interface operation by the mode control terminal of simulation touch-control, simulation touch-control is the touch action by identifying in user's finger other plane beyond screen, performs corresponding interface operation with triggering terminal.General simulation touch-control can realize by camera.Particularly, first, in the target area that the upper appointment one of certain flat board (as desktop) is corresponding with screen display interface, camera carries out image taking to this target area in real time, according to the image of shooting, determines to point the action of contact position in the target area and finger, its interface location corresponding in screen display interface is determined according to contact position, and determine corresponding interface operation according to the action of finger, then, terminal performs this interface operation at this interface location place.
Realizing in process of the present invention, inventor finds that prior art at least exists following problem:
In the scheme of above-mentioned simulation touch-control, because camera is taken in the process of image from top to bottom, background and the finger of target area can only be photographed, and not determine whether finger contacts with target area, like this, usually can cause maloperation by the image of shooting.
Summary of the invention
In order to solve the problem of prior art, embodiments provide a kind of information processing method and device.Described technical scheme is as follows:
First aspect, provides a kind of information processing method, and described method is applied in electronic equipment, and described electronic equipment has projecting cell, image acquisition units and sound collection unit; Described projecting cell has a projected area, and described image acquisition units has a pickup area, and described projected area and described pickup area have intersection; Described method comprises:
By described projecting cell, display interface is projected to present described display interface on the carrier;
M image information is obtained, the integer of M >=1 by described image acquisition units;
The input operation of operating body at described display interface is obtained according to described M image information;
First sound tone signal is obtained by described sound collection unit;
Determine whether mate with the first audio feature information preset;
When described first sound tone signal and described the first default audio feature information match, determine that described input operation contacts with the described supporting body presenting described display interface.
Alternatively, described method also comprises:
According to the primary importance of the described input operation of input operation determination operation body, described primary importance is the position of described operating body when obtaining described first sound tone signal;
According to the first object corresponding with described position on primary importance determination display interface;
Described input operation is responded based on described first object.
Alternatively, described method also comprises:
When obtaining the first image information of image acquisition units described in described first sound tone signal tense marker; Described first image information contacts with described supporting body for characterizing described operating body, and described first image information belongs to one in a described M image information;
Described input operation is determined based on described first image information and M-1 image information.
Alternatively, describedly determine described input operation based on described first image information and M-1 image information, comprising:
Determine that the imaging of the described operating body in the described first image information comparison result whether identical with the imaging comparison of the described operating body in image information before described first image information is no by the mode of image recognition and the whether identical comparison result of the imaging comparison of described operating body after determining the imaging of the described operating body in described first image information and described first image information in image information is no time, described input operation is defined as clicking operation; Or/and,
Determine that the imaging of the described operating body in described first image information and the comparison result of the imaging comparison of the described operating body of the image information after described first image information are that shape is identical by the mode of image recognition but position is different time, described input operation is defined as contact mobile operation.
Alternatively, when described input operation operation mobile for contact,
Describedly respond described input operation based on described first object, comprising:
Respond described contact mobile operation control first object to move according to the track of described input operation; And projected by the control procedure of projecting cell by mobile for described for described response contact operation to present on described supporting body.
Second aspect, provides a kind of signal conditioning package, and described application of installation is in electronic equipment, and described device has projecting cell, image acquisition units and sound collection unit; Described projecting cell has a projected area, and described image acquisition units has a pickup area, and described projected area and described pickup area have intersection; Described device comprises:
Projection module, for projecting display interface to present described display interface on the carrier by described projecting cell;
First acquisition module, for obtaining M image information by described image acquisition units, the integer of M >=1;
Second acquisition module, for obtaining the input operation of operating body at described display interface according to described M image information;
3rd acquisition module, for obtaining first sound tone signal by described sound collection unit;
Whether judge module, mate for the first audio feature information determined with preset;
First determination module, for when described first sound tone signal and described the first default audio feature information match, determines that described input operation contacts with the described supporting body presenting described display interface.
Alternatively, described device also comprises:
Second determination module, for the primary importance of the described input operation according to input operation determination operation body, described primary importance is the position of described operating body when obtaining described first sound tone signal;
Described second determination module, also for according to the first object corresponding with described position on primary importance determination display interface;
Respond module, for responding described input operation based on described first object.
Alternatively, described device also comprises:
Mark module, for the first image information when image acquisition units described in the described first sound tone signal tense marker of acquisition; Described first image information contacts with described supporting body for characterizing described operating body, and described first image information belongs to one in a described M image information;
Described second acquisition module, also for determining described input operation based on described first image information and M-1 image information.
Alternatively, described second acquisition module, also for:
Determine that the imaging of the described operating body in the described first image information comparison result whether identical with the imaging comparison of the described operating body in image information before described first image information is no by the mode of image recognition and the whether identical comparison result of the imaging comparison of described operating body after determining the imaging of the described operating body in described first image information and described first image information in image information is no time, described input operation is defined as clicking operation; Or/and
Determine that the imaging of the described operating body in described first image information and the comparison result of the imaging comparison of the described operating body of the image information after described first image information are that shape is identical by the mode of image recognition but position is different time, described input operation is defined as contact mobile operation.
Alternatively, when described input operation operation mobile for contact,
Described respond module, for:
Respond described contact mobile operation control first object to move according to the track of described input operation; And projected by the control procedure of projecting cell by mobile for described for described response contact operation to present on described supporting body.
The beneficial effect that the technical scheme that the embodiment of the present invention provides is brought is:
By projecting cell, display interface is projected to present display interface on the carrier, M the image information obtained by image acquisition units, obtain the input operation of operating body at display interface, first sound tone signal is obtained by sound collection unit, and determine whether mate with the first audio feature information preset, when first sound tone signal matches with the first audio feature information preset, determine that this input operation contacts with the supporting body presenting display interface, like this, the voice signal determination operation body received is utilized whether to contact with supporting body, if operating body does not contact with supporting body, then can not produce corresponding voice signal, avoid the erroneous judgement situation in above-mentioned technology, thus, the accuracy triggering interface operation can be improved.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing embodiment is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of information processing method process flow diagram that the embodiment of the present invention provides;
Fig. 2 is a kind of information processing method process flow diagram that the embodiment of the present invention provides;
Fig. 3 is a kind of information processing method process flow diagram that the embodiment of the present invention provides;
Fig. 4 is a kind of signal conditioning package structural representation that the embodiment of the present invention provides.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, embodiment of the present invention is described further in detail.
Embodiment one
Fig. 1 is a kind of information processing method process flow diagram that the embodiment of the present invention provides.See Fig. 1, the method is applied in electronic equipment, and electronic equipment has projecting cell, image acquisition units and sound collection unit; Projecting cell has a projected area, and image acquisition units has a pickup area, and this projected area and this pickup area have intersection; The method comprises:
Step 101, is projected display interface to present display interface on the carrier by projecting cell.
Step 102, obtains M image information by image acquisition units, the integer of M >=1.
Step 103, obtains the input operation of operating body at display interface according to this M image information.
Step 104, obtains first sound tone signal by sound collection unit.
Step 105, determines whether mate with the first audio feature information preset.
Step 106, when first sound tone signal matches with the first audio feature information preset, determines that this input operation contacts with the supporting body presenting display interface.
In the embodiment of the present invention, by projecting cell, display interface is projected to present display interface on the carrier, M the image information obtained by image acquisition units, obtain the input operation of operating body at display interface, first sound tone signal is obtained by sound collection unit, and determine whether mate with the first audio feature information preset, when first sound tone signal matches with the first audio feature information preset, determine that this input operation contacts with the supporting body presenting display interface, like this, the voice signal determination operation body received is utilized whether to contact with supporting body, if operating body does not contact with supporting body, then can not produce corresponding voice signal, avoid the erroneous judgement situation in above-mentioned technology, thus, the accuracy triggering interface operation can be improved.
Embodiment two
Disclosure embodiment provides a kind of information processing method, and the method is applied in electronic equipment, and electronic equipment has projecting cell, image acquisition units and sound collection unit; Projecting cell has a projected area, and image acquisition units has a pickup area, and this projected area and this pickup area have intersection, and wherein, electronic equipment can be desktop computer, integrated computer etc.
Below in conjunction with embodiment, be described in detail the treatment scheme shown in Fig. 1, content can be as follows:
Step 101, display interface is projected to present display interface on the carrier by projecting cell by electronic equipment.
Wherein, projecting cell is for showing image projection to certain supporting body by certain, display interface can be the current display interface of electronic equipment or default display interface (as the display interface that keyboard image is formed), supporting body is bear the carrier supporting something or other, this supporting body can be the object of solid shape, as square plank, desktop etc., the length of this supporting body and width are more than or equal to length and the width of the projected area that projecting cell presents on the carrier respectively.
In force, after user determines to present the supporting body of display interface, start the projecting cell of electronic equipment, display interface current for the display unit of electronic equipment projects on supporting body by projecting cell, now, presents display interface in the projected area of projecting cell.
Step 102, electronic equipment obtains M image information by image acquisition units, the integer of M >=1.
Wherein, image acquisition units is for gathering image information (as video, picture etc.), and image acquisition units can be the camera of electronic equipment.The pickup area of image acquisition units and the projected area of projecting cell have intersection, and alternatively, pickup area can comprise projected area.
In force, when the projecting cell of electronic equipment starts, electronic equipment can open self image acquisition units, the image in image acquisition units captured in real-time pickup area, thus electronic equipment can obtain at least one image information.
Step 103, electronic equipment obtains the input operation of operating body at display interface according to this M image information.
Wherein, operating body can be finger or writing pencil etc.
In force, electronic equipment is analyzed adjacent image information at least one image information obtained and is contrasted, and determination operation body is in the input operation of display interface.
Step 104, electronic equipment obtains first sound tone signal by sound collection unit.
Wherein, sound collection unit for receiving voice signal, as the microphone etc. of electronic equipment.
In force, when the projecting cell of electronic equipment starts, electronic equipment can open self sound collection unit, sound collection unit real-time reception voice signal, when operating body contact supporting body, the sound collection unit of electronic equipment receives the voice signal that operating body contacts with supporting body, and this voice signal is defined as first sound tone signal.
Step 105, electronic equipment determines whether mate with the first audio feature information preset.
Wherein, audio feature information is the change information such as sound wave frequency, amplitude in sound signal.
In force, the muli-sounds signal produced when electronic equipment can contact with supporting body operating body is in advance analyzed, and obtain the audio feature information that these voice signals are corresponding, the audio feature information obtained stores by electronic equipment.When electronic equipment receives first sound tone signal, first sound tone signal is analyzed, obtain the audio feature information of first sound tone signal, the audio feature information of first sound tone signal and the audio feature information prestored contrast by electronic equipment, thus determine whether comprise the audio feature information matched with the audio feature information of first sound tone signal in the audio feature information prestored.Wherein, determining that whether the audio feature information of first sound tone signal matches with the audio feature information prestored can be: electronic equipment by the frequency of first sound tone signal or changes in amplitude whether with the frequency in the audio feature information prestored or changes in amplitude identical, determine whether both mate.When such a match occurs, perform step 206, when both do not mate, electronic equipment can not respond to this voice signal.
Preferably, the process whether above-mentioned audio feature information determining first sound tone signal matches with the audio feature information prestored, can be undertaken by sound groove recognition technology in e, can reduce the probability of false touch like this.
Step 106, when first sound tone signal matches with the first audio feature information preset, electronic equipment determines that this input operation contacts with the supporting body presenting display interface.
In force, when the audio feature information of first sound tone signal matches with the first audio feature information preset, electronic equipment determination operation body contacts with supporting body, and now, electronic equipment can perform the input operation determined.
Above-mentioned steps 102 ~ step 103 is electronic equipment processes by image acquisition units determination input operation, above-mentioned steps 104 ~ step 105 is that electronic equipment obtains first sound tone signal by sound collection unit, and judge the process whether first sound tone signal matches with the first audio feature information preset, in embodiments of the present invention, the process of above-mentioned steps 102 ~ step 103 and the process of step 104 ~ step 105 perform according to sequencing, in practical operation, above-mentioned two processes can be carried out simultaneously, namely electronic equipment can carry out image acquisition by image acquisition units, simultaneously, sound collection unit receives voice signal, then electronic equipment processes the image gathered and the voice signal received respectively, above-mentioned two processes can be also the processes that electronic equipment first performs step 104 ~ step 105, and then perform the process of step 102 ~ step 103, and the execution sequence of the embodiment of the present invention to above-mentioned two processes does not limit.
Alternatively, electronic equipment performs the process of this input operation, can comprise the following steps:
Step one, electronic equipment is according to the primary importance of the input operation of input operation determination operation body, and primary importance is the position of operating body when obtaining first sound tone signal.
In force, when electronic equipment receives first sound tone signal, the record time now, and according to the time of the first sound tone signal received and the input operation determined by image information, determine at the time point receiving first sound tone signal, position residing for operating body, and using this position as primary importance.
Step 2, electronic equipment is according to the first object that on primary importance determination display interface, position is corresponding therewith.
Wherein, multiple object (icon or shortcut etc. as application) can be comprised in display interface.
In force, the image in the pickup area of image acquisition units shooting is preserved in advance in electronic equipment, display interface is comprised at this image, electronic equipment is corresponding with the object of the display interface of the current display of electronic equipment by the object of display interface in this image, when the primary importance of the input operation of electronic equipment determination operation body, according to the object that on this primary importance determination display interface, position is corresponding therewith, and this object is defined as the first object.
Step 3, electronic equipment responds this input operation based on the first object.
Based on above-mentioned steps one ~ step 3, preferably, be clicking operation for input operation, display interface is the situation of the display interface be made up of keyboard image, when operating body clicks the key icon of keyboard in display interface, electronic equipment can directly by Charactes Display corresponding for the key icon clicked on an electronic device.Alternatively, the character of above-mentioned input can not show in view field.
Alternatively, electronic equipment can comprise the following steps according to the process of the input operation of image information acquisition operating body:
Step one, when electronic equipment obtains the first image information of first sound tone signal tense marker image acquisition units; First image information is used for characterization operations body and contacts with supporting body, and the first image information belongs to one in M image information.
In force, when electronic equipment receives first sound tone signal, the time point that electronic equipment record operating body contacts with supporting body, and from M image information of image acquisition units, mark the image information that this time point is corresponding, and this image information is defined as the first image information.
Step 2, electronic equipment determines this input operation based on the first image information and M-1 image information.
In force, the first image information and the image information adjacent with the first image information are analyzed by electronic equipment, the input operation that determination operation body carries out.
Alternatively, input operation can be clicking operation or/and contact mobile operation, then above-mentioned steps two can comprise with under type:
Mode one, determine that the imaging of the operating body in the first image information comparison result whether identical with the imaging comparison of the operating body in image information before the first image information is no by the mode of image recognition and the whether identical comparison result of the imaging comparison of operating body after determining the imaging of the operating body in the first image information and the first image information in image information is no time, this input operation is defined as clicking operation by electronic equipment.
Alternatively, electronic equipment can set the receiving cycle of voice signal, when the cycle that accepts arrives, electronic equipment receives voice signal, after receiving first sound tone signal, at the end of receiving cycle, electronic equipment does not receive other voice signal matched with the audio feature information preset, then this input operation is defined as clicking operation.
Mode two, determine that the imaging of the operating body in the first image information and the comparison result of the imaging comparison of the operating body of the graphical information after the first image information are that shape is identical by the mode of image recognition but position is different time, this input operation is defined as contact mobile operation.
Alternatively, operation is moved for the contact in mode two to limit the distance in the process of operating body movement between operating body and supporting body, namely after operating body contacts with supporting body, when operating body moves, as long as the distance between operating body and supporting body is within the scope of predeterminable range, electronic equipment can think that operating body contacts with supporting body, and whole operation is defined as contact mobile operation, such as, when needing certain icon moving on desktop to other interface, user can click this icon on supporting body, then, finger can be left supporting body surface to carry out moving operation, other interface is moved to easily to enable this icon.
Alternatively, when this input operation operation mobile for contact, the responding this input operation based on the first object and can comprise of above-mentioned steps three:
Electronic equipment response contact mobile operation control first object moves according to the track of this input operation; And projected by the control procedure of projecting cell by the mobile operation of this response contact to present on the carrier.
In force, electronic equipment control the first object according to operating body movement track move, and by above-mentioned moving process, projected in real time by projecting cell, above-mentioned moving process is presented in the view field of supporting body, like this, user can be made to view current shift position, user-friendly.
In the embodiment of the present invention, by projecting cell, display interface is projected to present display interface on the carrier, M the image information obtained by image acquisition units, obtain the input operation of operating body at display interface, first sound tone signal is obtained by sound collection unit, and determine whether mate with the first audio feature information preset, when first sound tone signal matches with the first audio feature information preset, determine that this input operation contacts with the supporting body presenting display interface, like this, the voice signal determination operation body received is utilized whether to contact with supporting body, if operating body does not contact with supporting body, then can not produce corresponding voice signal, avoid the erroneous judgement situation in above-mentioned technology, thus, the accuracy triggering interface operation can be improved.
Embodiment three
Below in conjunction with concrete application scenarios, the information processing method that the embodiment of the present invention provides is described in detail, as shown in Figure 2, following treatment step can be comprised:
Step 201, display interface is projected to present display interface on the carrier by projecting cell by electronic equipment.
Wherein, display interface is comprise the icon of application or the interface of shortcut.
Step 202, electronic equipment obtains M image information by image acquisition units, the integer of M >=1.
The concrete processing mode of above-mentioned steps 201 ~ step 202 with reference to the related content in embodiment two, can repeat no more herein.
Step 203, electronic equipment obtains the input operation of operating body at display interface according to this M image information.
Wherein, input operation can comprise clicking operation and contact mobile operation, electronic equipment determination clicking operation with contact the mode that movement operates with reference to the related content in embodiment two, can repeat no more herein.
Step 204, electronic equipment obtains first sound tone signal by sound collection unit.
Step 205, electronic equipment determines whether mate with the first audio feature information preset.
Step 206, when first sound tone signal matches with the first audio feature information preset, electronic equipment determines that this input operation contacts with the supporting body presenting display interface.
The concrete processing mode of above-mentioned steps 204 ~ step 206 with reference to the related content in embodiment two, can repeat no more herein.
Step 207, electronic equipment is according to the primary importance of the input operation of input operation determination operation body, and primary importance is the position of operating body when obtaining first sound tone signal.
Step 208, electronic equipment is according to the icon that on primary importance determination display interface, position is corresponding therewith or shortcut.
Step 209, electronic equipment responds this input operation based on this icon or shortcut.
For the process described in above-mentioned steps 207 ~ step 209, in force, when input operation is clicking operation, electronic equipment is according to the time of reception of first sound tone signal corresponding to this clicking operation, determine the position of operating body in image information, and determine position is corresponding therewith icon or shortcut according to the position of operating body, electronic equipment performs clicking operation to this icon or shortcut, namely runs this icon or application corresponding to shortcut; When input operation operation mobile for contact, electronic equipment contacts the time of reception of the first sound tone signal produced with supporting body according to operating body, determine the position of operating body in image information, and determine position is corresponding therewith icon or shortcut according to the position of operating body, then, electronic equipment controls this icon or shortcut moves according to the track of the mobile operation of contact, simultaneously, projecting cell, by the control procedure projection of mobile for contact operation, presents on the carrier to make said process.
In the embodiment of the present invention, by projecting cell, display interface is projected to present display interface on the carrier, M the image information obtained by image acquisition units, obtain the input operation of operating body at display interface, first sound tone signal is obtained by sound collection unit, and determine whether mate with the first audio feature information preset, when first sound tone signal matches with the first audio feature information preset, determine that this input operation contacts with the supporting body presenting display interface, like this, the voice signal determination operation body received is utilized whether to contact with supporting body, if operating body does not contact with supporting body, then can not produce corresponding voice signal, avoid the erroneous judgement situation in above-mentioned technology, thus, the accuracy triggering interface operation can be improved.
Embodiment four
Below in conjunction with concrete application scenarios, the information processing method that the embodiment of the present invention provides is described in detail, as shown in Figure 3, following treatment step can be comprised:
Step 301, display interface is projected to present display interface on the carrier by projecting cell by electronic equipment.
Wherein, display interface is the interface of keyboard image.Now, electronic equipment can be in carry out editing mode to document, and user can by the input through keyboard character of display interface.
Step 302, electronic equipment obtains M image information by image acquisition units, the integer of M >=1.
The concrete processing mode of above-mentioned steps 301 ~ step 302 with reference to the related content in embodiment two, can repeat no more herein.
Step 303, electronic equipment obtains the clicking operation of operating body at display interface according to this M image information.
Wherein, the mode of electronic equipment determination clicking operation with reference to the related content in embodiment two, can repeat no more herein.
Step 304, electronic equipment obtains first sound tone signal by sound collection unit.
Step 305, electronic equipment determines whether mate with the first audio feature information preset.
Step 306, when first sound tone signal matches with the first audio feature information preset, electronic equipment determination clicking operation contacts with the supporting body presenting display interface.
The concrete processing mode of above-mentioned steps 304 ~ step 306 with reference to the related content in embodiment two, can repeat no more herein.
Step 307, electronic equipment is according to the primary importance of the clicking operation of clicking operation determination operation body, and primary importance is the position of operating body when obtaining first sound tone signal.
Step 308, electronic equipment is according to the button of the keyboard that position is corresponding therewith on primary importance determination display interface.
Step 309, electronic equipment is based on this clicking operation of key response of this keyboard.
For the process described in above-mentioned steps 307 ~ step 309, in force, electronic equipment is according to the time of reception of first sound tone signal corresponding to this clicking operation, determine the position of operating body in image information, and the button of the keyboard that position is corresponding is therewith determined according to the position of operating body, electronic equipment performs clicking operation to the button of this keyboard, namely inputs character corresponding to this button in the electronic device.
In the embodiment of the present invention, by projecting cell, display interface is projected to present display interface on the carrier, M the image information obtained by image acquisition units, obtain the input operation of operating body at display interface, first sound tone signal is obtained by sound collection unit, and determine whether mate with the first audio feature information preset, when first sound tone signal matches with the first audio feature information preset, determine that this input operation contacts with the supporting body presenting display interface, like this, the voice signal determination operation body received is utilized whether to contact with supporting body, if operating body does not contact with supporting body, then can not produce corresponding voice signal, avoid the erroneous judgement situation in above-mentioned technology, thus, the accuracy triggering interface operation can be improved.
Embodiment five
Based on identical technical conceive, the embodiment of the present invention additionally provides a kind of signal conditioning package, and as shown in Figure 4, this application of installation is in electronic equipment, and this device has projecting cell, image acquisition units and sound collection unit; Projecting cell has a projected area, and image acquisition units has a pickup area, and this projected area and this pickup area have intersection; This device comprises:
Projection module 410, for projecting display interface to present display interface on the carrier by projecting cell;
First acquisition module 420, for obtaining M image information by image acquisition units, the integer of M >=1;
Second acquisition module 430, for obtaining the input operation of operating body at display interface according to this M image information;
3rd acquisition module 440, for obtaining first sound tone signal by sound collection unit;
Whether judge module 450, mate for the first audio feature information determined with preset;
First determination module 460, for when first sound tone signal matches with the first audio feature information preset, determines that this input operation contacts with the supporting body presenting display interface.
Alternatively, this device also comprises:
Second determination module, for the primary importance of this input operation according to input operation determination operation body, primary importance is the position of operating body when obtaining first sound tone signal;
Second determination module, also for according to the first object that on primary importance determination display interface, position is corresponding therewith;
Respond module, for responding this input operation based on the first object.
Alternatively, this device also comprises:
Mark module, for the first image information when acquisition first sound tone signal tense marker image acquisition units; First image information is used for characterization operations body and contacts with supporting body, and the first image information belongs to one in this M image information;
Second acquisition module 430, also for determining this input operation based on the first image information and M-1 image information.
Alternatively, the second acquisition module 430, also for:
Determine that the imaging of the operating body in the first image information comparison result whether identical with the imaging comparison of the operating body in image information before the first image information is no by the mode of image recognition and the whether identical comparison result of the imaging comparison of operating body after determining the imaging of the operating body in the first image information and the first image information in image information is no time, this input operation is defined as clicking operation; Or/and
Determine that the imaging of the operating body in the first image information and the comparison result of the imaging comparison of the operating body of the image information after the first image information are that shape is identical by the mode of image recognition but position is different time, this input operation is defined as contact mobile operation.
Alternatively, when this input operation operation mobile for contact,
Respond module, for:
Response contact mobile operation control first object moves according to the track of this input operation; And projected by the control procedure of projecting cell by the mobile operation of this response contact to present on the carrier.
In the embodiment of the present invention, by projecting cell, display interface is projected to present display interface on the carrier, M the image information obtained by image acquisition units, obtain the input operation of operating body at display interface, first sound tone signal is obtained by sound collection unit, and determine whether mate with the first audio feature information preset, when first sound tone signal matches with the first audio feature information preset, determine that this input operation contacts with the supporting body presenting display interface, like this, the voice signal determination operation body received is utilized whether to contact with supporting body, if operating body does not contact with supporting body, then can not produce corresponding voice signal, avoid the erroneous judgement situation in above-mentioned technology, thus, the accuracy triggering interface operation can be improved.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can have been come by hardware, the hardware that also can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be ROM (read-only memory), disk or CD etc.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. an information processing method, described method is applied in electronic equipment, and described electronic equipment has projecting cell, image acquisition units and sound collection unit; Described projecting cell has a projected area, and described image acquisition units has a pickup area, and described projected area and described pickup area have intersection; Described method comprises:
By described projecting cell, display interface is projected to present described display interface on the carrier;
M image information is obtained, the integer of M >=1 by described image acquisition units;
The input operation of operating body at described display interface is obtained according to described M image information;
First sound tone signal is obtained by described sound collection unit;
Determine whether mate with the first audio feature information preset;
When described first sound tone signal and described the first default audio feature information match, determine that described input operation contacts with the described supporting body presenting described display interface.
2. method according to claim 1, is characterized in that, described method also comprises:
According to the primary importance of the described input operation of input operation determination operation body, described primary importance is the position of described operating body when obtaining described first sound tone signal;
According to the first object corresponding with described position on primary importance determination display interface;
Described input operation is responded based on described first object.
3. method according to claim 1, is characterized in that, described method also comprises:
When obtaining the first image information of image acquisition units described in described first sound tone signal tense marker; Described first image information contacts with described supporting body for characterizing described operating body, and described first image information belongs to one in a described M image information;
Described input operation is determined based on described first image information and M-1 image information.
4. method according to claim 3, is characterized in that, describedly determines described input operation based on described first image information and M-1 image information, comprising:
Determine that the imaging of the described operating body in the described first image information comparison result whether identical with the imaging comparison of the described operating body in image information before described first image information is no by the mode of image recognition and the whether identical comparison result of the imaging comparison of described operating body after determining the imaging of the described operating body in described first image information and described first image information in image information is no time, described input operation is defined as clicking operation; Or/and,
Determine that the imaging of the described operating body in described first image information and the comparison result of the imaging comparison of the described operating body of the image information after described first image information are that shape is identical by the mode of image recognition but position is different time, described input operation is defined as contact mobile operation.
5. method according to claim 4, is characterized in that, when described input operation operation mobile for contact,
Describedly respond described input operation based on described first object, comprising:
Respond described contact mobile operation control first object to move according to the track of described input operation; And projected by the control procedure of projecting cell by mobile for described for described response contact operation to present on described supporting body.
6. a signal conditioning package, described application of installation is in electronic equipment, and described device has projecting cell, image acquisition units and sound collection unit; Described projecting cell has a projected area, and described image acquisition units has a pickup area, and described projected area and described pickup area have intersection; Described device comprises:
Projection module, for projecting display interface to present described display interface on the carrier by described projecting cell;
First acquisition module, for obtaining M image information by described image acquisition units, the integer of M >=1;
Second acquisition module, for obtaining the input operation of operating body at described display interface according to described M image information;
3rd acquisition module, for obtaining first sound tone signal by described sound collection unit;
Whether judge module, mate for the first audio feature information determined with preset;
First determination module, for when described first sound tone signal and described the first default audio feature information match, determines that described input operation contacts with the described supporting body presenting described display interface.
7. device according to claim 6, is characterized in that, described device also comprises:
Second determination module, for the primary importance of the described input operation according to input operation determination operation body, described primary importance is the position of described operating body when obtaining described first sound tone signal;
Described second determination module, also for according to the first object corresponding with described position on primary importance determination display interface;
Respond module, for responding described input operation based on described first object.
8. device according to claim 6, is characterized in that, described device also comprises:
Mark module, for the first image information when image acquisition units described in the described first sound tone signal tense marker of acquisition; Described first image information contacts with described supporting body for characterizing described operating body, and described first image information belongs to one in a described M image information;
Described second acquisition module, also for determining described input operation based on described first image information and M-1 image information.
9. device according to claim 8, is characterized in that, described second acquisition module, also for:
Determine that the imaging of the described operating body in the described first image information comparison result whether identical with the imaging comparison of the described operating body in image information before described first image information is no by the mode of image recognition and the whether identical comparison result of the imaging comparison of described operating body after determining the imaging of the described operating body in described first image information and described first image information in image information is no time, described input operation is defined as clicking operation; Or/and,
Determine that the imaging of the described operating body in described first image information and the comparison result of the imaging comparison of the described operating body of the image information after described first image information are that shape is identical by the mode of image recognition but position is different time, described input operation is defined as contact mobile operation.
10. device according to claim 9, is characterized in that, when described input operation operation mobile for contact,
Described respond module, for:
Respond described contact mobile operation control first object to move according to the track of described input operation; And projected by the control procedure of projecting cell by mobile for described for described response contact operation to present on described supporting body.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410109978.1A CN104951145B (en) | 2014-03-24 | 2014-03-24 | Information processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410109978.1A CN104951145B (en) | 2014-03-24 | 2014-03-24 | Information processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104951145A true CN104951145A (en) | 2015-09-30 |
| CN104951145B CN104951145B (en) | 2018-08-10 |
Family
ID=54165833
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410109978.1A Active CN104951145B (en) | 2014-03-24 | 2014-03-24 | Information processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104951145B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107885483A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | Method of calibration, device, storage medium and the electronic equipment of audio-frequency information |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101317148A (en) * | 2005-12-30 | 2008-12-03 | 国际商业机器公司 | Hand-written input method and apparatus based on video |
| CN101438218A (en) * | 2006-06-15 | 2009-05-20 | 诺基亚公司 | Mobile equipment with virtual small keyboard |
| JP2010067062A (en) * | 2008-09-11 | 2010-03-25 | Ntt Docomo Inc | Input system and method |
| CN101937267A (en) * | 2009-07-03 | 2011-01-05 | 北京宏景捷讯网络技术股份有限公司 | Method for simulating mouse input and device thereof |
| CN201716701U (en) * | 2010-08-01 | 2011-01-19 | 苏州达方电子有限公司 | Input system combining mouse and plane sensing device |
| CN102214023A (en) * | 2010-04-06 | 2011-10-12 | 鸿富锦精密工业（深圳）有限公司 | Touch device |
| CN102385459A (en) * | 2010-08-31 | 2012-03-21 | 卡西欧计算机株式会社 | Information processing apparatus and method |
-
2014
- 2014-03-24 CN CN201410109978.1A patent/CN104951145B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101317148A (en) * | 2005-12-30 | 2008-12-03 | 国际商业机器公司 | Hand-written input method and apparatus based on video |
| CN101438218A (en) * | 2006-06-15 | 2009-05-20 | 诺基亚公司 | Mobile equipment with virtual small keyboard |
| JP2010067062A (en) * | 2008-09-11 | 2010-03-25 | Ntt Docomo Inc | Input system and method |
| CN101937267A (en) * | 2009-07-03 | 2011-01-05 | 北京宏景捷讯网络技术股份有限公司 | Method for simulating mouse input and device thereof |
| CN102214023A (en) * | 2010-04-06 | 2011-10-12 | 鸿富锦精密工业（深圳）有限公司 | Touch device |
| CN201716701U (en) * | 2010-08-01 | 2011-01-19 | 苏州达方电子有限公司 | Input system combining mouse and plane sensing device |
| CN102385459A (en) * | 2010-08-31 | 2012-03-21 | 卡西欧计算机株式会社 | Information processing apparatus and method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107885483A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | Method of calibration, device, storage medium and the electronic equipment of audio-frequency information |
| CN107885483B (en) * | 2017-11-07 | 2021-03-02 | Oppo广东移动通信有限公司 | Audio information verification method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104951145B (en) | 2018-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102119376B (en) | Multidimensional navigation for touch-sensitive display | |
| JP4900361B2 (en) | Image processing apparatus, image processing method, and program | |
| CN106415472B (en) | Gesture control method and device, terminal equipment and storage medium | |
| CN108958627B (en) | Touch operation method and device, storage medium and electronic equipment | |
| CN102129313A (en) | Information processing apparatus, input operation determination method, and input operation determination program | |
| US10956030B2 (en) | Multi-touch based drawing input method and apparatus | |
| CN103502923A (en) | Touch and non touch based interaction of a user with a device | |
| CN103403661A (en) | Scaling of gesture based input | |
| KR20150091365A (en) | Multi-touch symbol recognition | |
| US9846529B2 (en) | Method for processing information and electronic device | |
| CN105683881A (en) | Information processing device, input method, and program | |
| CN105630397A (en) | Method and terminal equipment for opening popup boxes | |
| CN108228065B (en) | Method and device for detecting UI control information and electronic equipment | |
| CN106909256A (en) | Screen control method and device | |
| CN103645848B (en) | A kind of terminal control method based on ultrasound wave and terminal control mechanism | |
| WO2015131590A1 (en) | Method for controlling blank screen gesture processing and terminal | |
| CN106325726B (en) | Touch interaction method | |
| CN105808129B (en) | Method and device for quickly starting software function by using gesture | |
| CN101086693A (en) | Input device and input method | |
| CN105224448B (en) | The method and apparatus for recording test scene | |
| CN103345738A (en) | Object detection method and device based on area of interest | |
| CN109358799B (en) | Method for adding handwritten annotation information input by user on handwriting equipment | |
| CN108984097B (en) | Touch operation method and device, storage medium and electronic equipment | |
| CN104951145A (en) | Information processing method and apparatus | |
| CN106897017A (en) | The method and device of control terminal screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |