Summary of the invention
In view of this, one object of the present invention is to provide a kind of visual media audient information feedback system, and it provides a kind of effective audient's information feedback mechanism for visual media, thereby makes the input effect of visual information be able to record and feedback.
Another object of the present invention is to provide a kind of visual media audient information feedback method, it provides a kind of effective audient's information feedback mechanism for visual media, thereby makes the input effect of visual information be able to record and feedback.
In order to achieve the above object, according to an aspect of the present invention, visual media audient information feedback system provided by the invention comprises the visual media that is exclusively used in playing advertisements in the building, and it is used to carry visible advertisements information and watches for spectators; Visual media carries one or several visible advertisements information, and each visible advertisements information all has a well-determined sign, and it also comprises:
Video acquisition device is used to gather the spectators' that watch visible advertisements information video;
Video analysis device is used for that the video of gathering is carried out people's face and detects, determining the spectators that watch visible advertisements information, and this spectators initial watch constantly and stop to watch constantly;
Specifically: the people that detected people's face is corresponding regards as the spectators that watch visible advertisements information; Accordingly; Confirm now to watch the initial of spectators of visible advertisements information to watch constantly according to going out of detected people's face, confirm constantly to watch according to the disappearance of detected people's face visible advertisements information spectators stop to watch constantly;
Perhaps; Specifically: detected people's face is carried out sight line judge; Sight line is pointed to people's face of visible advertisements information and is regarded as the spectators that watch visible advertisements information, corresponding, point to according to sight line visible advertisements information people's face go out to confirm now to watch the initial of spectators of visible advertisements information to watch constantly; Point to according to sight line visible advertisements information people's face disappearance constantly, confirm to watch visible advertisements information spectators stop to watch constantly;
Information storage apparatus, what be used to write down the spectators that watch visible advertisements information initially watches constantly and stops to watch constantly; And the initial moment and the finish time of the sign of each visible advertisements information of visual media carrying and the appearance of this visible advertisements information.
In order to achieve the above object; According to a further aspect in the invention, visual media audient information feedback method provided by the invention, said visual media are the visual media that is exclusively used in playing advertisements in the building; Being used to carry visible advertisements information watches for spectators; Visual media carries one or several visible advertisements information, and each visible advertisements information all has a well-determined sign, and it comprises:
A) spectators' of visible advertisements information video is watched in collection;
B) video of gathering being carried out people's face detects to determine the spectators that watch visible advertisements information;
Specifically: the people that detected people's face is corresponding regards as the spectators that watch visible advertisements information; Confirm now to watch the initial of spectators of visible advertisements information to watch constantly according to going out of detected people's face, confirm constantly to watch according to the disappearance of detected people's face visible advertisements information spectators stop to watch constantly.
Perhaps, specifically: detected people's face is carried out sight line judge, sight line is pointed to people's face of visible advertisements information and regarded as the spectators that watch visible advertisements information; Point to according to sight line visible advertisements information people's face go out to confirm now to watch the initial of spectators of visible advertisements information to watch constantly, the disappearance of pointing to people's face of visible advertisements information according to sight line confirm constantly to watch visible advertisements information spectators stop to watch constantly.
C) record watches the initial of spectators of visible advertisements information to watch the moment and stop to watch constantly; And the initial moment and the finish time of the sign of each visible advertisements information of record visual media carrying and the appearance of this visible advertisements information.
Like this in the technical scheme that the present invention proposes; Can collect the spectators' that watch visual information video; Through just being analyzed, the video of gathering to determine the spectators that watch visual information; Watch the moment and stop to watch constantly thereby learn and note the initial of spectators of watching visual information, the input effect of visual information just is able to record and feedback like this.
Embodiment
Below in conjunction with Figure of description embodiment of the present invention is described.
A kind of visual media audient information feedback system is provided among the present invention, and it provides a kind of effective audient's information feedback mechanism for visual media, thereby makes the input effect of visual information be able to record and feedback.
Please referring to shown in Figure 1; It shows block diagram among the embodiment of a kind of visual media audient of the present invention information feedback system, and said visual media audient information feedback system comprises visual media 10, video acquisition device 20, video analysis device 30 and information storage apparatus 40.Wherein, said visual media 10 is used to carry visual information and watches for spectators; Said video acquisition device 20 is used to gather the spectators' that watch visual information video; Said video analysis device 30 is used for the video of gathering is analyzed the spectators that watch visual information to determine; Said information storage apparatus 40 is used to write down the spectators that watch visual information initially watches constantly and stops to watch constantly.
In the present invention; Visual media 10 can be a sensu lato notion; It can be displaying sales counter or the goods carrier in the supermarket in video player, promotional plate, the exhibition; We can say that so long as the carrier of visual information can be called as visual media corresponding, visual information also can be a sensu lato notion here; It can be show piece, the goods on the goods carrier or the advertisement information on the promotional plate on the video information of playing on the video player, displaying sales counter, we can say so long as can be called as visual information by the artificial information that can see that is loaded on the visual media.In one embodiment; Said video player can be common cable TV or the radiotelevisor that has among the present huge numbers of families; Also can be to be positioned in the building or the special television machine in the elevator; Even can be mobile TV, said video information can be video ads or video TV program etc., such as video ads or TV series program of one section Coca-Cola.Usually, be positioned in the building or some advertisements of meeting round-robin broadcast in the special television machine in the elevator, and broadcast TV programme and advertisement that common wired or wireless TV can replace.Said promotional plate can stand in the both sides, street or post up on the buildings and supply masses to watch, and said advertisement information generally is a billboard, the huge image of representing for certain clothes brand such as the huge image or the Zhou Jielun of a certain automobile etc.
In a concrete embodiment; See also shown in Figure 3; Said visual media 10 can have several, can form a far-ranging visual media system like this to form the propagation of large-scale visual information, and several visual medias can disperse to be arranged on different geographical.In one 20 layers building; Possibility all will be placed a special television for every layer; All place a special television in each elevator, in supermarket, have tens of in different positions or up to a hundred shelf for another example; In exhibition, has the dozens of exhibition position for another example in different positions.Said video acquisition device and visual media are supporting settings; Said video acquisition device can be placed on the corresponding visual media or near; Promptly a visual media is equipped with corresponding video acquisition device; Such as all being equipped with corresponding video acquisition device, for each shelf all is equipped with corresponding video acquisition device, for each exhibition position is equipped with corresponding video acquisition device for every TV.
The visual angle of said video acquisition device 20 is the visual orientation towards visual media; The visual field covers the part or all of viewing area of visual media; Its objective is that when spectators really watched visual information, said video acquisition device 20 can collect these spectators' facial image.The visual orientation here is meant that spectators can see the direction of visual information; The viewing area is meant that spectators can see the zone of visual information; With the televisor is example; Visual orientation not only comprises the direction of the dead ahead of screen towards screen, also comprise screen left front, right front, go up the place ahead, inferoanterior direction towards screen, the viewing area is meant the zone that can see TV screen.In one embodiment, the video acquisition device that disposes for each visual media can be a camera, such as selecting for use the wide-angle imaging head to cover the whole viewing areas of visual media, selects for use common camera to cover the main viewing area of visual media part.In another embodiment; The video acquisition device that disposes for each visual media can be several cameras, and said several cameras can be placed in the different position of corresponding visual media, can overlap in their visual field; The overlapping part in the visual field is the topmost zones of watching visual media of spectators; Zone, dead ahead such as a TV screen can have several cameras to photograph the overlapping part in the visual field like this, and this helps the analysis of follow-up video analysis device.Certainly, the visual field of several cameras can be not overlapping fully yet, and they can be responsible for zone separately separately so.
See also shown in Fig. 2 and 3; Said visual media audient information feedback system can also comprise video frequency transmitter 50; It is used for the video of receiver, video harvester 20 collections and transmits it to video analysis device 30; Video frequency transmitter 50 can pass through internet, LAN transmission of video to video analysis device, so just can make video analysis device 30 and video acquisition device 20 and visual media 10 split settings, and said information storage apparatus 40 is split settings with video acquisition device 20 with visual media 10; And the spectators' of each visual media of collecting video is carried out collective analysis handle and preserve, be convenient to like this information collecting and management.Be set at respectively such as several cameras and special television machine in the different floors or elevator of building, and video analysis device and information storage apparatus can be arranged on control center or other position of building.Certainly, also can be equipped with corresponding video analysis device and information storage apparatus, the mode of other accommodation can also be arranged in addition, just not enumerate one by one here for every cover visual media and video acquisition device.
The video of 30 pairs of collections of said video analysis device carries out people's face and detects; Detect people's face; The people that detected people's face is corresponding regards as the spectators that watch visual information; Accordingly, confirm now to watch the initial of spectators of visual information to watch constantly according to going out of detected people's face, confirm constantly to watch according to the disappearance of detected people's face visual information spectators stop to watch constantly.Can adopt any one method that discloses in the prior art about concrete method for detecting human face; Such as the technical scheme that on 06 28th, 2006 disclosed application numbers is 200510135668.8 patented claim; It has disclosed the real-time detection and the method and system that continue to follow the tracks of of people's face in a kind of video sequence; The technical scheme that is the patented claim of 200610113423.X on 03 07th, 2007 disclosed application number for another example, it has disclosed the detection of a kind of colourful attitude people's face and tracing system and method.
Here brief account once number of patent application be that a kind of colourful attitude people's face that 200610113423.X discloses detects and method for tracing, it comprises:
(1) through people's face sample training, obtain the positive and half side-view detection model of people's face respectively, and definite AAM faceform;
(2) utilize the positive and half side-view detection model of said people's face, inputted video image is carried out people's face detect, confirm whether there is people's face in the two field picture;
(3) if in certain two field picture, detect people's face, then in subsequent frame, follow the trail of and verify this people's face, comprise step:
(31) the people's face position in the tracking former frame image, the preliminary position of people's face in the acquisition present frame;
(32) with the preliminary position of said acquisition as initial value, utilize the colourity difference of present frame and former frame image, calculate the point-to-point speed of people's face;
(33) according to said point-to-point speed, estimate the Position Approximate of people's face in the present frame, and utilize positive surface model of said people's face and half side-view detection model, near this position, detect, to verify this people's face;
(34) if near this position, detect people's face, then checking is passed through, and adopts described AAM faceform to calculate the affined transformation coefficient when forefathers' face, obtains the characteristic parameter of present frame people face.
In conjunction with the present invention; Video analysis device 30 also need be carried out people's face sample training in advance, obtains the positive and half side-view detection model of people's face respectively, and definite AAM faceform; Concrete process can be identical with this documents, also can adopt existing other training tools.Then, in step 2) in video analysis device 30 utilize said people's face positive with the half side-view detection model, video acquisition device 20 inputted video image are carried out people's face detect; Confirm whether there is people's face in the two field picture, afterwards, if video analysis device 30 detects people's face in certain two field picture; Then in subsequent frame, follow the trail of and verify this people's face; After checking is passed through, can confirm that then video analysis device 30 has detected people's face, the people that detected people's face is corresponding regards as the spectators that watch visual information; Accordingly, can be with that two field picture time corresponding point the going out now after verifying as people's face.At last, proceed step 3) and continue this people's face is followed the tracks of, do not pass through, will not verify that two field picture time corresponding point of passing through as the disappearance of people's face constantly this moment up to checking.In a preferred embodiment, after detecting people's face and continuing the tracking verification scheduled duration just with spectators initial watch constantly with spectators stop to watch entry information save set 40 constantly, scheduled duration can be 2-5 second or other setting durations.Such as camera is that 24 frames/second beats is taken the photograph, and said video analysis device 30 detects and authenticates to after someone's face, just writes down current time and frame number, and for example 2007.1.1.08:45:21.14 representes the 14th frame in 8: 45: 21 morning of 1 month 1 day July in 2007.In each follow-up frame, this people's face is followed the tracks of, till it disappears, and the time when writing down this front face and disappearing; 2007.1.1.08:46:08.20 for example, like this, to everyone face; We can obtain its time of occurrence and die-out time; For example, someone's face: (2007.1.1.08:45:21.14,2007.1.1.08:46:08.20).
In a preferred embodiment; Video analysis device 30 is after detecting people's face; Also need carry out sight line and judge, sight line pointed to people's face of visual information and regarded as the spectators that watch visual information detected people's face, so corresponding; Point to according to sight line visual information people's face go out to confirm now to watch the initial of spectators of visual information to watch constantly; Point to according to sight line visual information people's face disappearance constantly, confirm to watch visual information spectators stop to watch constantly, the result who analyzes like this is more accurately.It is 200510077043.0 patented claim that concrete sight line decision method please refer to the application number that is disclosed on November 13rd, 2005, and it discloses a kind of method and apparatus of differentiating direction of visual lines, has just repeated no more here.
Said visual media 10 carries one or several visual informations successively; Can all distribute a well-determined sign for each visual information; Said information storage apparatus 40 is also preserved the initial moment and the finish time that sign and this visual information of each visual information of visual media 10 its carryings occur; Such as 3 video ads of special television meeting loop play in the building, be respectively Sprite advertisement, Cherry's automotive advertising and unified green tea advertisement, its sign can be respectively so: 01 represents the Sprite advertisement; 02 represents Cherry's automotive advertising; The unified green tea advertisement of 03 representative can certainly come when making a check mark, as long as this sign can uniquely be confirmed this then advertisement with A, B, C.In addition, also need preserve the initial moment and the finish time that this visual information occurs, such as 01; 2007.7.2.9:00:00-9:03:00,2007.7.2.9:30:30-9:33:30 ...; This means that the Sprite advertisement began to play in o'clock sharp 2 days 9 July in 2007; To whole finishes 9: 03 on the 2nd July in 2007, begin to play 9: 30: 30 on the 2nd July in 2007 again then, to finishes 9: 33: 30 on the 2nd July in 2007.In certain embodiments, several visual medias 10 can be arranged, so can be for each visual media 10 all distribute a well-determined sign, the sign that said information storage apparatus 40 is preserved each visual media.Such as ten special televisions that have in: the building, their sign can be respectively so: 001 represents that of one deck, and 002 represents that of two layers, and 003 represents that of three layers ..., can certainly identify with other codes.Like this; The information storage apparatus information recorded has just comprised the sign of each visual media, the sign of each visual information in each visual media and the initial moment and the finish time that this visual information occurs; Whereby, we just can understand the visual information that arbitrary visual media carries at any time.
As previously mentioned; Having write down the initial of spectators of watching visual information in the information storage apparatus 10 watches the moment and stops to watch constantly; Because said video acquisition device 20 is supporting settings with visual media 10, so said spectators' initial watching constantly is to being scheduled to visual media with stopping to watch constantly.So far the information that said information storage apparatus is preserved can be organized into following formation: the visual media sign, and the visual information sign, the initial moment and the finish time that visual information occurs, the initial of every spectators watched the moment and stops to watch constantly.Information in the said information storage apparatus can be designated clue with visual media and put in order, and these information that this means visual media sign back are all corresponding to this visual media sign.In addition, information storage apparatus 10 can also be preserved the continuous sequence or the single image of people's face video image of the spectators that watch visual information.
Can know through foregoing description; Visual media audient information feedback system of the present invention is through disposing the video information that corresponding video acquisition device is collected spectators for visual media; We just can note audient's information like this, have realized the feedback of audient's information.Be example also with the special television in the building; We can find each video ads sign of playing on it through the sign of target-specific TV; The initial moment and the finish time that each video ads is play; Every spectators of this target-specific TV initial watched constantly and stops to watch these information that constantly waits, and analyzes us and just can understand each then the watching person-time, tire out own viewing time etc. and can reflect the information of throwing in effect of video ads through own.
The information of preserving in the said information storage apparatus all is a little raw data, we can according to these raw data carry out some sorting-outs in statistics obtain some more intuitively, active data, and then more direct proof is thrown in effect.In a concrete embodiment; See also shown in Figure 2; Said visual media audient information feedback system also comprises the data statistics device, and it carries out data statistics according to the rule of setting to the data of preserving in the information storage apparatus and obtains the data that people relatively pay close attention to.Specifically; The data statistics device counts the watching person-time of predetermined visual information, accumulative total viewing time, average single viewing time, set and watch in the period person-time or set accumulative total viewing time in the period, and these data can be made correct decision-making for people and play very big help.In addition, we can go to set rule ourselves and go to count own needed data.
According to a further aspect in the invention, the present invention also provides a kind of visual media audient information approach, and it provides a kind of effective audient's information feedback mechanism for visual media, thereby makes the input effect of visual information be able to record and feedback.Because visual media audient information approach of the present invention and visual media audient massaging device are roughly the same on principle, for the preamble of getting along well repeats mutually, only are to briefly introduce visual media audient information approach of the present invention here.
Please referring to shown in Figure 4; It shows schematic flow sheet among the embodiment of a kind of visual media audient of the present invention information feedback method; Said visual media is used to carry visual information to be watched for spectators, and it comprises: step 100, gather the spectators' that watch visual information video; Step 200 is analyzed the spectators that watch visual information to determine to the video of gathering; Step 300, record watch the initial of spectators of visual information to watch the moment and stop to watch constantly.
Said visual media can be a video player, and the visual information of its carrying is a video information; Said visual media can be a promotional plate, and the visual information of its carrying is a billboard; Said visual media can be the article display platform, and the visual information of its carrying is a displaying articles; Or said visual media can be shelf, and the visual information of its carrying is a goods.
The visual angle of the video acquisition in the step 100 is towards the visual orientation of visual media, and the visual field of video acquisition covers the part or all of viewing area of visual media.
In a concrete embodiment, step 200 specifically comprises: b1) video of gathering is carried out people's face and detect; B2) detected people's face is corresponding people regards as the spectators that watch visual information; So then be to confirm now to watch the initial of spectators of visual information to watch constantly in the step 300 according to going out of detected people's face, confirm constantly to watch according to the disappearance of detected people's face visual information spectators stop to watch constantly.In a preferred embodiment, step 200 also comprises: b3) detected people's face is carried out sight line and judge, sight line is pointed to people's face of visual information and regarded as the spectators that watch visual information; So then in the step c) be according to sight line point to visual information people's face go out to confirm now to watch the initial of spectators of visual information to watch constantly, the disappearance of pointing to people's face of visual information according to sight line confirm constantly to watch visual information spectators stop to watch constantly.
Visual media carries one or several visual informations successively, for each visual information is all distributed a well-determined sign, also writes down the sign of each visual information that visual media carries and the initial moment and the finish time that this visual information occurs in step 300.Visual media has several, for each visual media all distributes a well-determined sign, in step 300, also writes down the sign of current visual media.In a preferred embodiment, said visual media audient information feedback method also comprises: count and set the watching person-time of visual information, accumulative total viewing time, average single viewing time, set the step of watching in the period person-time or setting accumulative total viewing time in the period according to information recorded in the step 300.
The above is merely preferred embodiment of the present invention, and is in order to restriction the present invention, not all within spirit of the present invention and principle, any modification of being done, is equal to replacement etc., all should be included within protection scope of the present invention.