GB2461937A - A method for synchronised measurement of participant responses to stimuli using remote, networked computers - Google Patents

A method for synchronised measurement of participant responses to stimuli using remote, networked computers Download PDF

Info

Publication number
GB2461937A
GB2461937A GB0722492A GB0722492A GB2461937A GB 2461937 A GB2461937 A GB 2461937A GB 0722492 A GB0722492 A GB 0722492A GB 0722492 A GB0722492 A GB 0722492A GB 2461937 A GB2461937 A GB 2461937A
Authority
GB
United Kingdom
Prior art keywords
stimuli
software
computer
computers
responses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB0722492A
Other versions
GB2461937B (en
GB0722492D0 (en
Inventor
Michael David Kirk-Smith
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to GB0722492.6A priority Critical patent/GB2461937B/en
Publication of GB0722492D0 publication Critical patent/GB0722492D0/en
Publication of GB2461937A publication Critical patent/GB2461937A/en
Application granted granted Critical
Publication of GB2461937B publication Critical patent/GB2461937B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0242Determining effectiveness of advertisements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/29Arrangements for monitoring broadcast services or broadcast-related services
    • H04H60/33Arrangements for monitoring the users' behaviour or opinions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/46Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for recognising users' preferences

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Signal Processing (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

An apparatus for transmitting digitised continuous and static stimuli from one computer to remote computers comprises software allowing stimuli to be presented to remote subjects and allowing collection of their synchronised immediate, continuous responses and reflective responses to the stimuli on one or more aspects of judgement; then, these judgements are immediately transmitted to another computer or recorded to a computer data file or files for later transmission, being communicated to the remote computers using input devices. The preferred method of collecting affective responses is through pulling towards / pushing away a computer mouse so that approach (pull) and avoidance (push) motor responses - the basis of affective judgements - are recruited. Computers may be linked via the Internet or an intranet, and mobile phones, personal digital assistants (PDAs) or digital televisions may be used. Other input devices include sliders, joysticks, touch pads / screens or rollerballs. Participants may have visual feedback on their responses, e.g. via a visual vertical linear scale, which may be recorded. Stimuli-judging software may be downloaded to remote computers.

Description

A METHOD OF MEASURING JUDGEMENTS
TECHNICAL FIELD
This invention relates to the remote evaluation of visual and audio stimuli, e.g., advertisements, using computers.
BACKGROUND OF THE INVENTION
Most common methods of measuring human judgements, e.g., affective or intensity responses to stimuli, rely predominantly on the use of the self-report questionnaire or interview. The scales used may be verbal, numeric or graphic. These methods are unsuitable for collecting responses to continuous stimuli such as television advertisements and programmes: 1. If subjects judge a sequence of events as they occur, their attention is necessarily divided between observing the stimuli and completing the questionnaire.
2. If subjects rate such stimuli afterwards by these methods there may be errors in recall due to recency effects. Subjects judgements may be influenced unpredictably by reactions to social aspects of the situation, e.g., "impression management" (e.g., see Kirk-Smith, 1998, for review).
3. Subjects may also be unable to verbalise affective responses since these are primitive responses fundamentally related to approachlavoidance reactions (Zajonc, 1980).
Methods have been devised to counter some of these deficiencies by electronic means.
Several devices involve the collection of responses to stimuli using keypads, e.g., W090/04439 (Vogel), U54764 120 (Griffin), U54234933 (Adelson) and US4905080 (Watanabe).
Although these devices record responses at the same time as the stimuli occur, they use discrete, rather than continuous measures, thus constricting the range of values that can be recorded. The need to move to different keys is also a distraction from the stimulus.
Hughes (1990) describes a portable device in which a single subject turns a dial mounted on a hand-held computer to register and collect judgements. Although less distracting, the continuous measurements collected are not synchronised with either the stimulus (since it is not linked, electronically or otherwise) or with other subjects, since it is a single-user device; nor does it allow rapid analysis of data. FR268 1708 (Dahan) also uses a dial to collect synchronised measurements of several subjects to continuous stimuli.
Affective responses or judgements are fundamentally related to "approach-avoidance" behaviour, i.e., avoiding or pushing away things away that might hurt, and approaching or pulling towards one things that are positive and useful. Thus, affective responses or judgements are most effectively measured by directly related motor responses, i.e., pushing away or pulling towards the judged stimulus (Zajonc, 1981, Zajonc and Markus, 1982).
Therefore, the button pushing or twisting motions used in the above devices do not recruit the approach (pull) and avoidance (push) motor responses relevant to affective judgement.
Baumgartner et al. (1997) describe a device in which subjects move a computer mouse left or right to register their responses to advertisements presented on a TV. However, feedback is given by moving scale on a computer monitor nearby, thus distracting attention.
EP444260 (Skutta) uses a joystick which can employ push and pull movements. However, like FR268 1708 (Dahan), this device is non-portable and requires subjects to be present at a fixed testing location.
Kirk-Smith and Donnelly (1993) describe a portable device in which subjects push or pull a computer mouse to register their immediate affective responses in synchrony with the stimuli, with the position of the mouse being recorded by the computer representing the judgement. Visual feedback is provided by on-screen overlays or by a line of LEDS alongside the screen. This device is for single subject use alone, thus slowing data acquisition across a sample.
GB 2286280 (Kirk-Smith) brings together several aspects of the above devices in a portable device which allows real-time synchronised recording of affective judgements of continuous stimuli by a group of people. This is achieved by each subject registering their responses by moving a linear control back and forth. A computer records the position of each linear control from the start of a stimulus, so that the groups scores can be later displayed at each instant across the duration of the stimulus.
DISADVANTAGES OF CURRENT METHODS
These devices require subjects to be present at the point of data collection, and at the same time. They also use input devices and stimuli that are not easily changeable. These aspects create economic and practical problems: 1. Bringing groups of people together at the same time is time consuming.
2. The groups of people to be tested may be living at a place remote from the testing organisations place of business.
3. Individual testing allows the individual to control the judgement process and stimulus presentation as desired (e.g., to stop playback of the stimulus or repeat the stimulus), but is expensive. Group testing is economic, but is less flexibility since group members cannot influence the judgement process.
4. The stimuli are presented in a form that does not allow rapid changes to the stimuli in response to a subjects judgements, or allow the subject to manipulate the image.
5. The methods of rating are hard-wired, i.e., it is not easy to change keypads and joysticks to alternative input and rating methods. These may be required within a testing session for different types of measures and stimuli.
DEFINITION OF THE INVENTION
According to the present invention, there is provided a system for transmitting digitised continuous and static stimuli from one computer to remote computers by a means of transferring data, with software allowing the stimuli to be presented to subjects at the remote computers and allowing collection of the subjects' synchronised immediate, continuous responses to the stimuli and reflective responses to the presented stimuli on one or more aspects of judgement and allowing these judgements in digital form to be immediately transmitted to another computer or to be recorded to a computer data file or files for later transmission, these judgements being communicated to the remote computers using input devices.
DETAILED DESCRIPTION OF THE INVENTION
The system comprises hardware and a suite of computer programmes ("the software"). The hardware comprises an originating computer, remote computers with input devices and the means of transferring data.. The software governs the transmission and presentation of stimuli, and the collection and transmission of judgements and their analysis.
The preferred computers, i.e., devices with central processing units for digital data and the means for inputting and displaying data, are personal microcomputers, digital televisions with associated input devices and digital telephones with display screens (e.g., WAP phones).
The preferred input devices for subjects' responses are the computer mouse or keyboard, although other devices such as joystick, dials, linear controls, keypads, rollerballs and touchpads may be employed, and which may be incorporated in the keyboard.
The preferred means of transmission is the Internet and the world wide web via telephone, cable or wireless networks, both terrestrial and satellite. However, comparable systems which allow distribution and collection of digital data to the preferred computers, as described in the Definition, may be also employed, e.g., in digital television and telephone systems which do not use the Internet or the world wide web to transmit digital data.
For example, broad bandwidth Internet connections (e.g., Asymmetric Digital Subscriber Line (ADSL) allow distributed transmission of high volumes of digital data via packet switching from one computer to many others. Thus, digitised audio and moving visual data, either recorded, e.g., from films and video, or live from video cameras as in "webcams" can be compressed in various formats (e.g., as mov, avi, or MPEG; way or MP3 files) and transmitted from one computer, possibly via the internet, and simultaneously received and displayed by remote computers. Similarly, the receivers of these digitised audio or visual data can send digitised data to the originating or other computers. Slower connections may require the digitised stimuli to be first stored and then presented for judgement.
The software used to transmit and collect data allows the following: 1. For the software used for judging the stimuli to be downloaded from the means of transmitting data and installed onto the remote computers. This may be done in advance or with the stimuli. It may also be installed via CD or other portable media.
2. For the transmitted digitised data to be judged as they are received, or stored for later judgement at the remote computers.
3. For the judgement data to be transmitted at the same time, or stored for later transmission, to the originating or other computer.
The software used to present the digitised data on the remote computers allows subjects or programming to control stimulus presentation in various ways: 1 Start, stop, rewind, fast forward and repeat the stimuli.
2 Change the size, brightness, contrast and colouring and other characteristics of visual stimuli.
3 Change the volume, tone and stereo balance and other characteristics of audio stimuli.
4 Stimuli may be manipulated in three dimensions so that objects may be viewed and judged from different perspectives.
Combinations of stimuli may be presented in parallel (i.e., different audio stimuli with a visual stimulus and vice-versa; or split screen presentation of different visual stimuli for comparison) or in sequence.
The software used to collect judgements allows the subjects responses to be cued by visual elements on the screen which represent the methods of judgement required. Combinations of methods of judgemnent, such as the following, can be selected according to the specific task and stimuli: 1 Subjects can give their immediate responses to stimuli on affective terms such as "Like-dislike", "Interesting-boring" "Believable-unbelievable" by moving a mouse (or other continuous input device) with feedback being given by on-screen moving bar or thermometer-like scales. Intensity judgements similarly be given.
2 Mouse clicks or keystrokes may be used by subjects during stimulus presentation to give indication of when certain events occur, or when changes are perceived in the stimuli.
3 At any time, conventional market research scales may be presented (e.g., numerical, semantic differential, analogue, Likert or magnitude estimation scales) to collect responses to the stimuli or information about the subject (e.g., demographic, attitudinal or mood-related). Responses may be entered by mouse, keyboard or other input device. Free responses may be cued and collected by an on-screen notepad or recorded via microphone.
Questionnaire and free responses may be collected before, after or during stimulus presentation. During presentation, stimuli can be stopped by a mouse click or keyboard by the subject or by the software. Subjects might be also instructed to move the mouse to part of the screen, e.g., to judge the ergonomic aspects of a presented product or disliked parts of the display.
Other functions which the software allows are: 1 A subject's responses to stimuli to be monitored by the software and used to determine what is presented next or what tasks are required to be done next by the subject.
2 Responses to be transmitted to another computer, so that a researcher may remotely instruct either the subject or the software as to the next action to be taken.
3 Remote computers can be networked, for example, via the internet, for discussion between subjects and researchers by video or audio conferencing after the stimuli have been shown.
At the computer collecting the judgement data, the software allows judgements from remote computers to be identified by source, collated, analysed and displayed. As described above, the software allows judgement data to be monitored in real-time and instructions to be sent to the software on the remote computer or the subjects.
ADVANTAGES
The control of digitised stimuli by the software described above gives more flexibility than the current methods, which rely on videotaped stimuli. However, the main advantages are economic and practical: 1 Stimuli can be delivered for evaluation to subjects' locations or homes across the world at minimal cost: For example, advertisements (or product concepts) may be sent to selected market segments for evaluation, e.g., a US firm could send a product concept or advertisment to urban middle-class communities in Germany or a music video to teenage children in Paris for evaluation. This may be compared with the current method of getting groups of people together or going to them and then bringing them together for testing; the cost of which is likely to preclude the examples just given.
2 Many can be tested: For example, the internet allows judging software and digitised advertisements to be distributed to many people, and their judgements collected for analysis. Large samples and many market segments can be tested in many countries in minimal time and cost. No-one need travel from the distributing site. This may be compared with the cost, inefficiency and inaccuracy of current group testing, where perhaps 16 people are tested at a time, and much travelling and coordination has to be done.
3 Ecologically validity: For example, people can rate the stimuli in their normal home environments -where they are usually likely to encounter them. Therefore, their reactions are likely to be realistic and thus accurate and generalisable. Compare this with the artificial situations of current testing methods, where people are often brought into new places and unknown rooms and questioned with other unknown people by unknown people.
EXAMPLES
FIGURE 1 shows the linkage of originating and remote computers with alternate means of internet connection.
FIGURE 2 shows an example screen with stimulus and rating scale for use with a mouse as input device.
FIGURE 3 shows an example screen with a questionnaire presented when the stimulus is stopped by mouse or keystroke.
FiGURE 4 shows the changing usefulness' judgments of 40 subjects using a mouse to rate two advertisements after a gap of 11 months.
FIGURE 5 shows the "interest" judgments of 60 subjects using a mouse to rate four advertisements.
FIGURE 6 shows the "belief" of youths using a mouse to rate an anti-terrorist advertisement in comparison to two others.
REFERENCES
Adelson, A.M. et al. (1978) Electrical game, polling and testing apparatus. US 4234933.
Dahan, G. (1991) Dispositif de saisie en temps reel et de traitement des reactions d'au moms un groupe de personnes. FR 2681708.
Griffin, B.J. et al. (1986) Student response system. US 4764120.
Hughes GD, Studies in imagery, styles of processing, and parallel processing need realtime response measures, Advances in Consumer Research, Vol.XVII, 461-466, 1990.
Kirk-Smith, M. (1998) An apparatus to measure judgements. GB 2286280.
Kirk-Smith, M. (1998) Psychological issues in questionnaire-based research. The Journal of the Market Research Society, 40 (3), 223-236.
Kirk-Smith, M.D. and Donnelly, F. (1993) Apparatus for the measurement of real-time affect. Abstracts of the British Psychological Society London Conference. BPS, Leicester.
Skutta. H. (1990) Vorrichtung zur ermittlung der zuschauerrreaktionen auf eine videospot.
EP 444260.
Vogel, P.S. (1989) Audience response system. WO 90/004439, PCT/AU89/00457 Watanabe, F. et a!. (1987) Apparatus for collection television channel data and market research data. US 4905080.
Zajonc RB, Feeling and thinking: Preferences need no inferences, American Psychologist, v.35, 151-175, 1980.
Zajonc RB and Markus H, Affective and Cognitive Factors in Preferences, J.Consumer Research, 9(2), 123-132, Sept. 1982.

Claims (1)

  1. CLAIMSI An apparatus for transmitting digitised continuous and static stimuli from uii computer to remote computers by a means of transferring data, with software allowing the stimuli to be presented to participants at the remote computers and allowing collection of the participants' synchronised immediate, continuous responses to the stimuli and reflective responses to the presented stimuli on one or more aspects ofjudgement and allowing these judgements in digital form to be immediately transmitted to another computer or to be recorded to a computer data file or files for later transmission, these judgements being communicated to the remote computers using input devices.MEANS OF TRANSMISSION
    2 An apparatus as claimed in Claim I wherein the computers are linked via the internet using telephone, cable or wireless networks, both terrestrial and satellite.
    3 An apparatus as claimed in Claim 1 wherein the computers are linked in a restricted computer network, e.g., an "intranet".
    4 An apparatus as claimed in Claim I wherein the computers use the software and protocols of the world wide web.TYPES OF COMPUTERS
    An apparatus as claimed in Claim 1 wherein the computers are microprocessor based.
    6 An apparatus as claimed in Claim 5 wherein the computers are personal computers,fixed or portable.
    7 An apparatus as claimed in Claim 5 wherein the computers are mobile phones.
    8 An apparatus as claimed in Claim 5 wherein the computers are personal digital assistants (PDA), e.g., the Blackbeny. * S S
    9 An apparatus as claimed in Claim 5 wherein the computers are digital televisions. *.**
    *:.::* TYPES OF iNPUT DEVICES An apparatus as claimed in Claim I wherein the input devices are computer "mouses". *.**
    11 An apparatus as claimed in Claim 1 wherein the input devices are sliders. **.*.S.
    * 12 An apparatus as claimed in Claim 1 wherein the input devices are joysticks.
    13 An apparatus as claimed in Claim 1 wherein the input devices are touch pads.
    14 An apparatus as claimed in Claim I wherein the input devices are touch screens.
    An apparatus as claimed in Claim I wherein the input devices are rollerballs.
    16 An apparatus as claimed in Claim 1 wherein the input devices are keyboards.MEANS OF PRESENTING
    17 An apparatus as claimed in Claim 1 wherein the means for presenting includes the computer recording a participant's responses.
    18 An apparatus as claimed in Claim 1 wherein the means for presenting includes another computer.
    19 An apparatus as claimed in Claim 1 wherein the means for presenting includes a display screen.
    An apparatus as claimed in Claim 19 wherein the means for presenting includes a computer monitor.
    21 An apparatus as claimed in Claim 19 wherein the means for presenting includes a television.
    22 An apparatus as claimed in Claim 19 wherein the means for presenting includes LCD, TFT or plasma screens.PROVISION OF FEEDBACK
    23 An apparatus as claimed in Claim I wherein the means for presenting provides the participant with feedback on their response through the display of a representation of their judgement provided by the input device, e.g., a visual vertical linear scale.SOFTWARE -TRANSMITTING AND COLLECTING DATA
    24 An apparatus as claimed in Claim 1 wherein the software used to transmit and collect data allows software used for judging the stimuli to be downloaded from the *: means of transmitting data and installed onto the remote computers.
    *: ... 25 An apparatus as claimed in Claim I wherein the software used to transmit and collect data allows the transmitted digitised data to be judged as they are received, or stored for later judgement at the remote computers.
    26 An apparatus as claimed in Claim 1 wherein the software used to transmit and collect data allows the judgement data to be transmitted at the same time, or stored for later transmission, to the originating or other computer.SOFTWARE -PARTICIPANTS' CONTROL OF STIMULI 27 An apparatus as claimed in Claim 1 wherein the input devices can be used by the participants to control and alter the stimuli or continuous actions, e.g., stopping or replaying or changing the physical and sensory characteristics.
    SOFTWARE -DISPLAYING FEEDBACK AND RATING SCALES ON SCREEN
    28 An apparatus according to any of the preceding claims wherein visual elements, such as representations of the methods ofjudgment required and feedback displays created by the participant's computer, are presented on the display screen.
    29 An apparatus according to any of the preceding claims wherein visual elements, such as representations of the methods ofjudgment required and feedback displays created by a linked computer, are presented on the display screen.
    An apparatus as claimed in Claim 28 and Claim 29 wherein the input devices may be used by the participants to alter the form and position of the visual elements.
    31 An apparatus as claimed in Claim 28 and Claim 29 wherein the altered form and position of the visual elements may be recorded.OTHER SOFTWARE FUNCTIONS
    32 An apparatus as claimed in Claim 1 wherein a participant's responses to stimuli may be monitored by the software and used to determine what is presented next or what tasks are required to be done next by the participant.
    33 An apparatus as claimed in Claim 1 wherein software allows a participants' judgement data to be monitored in real-time and instructions to be sent to the software on the remote computer or the participants as to the next action to be taken..
    34 An apparatus as claimed in Claim I wherein remote computers can be networked, for example, via the internet, for discussion between participants and researchers by video or audio conferencing after the stimuli have been presented.An apparatus as claimed in Claim 1 wherein software allows the linked computer collecting the judgement data from remote computers to be identified by source, collated, analysed and displayed. a... * ,, S.a... SOFTWARE -PRESENTING AND ANALYSING RESULTS * S *._ * 36 An apparatus according to any of the preceding claims wherein software allows * . recorded participants' judgements be graphically presented without further processing.37 An apparatus according to any of the preceding claims wherein software allows * recorded participants' judgements to be statistically analysed with further processing.SS.. S. -S
GB0722492.6A 2007-11-16 2007-11-16 A method of measuring judgements Active GB2461937B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB0722492.6A GB2461937B (en) 2007-11-16 2007-11-16 A method of measuring judgements

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB0722492.6A GB2461937B (en) 2007-11-16 2007-11-16 A method of measuring judgements

Publications (3)

Publication Number Publication Date
GB0722492D0 GB0722492D0 (en) 2007-12-27
GB2461937A true GB2461937A (en) 2010-01-27
GB2461937B GB2461937B (en) 2013-03-27

Family

ID=38896411

Family Applications (1)

Application Number Title Priority Date Filing Date
GB0722492.6A Active GB2461937B (en) 2007-11-16 2007-11-16 A method of measuring judgements

Country Status (1)

Country Link
GB (1) GB2461937B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060064342A1 (en) * 2001-06-18 2006-03-23 Quality Resources Worldwide, Llc. Internet based qualitative research method and system and Synchronous and Asynchronous audio and video message board
WO2007035412A2 (en) * 2005-09-16 2007-03-29 Imagini Holdings Limited System and method for response clustering
US20070203426A1 (en) * 2005-10-20 2007-08-30 Kover Arthur J Method and apparatus for obtaining real time emotional response data over a communications network

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4006244A1 (en) * 1990-02-28 1991-08-29 Gfk Ag DEVICE FOR DETERMINING SPECTATOR REACTIONS ON A VIDEO SPOT
GB2286280B (en) * 1994-02-08 1998-08-26 Kirk Smith Michael David An apparatus to measure judgments

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060064342A1 (en) * 2001-06-18 2006-03-23 Quality Resources Worldwide, Llc. Internet based qualitative research method and system and Synchronous and Asynchronous audio and video message board
WO2007035412A2 (en) * 2005-09-16 2007-03-29 Imagini Holdings Limited System and method for response clustering
US20070203426A1 (en) * 2005-10-20 2007-08-30 Kover Arthur J Method and apparatus for obtaining real time emotional response data over a communications network

Also Published As

Publication number Publication date
GB2461937B (en) 2013-03-27
GB0722492D0 (en) 2007-12-27

Similar Documents

Publication Publication Date Title
US7343417B2 (en) System and method for rating media information
Rossetti et al. An assessment of the ecological validity of immersive videos in stated preference surveys
US7899700B2 (en) Method and system for providing multi-dimensional feedback
AU2008204688B2 (en) Participant response system employing graphical response data analysis tool
CN101976519A (en) Multi-picture monitoring system of distributed control system (DCS) simulator of nuclear power station
US20130096985A1 (en) Survey systems and methods useable with mobile devices and media presentation environments
JP2001147944A (en) Feedback method for viewer taste for image in presentation
CN103458267A (en) Video picture quality subjective evaluation method and system
AU2011352069A1 (en) System and method for displaying responses from a plurality of users to an event
Dix et al. Television advertising avoidance: Advancing research methodology
Millard A history of handsets for direct measurement of audience response
CN105933787A (en) Video comment and processing method and device thereof, and server
CN112085984A (en) Intelligent learning device, customized teaching system and method
JP2018067834A (en) Investigation system and investigation method
Abreu et al. A UX evaluation approach for second-screen applications
US6865519B2 (en) Reaction measurement method and system
Burnik et al. Video-based learners’ observed attention estimates for lecture learning gain evaluation
US7512289B2 (en) Apparatus and method for examination of images
KR101126440B1 (en) Reaction information display system and computer readable medium having thereon program for operating the system
CN112565669B (en) Method for measuring attention of participants in network video conference
GB2461937A (en) A method for synchronised measurement of participant responses to stimuli using remote, networked computers
US20060267789A1 (en) Multimedia tour system
CN111028568A (en) VR education equipment
JP2012129760A (en) Content evaluation device and content evaluation method
KR20160111175A (en) Advertising effective analysis apparatus and advertising effective analysis method

Legal Events

Date Code Title Description
AT Applications terminated before publication under section 16(1)
S20A Reinstatement of application (sect. 20a/patents act 1977)

Free format text: REQUEST FOR REINSTATEMENT FILED

Effective date: 20090511

Free format text: REQUEST FOR REINSTATEMENT ALLOWED

Effective date: 20090603

AT Applications terminated before publication under section 16(1)
S20A Reinstatement of application (sect. 20a/patents act 1977)

Free format text: REQUEST FOR REINSTATEMENT FILED

Effective date: 20090916

S20A Reinstatement of application (sect. 20a/patents act 1977)

Free format text: REQUEST FOR REINSTATEMENT ALLOWED

Effective date: 20091106

R108 Alteration of time limits (patents rules 1995)

Free format text: EXTENSION ALLOWED

Effective date: 20130121

Free format text: EXTENSION APPLICATION

Effective date: 20130121