GB2181627A - Information processing system - Google Patents

Abstract

The system comprises a pictorial image storage unit (10) e.g. a video disc, a screen (22) for displaying images stored in the image storage unit (10) and process control means (16-20) including a microcomputer (16) and floppy disc unit (18), the process control means (16-20) including touch-screen means (14) by which a user may select one of a plurality of specified portions of an image displayed on the screen (10) by pointing towards that portion of the image, alternatively a light pen may be used, the process control means (16-20) controlling subsequent processing in accordance with the portion of the image selected by the user. The invention is particularly applicable to a system in which the stored images include groups, each group having a primary pictorial image and a plurality of secondary pictorial images, the secondary pictorial images consisting of respective sections of the primary image to an enlarged scale e.g. a file of engineering drawings, maps or instructions for a physical task. The process control means (16-20) controls display of the respective secondary image upon selection of a portion of the primary image associated with the respective section. <IMAGE>

Description

SPECIFICATION information processing system The present invention resides in an information processing system. In particularthe system consists at least in part of image retrieval.

The ability to store images on the surface of a disc and subsequently reproduce them using a laser has been known for some time. Reproduction ofthe image is, however, normally carried out in a sequen tial manner so as to produce a picture which changes fasterthan the "flicker rate" of human vision. In such systems interaction between a user and the system is normally only available in the form offast4orward, rewind and pause type facilities. These facilities are activated by operation of corresponding controls on the disc unit or more often by operation of such controls on a separate control unit which transmits appropriate signals to the disc unit. The signal transmission is usually by way of a cable or by infra-red beam.

Information processing systems in the form of micro-computers which can be operated in the so called "touch-screen" mode are known. A user is able to retrieve information using a selection of op tionsfrom subsequentdisplayswith each selection being made by the usertouching a portion ofthe screen assigned to the chosen option. This form of system has been applied to the retrieval of word processing documents which consist of text and which may be supplemented by the addition oftables, for- mulaeorsimplegraphs.

The present invention utilises features of both of the above described and previously known systems and provides a new system which offers remarkable benefits to users of the processing system. The invention is not limited by the above described features.

According to a first aspect ofthe present invention there is provided an information processing system comprising an image storage unit, an image display screen and process control means including means by which a user selects one of a plurality of specified portions of the screen by pointing towards that portion ofthescreen.

Embodiments of the present invention will now be described by way of example only and with reference to the accompanying drawings, in which: Figure 1 is a sketchmatic illustration of the various units used to implement an embodiment of the invention, Figure2 is an illustration of a first menu screen, Figure 3 is an illustration of a second menu screen, Figure4isan illustration of a screen displayinclud ing an engineering drawing, Figure 5 is an illustration of an initial stage of plac ing an order, and Figure 6 is an illustration of a further stage of plac ing an order.

The system includes a video disc player 10, a visual display unit 12 and an infra-red "touch screen" bezel 14. Also included in the illustrated arrangementarea micro-computer 16, a floppy disk drive 18 and a pro grammable switch 20.

The infra-red touch screen bezel 14 contains arrays of infra-red transmitters and detectors and the beams of infra-red radiation transmitted between them dissect the area 30 surrounded by the bezel 14 into a grid. When an object such as afingeris presented in the area 30 surrounded by the bezel 14then certain ones of the beams of infra-red radiation will be interrupted. The absence of a signal at the respective detectors enables the coordinates of the point of presentation of the object to be determined. Thus, if the display presented on screen 22 identifies a number of areas of the display available for selection, processing of information from the bezel 14 enables the system to determine which of the available areas has been selected.Once the area selected has been determined then subsequent displays on the screen 22, and other information processing, can be put into effect in dependence upon the selection made.

Consequently,itisto beunderstoodthatalthough reference is made throughout the following description to a 'touch screen' system and to the user 'touching' the screen, the user does not have to actually touch the screen. The user merely has to insert an object, usually a finger, sufficiently far into the area surrounded by the touch screen bezel so as to inter rupt various ones of the beams of infra-red radiation.

The areas of the display designated as available for selection are referred to herein as selection options.

Output from the video disc 10 is transmitted to the visual display unit 12 for display upon the screen 22 thereof. The touch screen bezel 14 supplies signals via the programmable switch 20 to both the microcomputer 16 and the video disc unit 10. Signals are also supplied from the bezel 14 direct to the floppy disc drive 18. The floppy disc drive 18 is connected to the micro-computer 16 which in turn is connected to the visual display unit 12 by a text syncronization unit 24. Attached to the micro-computer 16 is a printer 26 and preferably also a telecommunications interface 28.

The system can either operate autonomously or can be connected by conventional telecommunications procedures to a central processing facility. Advantages accruing from connection to one form of central processing facility are described below but interconnection with other forms of processing facilities is feasible and can be advantageous.

A detailed example of one application ofthe system will now be given. For the purposes of this example the system is described as applied to veh- icle maintenance industries.

The video disc unit 10 contains a video disc 11 which has recorded thereon copies of engineering or technical drawings relating to the vehicles covered by the system.

The video disc 11 is prepared in a conventional mannerbutwhereasthediscwould normallycon tain sequentialframesfrom afilm, in the present arrangementeachframeconsistsofacopyofanen- gineering drawings. The engineering drawings are stored on the video disc 11 via a photographic stage.

A conventional disc 11 is capable of storing of the order of 55,000 frames per side and this is sufficient to store the majority of the engineering drawings associated with a large commercial aircraft. If the number of frames is insufficientforthe vehicle under investigation or if it desired to change from one vehicle to anotherthen this can be achieved simply by changing the disc. This process may be automated.

Once a system has been activated the user effects a number of menu selections which determines the video disc 11 which is to be interrogated and preferably enables the system to identify a particular portion of the disc. The first choice to be made by the user might be selection ofonefrom a numberofdifferent manufacturers. This is illustrated in Figure 2 of the drawings. The user is prompted to choose a manufacture by a message 32 displayed at the top of the screen 22. Manufacturers names are each displayed on separate areas 34 of the screen 22 and the user makes his selection by touching that area 34 of the screen associated with the required manufacturer.As the user touches the screen 22 the infrared beams in the touch screen bezel 14 are interrup tedandthemicro-computerl6isthereforeableto determine, by coordinates, which ofthe manufacturers has been selected.

Should the user attempt to select an area which is not designated on the screen orshouldtheuser make an ambiguous selection, by touching the boundary between two defined areas, then the micro-computer 16 causes an appropriate error message (not shown) to be displayed across the bottom of the screen 22. Should the user not wish to select a manufacturerthen the operation can be terminated by the user touching the 'Exit' option 36 displayed on the screen. Alternatively, the user touches the 'Confirm' option 38 in orderto confirm his selection and proceed to the next stage.

Once the user has confirmed selection of a par ticular manufacturer the micro-computer 16 retrieves information from the floppy disc so as to present a display on screen 22, as illustrated in Figure 3, listing the vehicle models available from that manufacturer. Again, each separate option is associated with an area 40 of the screen such that the system can determine the selection made from the coordinates ofthe point at which the user touches the screen.As can be seen from Figure 3 the prompt message 32 and confirmation option 38 remain in the same location on the screen 22 as shown in Figure 2. The 'Exit' option 36 is replaced by a 'Previous' option 42 which, if selected returns the user to the previous display.

The selection options 40 designating the vehicle models are however of differentformatand location to the options 34shown in Figure 2. This illustrates that each display may divide the screen 22 into different selection options which can be located on the screen as desired.

Having selected the manufacturer the vehicle model the system requests further classification of the information required. That is, once the model has been selected the nextscreen askstheusertoselect which aspect of the vehicle is to be reviewed. This screen (notshown) may therefore present a list of op tions such as: engine, electrical system, bodywork.

The user makes his selection by touching the respectivearea ofthe screen. The micro-computerdetermines which option has been selected and transmits a signal via the programmable switch 20 such that the main engineering drawing forthe selected sub-system of the chosen vehicle model is displayed on screen 22.

It should be noted that at this stage of system operation the entire display on the screen 22 is generated by the micro-computer 16 using information recorded digitally on a floppy disc mounted in the floppy disc drive 18.

At each stage ofthe progressive selection of a vehicle sub-system one of the areas, shown as 42 in Figures 3 to 6, displayed on the screen makes available the option to return to the previous selection. Once a valid selection has been made then the option chosen is indicated on the screen by the selected option being displayed at an enhanced intensity. The user may confirm the selection by touching the confirmation option, shown as 38 in the drawings, orre- select by touching an alternative from the available options. A separate cancel option may be required in some applications and examples are described below.

The main engineering drawing is displayed on the screen and valid selection coordinates are regulated by the micro-computer in accordance with information concerning the availability of more detailed drawings. That is, those areas of the screen in which are displayed components orsub-assembliesfor which more detailed engineering drawings are available are designated as selection options. The com ponents or sub-assemblies available for selection may be indicated to the user by displaying them with enhanced intensity. Thus, the user simplytouches the area of the screen displaying the component or sub-assemblywhich he wishes to view and from the coordinates derived from the touch screen bezel the micro-computer sends an appropriate signal to the video disc player.The index identifying which frame ofthedischoldswhichtechnical drawings may boa function which is dealt with bythevideo disc player alone or may be a function which is shared between the disc player and the micro-computer.

As the technical drawings progress in showing a smaller number of components to a Iargerscalethe drawings start to include reference lines indicating individual components. This is illustrated in Figure 4 of the drawings. Each reference line 48 is terminated bya reference box or area 50 which on aconventional drawing would contain a reference number. Indeed, the reference number may be retained in the present system although this is not necessary. The reference area 50 is identified by the micro computer 16 as designating a selection option.

Thisenablesan individual componentorsubassembly to be selected to retrieve further information orto initiate further processing, as will be described below.

Each of the engineering drawings stored on the video disc 11 is displayed on the screen 22 together with information supplied from the floppy disc via micro-computer 16. The image of the engineering drawing is supplied in the form of an analogue signal and text information supplied from the floppy disc is in digital form. Consequently, it is desirableforthe system to include the synchronisation unit, shown as unit 24 in Figure 1, in order to synchronisethe display ofthe digital and analogue information.

The above described system provides for image retrieval and can control access to specific drawings to specified persons. The level of access granted to a user may depend upon whether they are involved in research and development work or general maintenance and can also be allocated in accordance with the level of technical skill and training obtained by a part icular person. These details are stored by the microcomputer or bya central processing facilitytowhich it may be connected. The procedure of identifying individual users can be made in any conventional mannerforexample by the insertion of a magnetic card or entry of a password.

It will be appreciated that the system obviates the need for production and storage of multiple copies of engineering drawings on paper and significantly en hances the efficiency of updating drawings and ensuringthatall personnel workfromthe updated drawings. When a drawing is superseded the central processing facility can signal the individual microcomputers to annotate the indexforthe drawing to the effect that the drawings has been superseded.

Thisformofupdatecan be virtually instantaneous.

Each individual system will present a warning message if a user requests access to the superseded drawing. Thewarning can indicatethenatureofthe change or preferably indicate that the drawing is not available and is replaced by a temporary paper copy or is to be found on a replacement disc. Thus the risk of engineers working from drawings which have been superseded can be avoided in a simple and efficient manner. This far surpasses the control available conventionally when manyindividualsarere- sponsiblefor manually replacing copies of drawings printed on paper.

Afurthersignificant benefit of the system accrues from the addition to the above described arrange mentofa facilityfora userto ordercomponentsonce those components have been identified on one of the detailed engineering drawings.

When an engineering drawing having sufficient detail to include the reference lines 48 and reference areas 50 has been selected, the micro-computer 16 adds to the bottom of the display an extra selection option 54 containing the prompt message "Order" as shown in Figure 4. If this option is selected than the micro-computer 16 displays a new image on the screen 22 which requests the basic identification of an orderforthe supply of components. The initial form of the new image is illustrated by Figure 5 ofthe drawings.

It is not, of course, necessaryforthe user to identify his company, branch office orothersuch information since the system will already possess this information from the time that the user activates the system.

The system does however require the entry ofthe order number.

The screen, as illustrated in Figure 5, includes a field 58 which requests entry of a pro-set number of characters next to the prompt 56 "Order No." and beneath this is a display 60 ofthe digits Oto 9from which the user may sequentially compose the order number. It is possibleforthe available charactersto include letters as well as numerical digits and the necessity for this will depend upon the order number nomenclature required by the component manu facturer. Each of the numeric digits 60 is designated ataselection option on the screen andtheusercomposes the order number in the following manner.

The user touches the screen in that section of the area 60 associated with the required digit and the digit is identified by the micro-computer 16 from the coordinates supplied by the touch screen bezel 14. The micro-computer 16 enters the selected digit in the first character position 58 ofthe order number and the system is then ready for the user to selectthe second character ofthe order number. The process is repeated for each character position of the order numberfield until the user selects the confirmation option 38. Should the user enter a digit erroneously the whole of the order numberfield 60 can be in- itialised by selection of the cancel option 62. Simple re-selection of the digit is not possible since the reselection would be treated as entry of the next digit.A function undertaken by the users system and/orthe central processing facility is validation of the order number and this is undertaken before allowing the userto return to the drawing to make his selection of components to be ordered.

Once an order number has been entered, confirmed and validated the display returns to the previous drawing and a component to be ordered is selected. The component is selected by the user touching the reference area 50 at the end of the reference line 48 associated with thecomponentorsub- assembly required. When the selection has been made, and confirmed by the user selecting the confirmation option 38, the micro-computer returns to the display containing the component order information. The display is now updated with the details of the component as illustrated in Figure 6.

Beneath the previously entered order number 58 is now displayed in area 64thetitle of the component selected together with other appropriate information such as "supplied in pairs only", "supplied in units of 10" etc. Beneath the display of this information on the screen is the prompt "Quality", as indicated at 66, together with a specified number of character posi- tions 68 to be entered by the user. The user selects the quantity of the components to be ordered using the digits 60 displayed beneath the prompt 66 in the same manner as described above for entry of the order number. At the bottom of the screen is the standard selection option "previous" and selection ofthis option enables the userto return to the previously displayed drawing so thatfurther components may be ordered, if required. Furthercom- ponents may be ordered in the manner described above or by returning to a preceding drawing and selecting a component shown in more detail on anotherdrawing. Inthiswaytheusermayprogress through a limited number of alternative drawings so as to select further components to be added to the order. The micro-computer or central processing facility controls the associated drawings which may be displayed during the ordering procedure. That is, control is exercised over the type of components which may be included in one particular order.This is especially advantageous where various types of components have to be ordered from different locations or different manufacturers.

Each time an item is to be added to the orderthe user is required to confirmthatthecomponentand quantity as specified are correct before the item is added to the cumulative order. The cancel option 62 is effective at this stage. After completing the selection required forthe orderthe user has the display of the screen showing details ofthe order. The user now has selection options to confirm the order orto exit the order procedure without the order having been placed.

Once the user has confirmed that the order is complete the system takes control of further processing ofthe order. The system includes a local printer 26 and details ofthe order entered by the user are printed out so as to provide a copy either for the user himselforforacentralordercollation officeatthe user's site, or both. It is to be noted that the information printed whilst including the information entered bytheusercan be in any suitable format and can include detailed identification of the components, for example by manufacturers and/or users part number. The printed order can contain details ofthe manufacturerto whom the order should be sent so that a copy ofthe order can be posted to the manufacturer.However, in the preferred arrangement the micro-computer includes the telecommunications unit, shown by reference numeral 28 in Figure 1,and details ofthe order are sent automatically via this conventional telecommunications link into the manufacturers computer system. Thus the order is received automatically and can be dealt with as ap propriate by the manufacturer. This provides op portunities for significantly enhanced efficiency since conventionally the manufacturers staff are likely to enter information sent by post into a computer, with the attendant risk of human error. The printouts both at the user site and the central manufacturers site can include many variations of costing and distribution information, as desired.

Therearefundamental advantages to be gained on the above described system of ordering components. The user is not required to enter the manufacturers part number and is only required to point towards the required component on the screen ofthe visual display unit. Thus, human error in specifying the part number can be elminated.

Furthermore,there is no requirementforthe user to knowthe name of or be ableto spell the name of the component. The user only has to pointtowards the component on the screen ofthe visual display unit. This can be of significant advantage forthe vehicle maintenance industries in particular. Many ofthe maintenance sites will be in parts of the world where a foreign language is used predominantly and in which the workforce may not be sufficiently skilled to enter reliably component names and/or part numbers. Thus the advantage for the component manufacturer or supplies is that they do not have to repro duce their engineering drawings suitably annotated in the different languages.This can represent a sig- nificantsaving in both time and cost. Since the telecommunications link may be interactive it is possible forthe manufacturer to inform the user directly on the screen if a particular component is no longer available, has been replaced, orwill incur an unusually long time for delivery. Itwill be notedthatthe image retrieval system and the component ordering system described above are both operated solely the user printing towards selection options displayed on the screen ofthe visual display unit. There are no keyboard entries to be made by the user.This can be an advantage when the efficiency of keyboard operation by the user is low, and has the distinct advantage that the depressions and recesses of a keyboard, where dirt and grime can accumulate, are obviated as is failure to mechanical fatigue of moving parts.

Afurtherenhancementofthe present system resulting in significant benefits in practice is achieved by including on the video disc a section of normal video recording. This video recording consists of a step by step demonstration of how to carry out a task, such as replacement, associated with a component or sub-assembly selected from an engineering drawings. Where available, when a user has selected a component orsub-assembly by progressive inspection of more detailed drawings, the micro computerdesignatesaselection option on the screen, shown at 52 in Figure 4, which when selected commences the video film associated with the selected component.The video film sequences are only normally available for those components requiring special procedures or skill for their maintenance or replacement, in order to consolidate storage space on the disc. The video film sequence can be used for training personnel as well asforguidanceorrefer- ence undertaking the specified task.

An additional or alternative facility is the provision of a printed list of instructions, possibly including drawings, which can be used as a checklistoftasksto be undertaken. Such a list can be printed on a local printer in response to the selection of an appropriate option on a particular screen display.

The provision ofthe reference or training video sequences can reduce the requirementfor reference and training manuals. This can be particularly signifi cantwherethemanualswould normallyhaveto be translated into a foreign language, since it is usually easierto produce a short video sequence in a foreign language as compared with translation of a reference manual.

The above description is concerned with operation of the system when fully implemented. It will be appreciated that establishing the interrelationship between the different drawings stored on the disc, the order part numbers and sections of video film presents a particularly onerous taks. However, it is possible to use the system itself in orderto establish the interrelationships, and validations required. This is achieved by interactive programming of the microcomputerand use of a "learn by example" technique. In this mode the micro-computer is controlled from a keyboard under a program which prompts the system specialist to enter indexing details of associated drawings, to enter screen coordinates so as to define selection option areas and to define the subsequent processing to be undertaken upon selection of the defined options. This mode of operation enables the system to be established more quickly and efficientlythan would otherwise be possible.

Whilst one embodiment of the invention has been described above in detail, it is to be appreciated that the present invention is not limited to the detail thereof. It is not necessary to restrict the selection of options from the screen to the use of a touch screen bezel. An alternative isto provide a "light penn apparatussothatthe usertouchesthelightpentothe screen in orderto make his selection ratherthan interrupting a grid of infra-red beams. Other variations of the touch screen apparatus are encompassed by the present invention.

Another embodiment of the present invention relates to the use of geographical maps. The frame stored on the disc comprise sections of several maps and includes maps ofthe same area to differing scales. The user selects the geographical area of interestfrom a menu and controls the displayofvarious portions ofthe map by touching selection options available on the screen and designated; North, South, East, West. A selection option is also available on the screen to enable the userto select an area of the mapto be displayed to an enlarged scale. As with the above described embodiment, several levels of information may be provided, that is the user may progress through a number of maps of the same are; but of increasing scale. This arrangement can op eratetogetherwith a digital database in order to provide additional information. For example, once a portion of a map of sufficient detail has been selected then it is possible to make available a selection op tion which lists alphabetically the names ofall ofthe streets shown in the section of the map which is currently displayed. Alternative facilities may also be provided an example being a route planning facility.

Claims (16)

1. An information processing system comprising a pictorial image storage unit, a screen for displaying images stored in the image storage unit and process control means, the process control means including means by which a user may select one of a plurality of specified portions of an image displayed on the screen by pointing towards that portion of the image, the process control means controlling subsequent processing in accordance with the portion of the image selected bythe user.

2. An information processing system as claimed in Claim 1, wherein the image stored in the image storage unit include at least one group of images comprising a primary pictorial image and a plurality of secondary pictorial images, the secondary pictorial images consisting of respective sections of the primary imageto an enlarged scale and wherein the process control means controls display of re- spective secondary image upon selection of a por tion ofthe primary image associated with the re spective section.

3. An information processing system as claimed in claim 1 or 2,wherein the image storage unitcom- prises one or more disks and an optical read-out system.

4. An information processing system as claimed in any preceding claim, further comprising a magnetic storage medium which carries information to be displayed on the screen so asto specify portions of the screen which may be selected.

5. An information processing system as claimed in claims 2 and 4, in which a plurality of groups of images are stored in the image storage unit and wherein the process control means controls display of information from the magnetic storage medium so as to enable selection and display of any of the primary pictorial images.

6. An information processing system as claimed in any preceding claim, wherein the images stored in the image storage unit include at least one sequence of images which illustrate subsequent stages in the execution of a physical task and wherein the process control means initiates displayofthesequenceofim- ages upon selection of the first image of the sequence.

7. An information processing system as claimed in any preceding claim, further comprising a printer, the process control means effecting the printing of information associated with a displayed image upon selection of a specific portion of the image, that portion being annotated as a printfacility.

8. An information processing system as claimed in claim 4, wherein the pictorial images are engineering drawings and upon selection of one of the specified portions, the process control means effects the display of an order form upon the screen together with an image of a key board on which the characters are respective specified portions, selection of which causes entries to be made on the displayed order form.

9. An information processing system as claimed in claim 8,wherein detailsofacomponentto beordered are entered on the displayed order form auto maticallyuponselectionsubsequenttodisplayofthe order form of a specified portion of the image depicting the component.

10. An information processing system as claimed in claim 8or9, further comprising a printer, the process control means effecting printing of an order form completed upon the screen upon selection of a specified portion annotated asa printfacility.

11. An information processing system as claimed in claim 8 or9, further comprising a telecommunications unitforconnecting the information processing system to a system capable of receiving and verifying the details of the order.

12. An information processing system as claimed in claim 2, wherein the process control means com prises programming means which enable re- lationship between the pictorial images of a group to be recorded together which the location of respective portions of the primary image by pointing towards the portions to be specified.

13. An information processing system as claimed in claim 2, wherein the pictorial images are maps and the process control means includes data processing means which can determine and display an optimised route between two locations specified on the imagebytheuserpointingtowardsthetwoloca- tions.

14. An information processing system as claimed in claim 2, wherein the pictorial images are maps and the process control means includes a data base of road names stored in accordance with the image or images in which they are shown.

15. An information processing system as claimed in claim 2, wherein the pictorial images are maps and the process control means include data processing means and magnetic storage means capable of re ceivingfrom the screen data identifying a particular location within any specified pictorial image and storing the data for subsequent display.

16. An information processing system substantially as hereinbefore described with reference to and as illustrated in the accompanying drawings.