CA2316627A1 - Digital image processing system - Google Patents

Digital image processing system Download PDF

Info

Publication number
CA2316627A1
CA2316627A1 CA 2316627 CA2316627A CA2316627A1 CA 2316627 A1 CA2316627 A1 CA 2316627A1 CA 2316627 CA2316627 CA 2316627 CA 2316627 A CA2316627 A CA 2316627A CA 2316627 A1 CA2316627 A1 CA 2316627A1
Authority
CA
Canada
Prior art keywords
image processing
image
processing system
unit
text elements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA 2316627
Other languages
French (fr)
Inventor
Rene Seeber
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cobion AG
Original Assignee
Only Solutions Gmbh
Rene Seeber
Cobion Gmbh
Cobion Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Only Solutions Gmbh, Rene Seeber, Cobion Gmbh, Cobion Ag filed Critical Only Solutions Gmbh
Publication of CA2316627A1 publication Critical patent/CA2316627A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Machine Translation (AREA)
  • Document Processing Apparatus (AREA)

Abstract

A digital image processing system for processing and optionally reproducing images with graphic and original text elements is described. The image processing system includes a digital image source (1), an image reproduction controller (5) and an image processing device (3) connected between the two. According to the invention the image processing system is provided with an image processing unit (11) adapted to provide translations of the original text elements in another language, comprising a text recognition unit (17) and a text translation unit (18).

Description

Di~ita.l Image ProcessingSystem This invention relates to a digital image processing system of the kind specified in the pre-characterizing part of claim 1.
In one known image processing system of this kind (DE 197 16 449 Al) images supplied from a digital image source, such as a digital camera for example, are edited by means of a signal processing device, which consists for example of a digital signal processor (DSP). The resulting signals are then fed to an image reproduction controller, which is equipped with the necessary digital drivers, modulators or the like for example, and are passed thence to an image reproduction device for display of the images, such as the display of a digital camcorder or of a digital photo camera, a television screen for example or any other kind of suitable display.
While images which consist solely of graphic elements can readily be com-prehended and assimilated by observers, there are always problems when the images also contain text elements which appear in a language unlolown to the observer. The observer then has to translate individual text elements with the aid of dictionaries or the like.
However, this is not always possible and not always possible with the desired accuracy, because the necessary dictionaries are mostly not available or the inserted text elements disappear too quickly again with motion pictures.
The invention is therefore based on the object of so designing the image processing system of the kind initially specified that the observer of the images can inform himself comparatively simply and quickly of the contents of the text elements.
The characterizing features of claim 1 serve to meet this object.
The image processing system according to the invention can be provided in different versions in relation to the time and placement of the representation of the translated text elements. In relation to time a first but expensive possibility is to make the text elements, translated in a perdetermined or even selected language, available live, i.e.
in real time. Where this is not necessary or is undesirable for reasons of cost, it is possible in a second variant to let the translation appear at a later point in time and when called up by the user. On the other hand in the positional respect it is possible for example to let the translated text elements appear in place of the original text elements; to show the original text elements together with merged in translated text elements or to arrange the translated text elements in a totally different position of the picture, while the non-trans-lated original text elements are provided with a reference to the translated text elements (and/or vice versa) for example.
Further advantageous features of the invention appear from the dependent claims.
The invention will now be explained in more detail in conjunction with the accompanying drawings of an embodiment, wherein:
Fig. 1 is a functional block diagram of an image processing system with an image processing unit according to the invention and Fig. 2 shows a schematic and abbreviated flow diagram of a microcomputer program controlling the image processing unit according to Fig. 1.
According to Fig. 1 an image processing system comprises a digital image source 1, to which an image processing device 3 is connected through a line 2.
The image signal output of the image processing device 3 passes through a line 4 to an image reproduction controller 5, which is equipped with all necessary drivers, modulators, or the like, in order to be able to feed the images provided from the image source 1 through a line 6 to at least one selected image reproducing device 7 and show it on its screen. A
control device 8 is also provided, which is connected through lines 9 and 10 to the image processing device 3 and the image reproduction controller 5 respectively.
Image processing systems of this kind are generally known (e.g. DE 197 16 449 A1) and therefore do not need to be described in more detail to the man skilled in the art. The way in which such an image processing system functions is essentially as follows:
The digital image source 1 provides digital images and consists of a digital image receiver (CCD sensor) or a digital storage medium for example.
Alternatively it can receive digital images from an external source or a system as e.g. the Internet, to which the image processing system is subordinated. The digital images are fed over the line 2 to the image processing device 3, which includes at least one microcomputer in the form of a fast digital signal processor (DSP) and a memory unit. The images are edited here and various functions can be controlled or affected with the aid of the control device 8, as is known for example from image processing system in the form of digital photo or video cameras (camcorders), digital television sets and video conferencing systems with digital image processing or also from computer programs, which process digital images and display them on a screen. In particular, with the aid of microcomputer technique, complex operations, such as image corrections, still pictures, adjustment of brightness, image storing, special image reproduction or the like for example can be managed, as well as simpler commands such as "start", "stop", "record" or the like. This is independent of whether the image source 1 involves for example a digital camera additionally provided with suitable optics for individual pictures or motion pictures or whether the digital image source 1 derives the images from say a video playback apparatus.
The image signals obtained in the image processing device 3 are fed to the image reproducing controller 5 and processed in this for reproduction on a screen of the image reproducing device 7 for example. Various functions can again be affected by means of the control device 8, such as the image enlargement or reduction for example.
Examples of the image reproducing device 7 in addition to normal digital screens or displays are also means for further processing of images accessible through external terminals, e.g. apparatuses for editing control or for subsequent composition wherein the image reproducing controller 5 can have a video terminal and/or an interface for a computer for example.
The described image processing systems frequently furnish images which include pure text elements in at least one predetermined language as well as pure graphic elements, or graphic elements combined with such text elements, such as is generally known in advertising for example. In order to make such text elements generally readable, for people not being familiar with the predetermined language(s), the image processing system according to the invention comprises an image processing unit 11 in addition to the described devices and integrated into the system, having an input 12 which is connected to an output of the image processing device 3 formed by the line 4 for example, and an output 14 connected to the image reproduction controller 5. The image processing unit 11 has the purpose of and is arranged to translate the original text elements which are contained in the images provided by the image source 1 into a language which is different from the language in which they are provided. This leads to the possibility of converting the original text elements into translated text elements, which are translated into an arbitrary language known to the user of the image processing system of of ?????
The image processing unit 11 according to the invention preferably includes a separate module in the form of an image editing unit 15 which is connected tQ
the image processing device 3 and the image reproduction controller 5 and receives the digital image from the image processing device 3, organises the digital image into individual image points (pixels) arranged in a coordinate system for example and thereby puts the image data into a format suitable for text recognition. If the image data from the image source 1 or from the image processing device 3 is already in a format with this organisation, the formatting can be omitted. Moreover the image editing unit 15 can also be in the form of a component of the image processing device 3 and be present in this as an additional program module for example, so that a run program stored therein runs automatically with the operation image processing device 3 and supplies the necessary data to the image processing unit 11. The whole image processing unit 11 could equally be integrated in the image processing device 3, in which the blocks 15, 17 and 18 are implemented as individual program modules for example.
The image editing unit 15 passes the digital images through a line 16 to a text recognition unit 17, which searches for and recognises all relevant text and characters within the image, forming the original text elements contained in the digital images, transforming these elements into a computer language or character code (e.g.
ASCII code) and outputs these optionally with information on the coordinates and sizes of those regions in which the original text elements were recognised.
Known text recognition modules can be used as the text recognition unit 17, as manufactured and marketed for example by the company Caere Corp., Los Gatos, California, USA or under the name "Textbridge" by the company Xerox Corp., Roche-ster, N.Y., USA. Such text recognition modules are particularly adapted to finding and recognising dark characters on a uniform light background and/or of horizontally aligned text lines, but have previously been used only in conjunction with special written matter scanning and recognition devices. It is customary to find text blocks, to extract individual lines of text from these, then to separate individual written characters and optionally compare them with stored patterns as well as finally to generate the output data. When required it would also be possible for the purposes of the invention to employ special methods for segmenting the images into individual textures, to decide for each individual texture segment whether it concerns a text or a graphic texture, to convert the segments recognised as text textures into image sections with black characters on a light background and to rotate the text lines thus obtained until they are horizontally arranged, before a start is made on the actual character recognition.
The output of the text recognition unit 17 is either passed directly to a text translation unit 18 or through the line 16 to the image editing unit 1 S, in order then to be passed on through a line 19 to the text translation unit 18. The text translation unit 18 is moreover informed by the image editing unit 15 as to the rules with which it should operate and translate.
The image editing unit 15 is moreover connected through a line 20 to the control device 8, by means of which the translation rules can be affected if necessary. It would further be possible to form the text translation unit 18 from at least two sections for translation into different languages and to associate these with a selector switch, in order to be able to select freely the language into which the original text elements should be translated. The data of the translated text elements is fed back to the image editing unit 15 from the text translation unit 18.
The text translation unit 18 is advantageously formed in a manner known per se from dictionaries in digital form, where a corresponding dictionary is associated with each section associated with whatever language. In the simplest case translation is effected word for word, without taking into account the context of the text elements, rules of grammar or the like. In this case a corresponding word into another language is associated with each word recognised in the text recognition unit 17, which is good enough for many applications. Words not present in the dictionary can naturally not be translated.
Text translation units 18 of the kind of interest here are generally known as text translation modules and are available on the market (e.g. Langenscheidt, Hlexaglot) but have previously been used only for totally different applications. Not only the current section or the current language can be selected by the control device 8 but preferably also a selected language can be set permanently.
The image editing unit 15 preferably consists like the image processing device 3 of a microcomputer, which operates in accordance with a predetermined run program.
Such a run program is shown in its simplest variant as a flow diagram in Fig.
2.
The data of the translated text elements supplied in the described manner to the image editing unit 15 and available therein for further use can be fed to the image reproduction controller 5 under the control of the control device 8 and be passed on therefrom to any kind of image editing or image reproducing device. If this consists of an image reproducing device 7 in the form of a television screen or other display, the reproduction of the translated text elements can be effected live, i.e. in real time.
Alternatively a switch can be associated with the image processing unit 11 and pass the translated text elements to the image reproduction controller 5 only when closed and can then for example be actuated by a user of the image processing system only when there is a current requirement.
According to a further embodiment of the invention it is possible to pass the output of the image processing unit 11 through the line 14 to a speech synthesiser, to which a loudspeaker or earphones are connected, in order to make the translated text elements audible as an alternative or in addition.
The representation of the translated text elements can be effected in various ways, for example such that they replace the original text elements, which are removed from the image in this case. Alternatively it would be possible to show the translated text elements directly alongside or above or below the original text elements or at a selected place in the image, e.g. at the bottom edge, and to provide the original text elements with a pointer to the translated text elements (and/or vice versa).
The invention thus provides an image processing system with an automatic translation device integrated therein, for translating text elements contained in the images into a different language, wherein the translated text elements are made available selecti-vely for representation together with the original text elements or for further processing in any way whatsoever. This is achieved in that a recognition and translation of text elements is undertaken in parallel with the image data flow at a point of derivation from the image data flow between the image source 1 or the image processing device 3 associated therewith and the image reproduction controller S. The described image processing unit 11 is preferably not only an integral component of the described image processing system but also an integral component of an apparatus equipped with such an image processing system, e.g. a camcorder, a television set or the like.
Alternatively it would also be possible to transmit by radio (wireless) the signals to be processed from the device including the image source 1 or the image processing device 3 to a stationary or mobile processing unit being provided with a computer, to let analyse and translate the text elements by this processing unit and to then transmit back by radio the obtained result, i. e. the translated text elements alone or together with the origignal imgage signals to the device including the image source 1 or the image processing device 3 (or optionally to any other device, respectively). Such applications are particularly useful in combination with mobile radio end devices, digital cameras with mobile radio equipment, mobile digital image processing devices and devices of all kinds for wireless data transmission, particularly mobile telephones (handys) _ 7 _ under use of common telephone exchange (switching) centers (handy networks).
The invention is not limited to the described embodiment, which can be modified in many ways. In particular the image processing system shown with reference to Fig. 1 only represents one embodiment, whose individual components can be changed in numerous ways and be exchanged for others. Also the above description does not represent a restriction of the invention to a particular application. Finally it will be understood that the various features and blocks can be used in combinations other than those shown and described.

Claims (10)

1. A digital image processing system for processing and optionally reproducing images with graphic and original text elements, in at least a first language, comprising a digital image source (1), an image reproduction controller (5) and an image processing device (3) connected between the image source (1) and the image reproduction controller (5), characterized in that it is provided with means for translating the original text elements into a language different from said at least one first language.
2. An image processing system according to claim 1, characterized in that the means include an image processing unit (11) comprising a text recognition unit (17) and a text translation unit (18).
3. An image processing system according to claim 2, characterized in that the image processing unit (11) has an input (12) connected to the image processing device (3) and an output (14) connected to the image reproduction controller (5).
4. An image processing system according to claim 2 or 3, characterized in that the image processing unit (11) comprises an image editing unit (15) which controls the data flow to and from the text recognition and text translations units (17 and 18).
5. An image processing system according to claim 4, characterized in that the image editing unit (15) is in the form of a program module of the image processing device (3).
6. An image processing system according to claim 5, characterized in that the image editing unit (15) is in the form of a separate module of the image processing unit (11).
7. An image processing system according to claim 6, characterized in that the image editing unit (15) is in the form of a microcomputer.
8. An image processing system according to any of claims 1 to 7, characterized in that a switch is associated with the image processing unit (11) for selective representation of the original text elements or of translated text elements.
9. An image processing system according to any of claims 1 to 8, characterized in that the image processing unit (11) is arranged to replace the original text elements by the translated text elements.
10. An image processing system according to any of claims 1 to 9, characterized in that the text translation unit (17) has sections associated with at least two different languages and comprises a selector switch for selecting the language of the translation.
CA 2316627 1999-08-25 2000-08-25 Digital image processing system Abandoned CA2316627A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE1999141123 DE19941123A1 (en) 1999-08-25 1999-08-25 Digital image processing system
DE19941123.9 1999-08-25

Publications (1)

Publication Number Publication Date
CA2316627A1 true CA2316627A1 (en) 2001-02-25

Family

ID=7920096

Family Applications (1)

Application Number Title Priority Date Filing Date
CA 2316627 Abandoned CA2316627A1 (en) 1999-08-25 2000-08-25 Digital image processing system

Country Status (4)

Country Link
EP (1) EP1079331A1 (en)
JP (1) JP2001109750A (en)
CA (1) CA2316627A1 (en)
DE (1) DE19941123A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005106706A2 (en) * 2004-04-27 2005-11-10 Siemens Aktiengesellschaft Method and system for preparing an automatic translation of a text
JP6068566B1 (en) * 2015-07-08 2017-01-25 三菱電機インフォメーションシステムズ株式会社 Image transmission system and image transmission program

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2078423C (en) * 1991-11-19 1997-01-14 Per-Kristian Halvorsen Method and apparatus for supplementing significant portions of a document selected without document image decoding with retrieved information
GB2328770A (en) * 1997-08-30 1999-03-03 E Lead Electronic Co Ltd Camera type electronic language translation system

Also Published As

Publication number Publication date
JP2001109750A (en) 2001-04-20
EP1079331A1 (en) 2001-02-28
DE19941123A1 (en) 2001-03-08

Similar Documents

Publication Publication Date Title
US7469064B2 (en) Image display apparatus
US20050221856A1 (en) Cellular terminal image processing system, cellular terminal, and server
EP1486949A1 (en) Audio video conversion apparatus and method, and audio video conversion program
ATE400968T1 (en) IMAGE OVERLAY CONTROL OF A MOBILE TELECOMMUNICATIONS TERMINAL
EP1117256A4 (en) All-around video output method and device
CN103581566A (en) Image capture method and image capture apparatus
CN101964110B (en) For creating the method and system of image
EP4254973A1 (en) Photographing device and self-adaptive method of software functions and photographing parameters thereof
US6803887B1 (en) Method and corresponding devices for delivering useful data concerning observed objects
JP4192476B2 (en) Video conversion apparatus and video conversion method
KR20030024786A (en) Method and means for mobile capture, processing, storage and transmission of text and mixed information containing characters and images
US10911687B2 (en) Electronic device and method for controlling display of images
CA2316627A1 (en) Digital image processing system
US20020147589A1 (en) Graphic display device with built-in speech recognition function
JP2021044669A (en) Information processing device and program
US4491864A (en) Color separation condition selecting means for a picture scanning and recording machine
JPH08139994A (en) Image synthesis system
EP1453291A2 (en) Digital media frame
CN110134470B (en) Language setting device, language setting method, and display device
JP2899263B2 (en) Computer control method
US20060016890A1 (en) Automatic planar image capture device
EP0533348A2 (en) Apparatus and method for providing and displaying a partially transparent image
JPH10232661A (en) Display device and electronic equipment
JPH10105727A (en) Image processor
KR100247950B1 (en) Television format conversion method of personal computer signal

Legal Events

Date Code Title Description
FZDE Dead