CN111614852A

CN111614852A - Multifunctional machine and image processing method

Info

Publication number: CN111614852A
Application number: CN201910132661.2A
Authority: CN
Inventors: 王凯
Original assignee: Fuji Xerox Industry Development China Co Ltd
Current assignee: Fuji Xerox Industry Development China Co Ltd
Priority date: 2019-02-22
Filing date: 2019-02-22
Publication date: 2020-09-01
Anticipated expiration: 2039-02-22
Also published as: CN111614852B

Abstract

The invention relates to a screen projection display technology, in particular to a multifunctional machine and an image processing method. The multifunctional machine comprises a communication module which is in communication connection with the display device and is used for acquiring the geometric characteristics of the display device; the imaging module is used for acquiring an image of an object to be projected based on the geometric characteristics of the display device; and the processing module is respectively connected with the communication module and the imaging module and is used for converting the image of the object to be projected into a digital image signal and projecting the digital image signal to the display device through the communication module. By adopting the invention, high-quality screen projection display can be carried out aiming at display devices with different sizes and length-width ratios.

Description

Multifunctional machine and image processing method

Technical Field

The invention relates to a screen projection display technology, in particular to a multifunctional machine and an image processing method.

Background

The existing screen projection display technology, such as AIRPLAY, generally intercepts a screen video signal of an object to be projected, and realizes screen projection display by directly amplifying pixel points in an electronic graph.

Because the specific size and length-width ratio of the display device are different, the mode of directly amplifying the pixel points in the electronic graph is easy to generate the problem of image ratio distortion in the screen projection display process, and an image matched with the display device cannot be generated. The amplification of the pixel points can also reduce the definition of the image, and the display effect is poor.

In addition, the existing screen projection display technology projects the screen video signal of the object to be projected directly, and cannot realize the function of broadcasting and displaying to a plurality of display devices simultaneously, and cannot realize the function of automatically erecting the image when the projected image is inclined or reversed.

Therefore, there is a need in the art for an image processing technique to perform high-quality projection display for display devices with different sizes and aspect ratios.

Disclosure of Invention

The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, and is intended to neither identify key or critical elements of all aspects nor delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.

The invention provides a multifunctional machine and an image processing method for high-quality screen projection display of display devices with different sizes and length-width ratios.

The present invention provides the above multifunctional machine, comprising:

the communication module is in communication connection with the display device and is used for acquiring the geometric characteristics of the display device;

the imaging module is used for acquiring an image of an object to be projected based on the geometric characteristics of the display device;

and the processing module is respectively connected with the communication module and the imaging module and is used for converting the image of the object to be projected into a digital image signal and projecting the digital image signal to the display device through the communication module.

Preferably, in the multifunctional machine provided by the present invention, the imaging module may set DPI parameters based on the geometric features of the display device and the geometric features of the object to be projected, so as to acquire an image of the object to be projected.

Preferably, in the above multifunctional machine provided by the present invention, the geometric features of the display device may include a height h1 of the display device and a width w1 of the display device;

the geometrical characteristics of the object to be projected comprise the height h0 of the object to be projected and the width w0 of the object to be projected;

in response to the height h0 of the object to be projected being greater than the width w0 of the object to be projected, the imaging module may set the DPI parameter to be proportional to h1/h 0;

in response to the height h0 of the object to be projected being less than the width w0 of the object to be projected, the imaging module may set the DPI parameter to be proportional to w1/w 0.

Optionally, in the above multifunctional machine provided by the present invention, the imaging module may include a plurality of cameras and a sealed exposure area, and the plurality of cameras may scan the object to be projected placed in the exposure area line by line to obtain an image of the object to be projected.

Optionally, in the multifunctional machine provided by the present invention, the communication module may further be communicatively connected to a text recognition device, and the text recognition device may perform angle deflection on a text image in the digital image signal to recognize text information in the digital image signal, and return a deflection angle when recognition is successful to the multifunctional machine;

the processing module may perform rotation processing on the digital image signal according to the deflection angle to erect the digital image signal.

Preferably, in the multifunctional machine provided by the present invention, the text recognition device may split the digital image signals of a plurality of pages into a plurality of single-page digital image signals for text recognition, and return the text information and the position information of the corresponding text image to the multifunctional machine,

the text information and the position information of the character image are mutually related and projected to the display device along with the digital image signal for retrieval and positioning.

Preferably, in the multi-function machine provided by the present invention, in response to receiving the text message, a translation processing device communicatively connected to the multi-function machine may perform translation processing on the text message and return the translated text message to the multi-function machine; and/or

In response to receiving the text message, a speech processing device communicatively coupled to the multi-function machine may perform speech processing on the text message and return a speech message to the multi-function machine,

in response to receiving the translated text information and/or the voice information, the processing module may associate the text information, the location information of the text image, and the translated text information and/or the voice information and project the associated translated text information and/or the voice information with the digital image signal to the display device to display a translated text and/or voice play link associated with the text information at a corresponding location of the display device.

Optionally, in the multifunctional machine provided by the present invention, the communication module may send identity information of the multifunctional machine to a plurality of display devices;

the display device authorized to pass through can return the address information and the port information thereof to the multifunctional machine so as to form an accessible list on the multifunctional machine;

the multi-function machines may establish the communication connection with the display devices on the accessible list, respectively.

Preferably, in the multifunction machine of the present invention, the communication module may acquire a geometric feature of a display device on the accessible list;

in response to the communication module projecting the digital image signal to the display device, the communication module re-acquiring a geometric feature of another display device on the accessible list;

the multi-function machine may traverse all of the display devices on the accessible list for projection of multiple display devices.

Optionally, in the multifunctional machine provided by the present invention, the display device that is authorized to pass through may return the address information and the ciphertext of the port information to the multifunctional machine, so as to establish the communication connection;

the communication module can project the ciphertext of the digital image signal to the display device to display an image.

Optionally, in the multifunctional machine provided by the present invention, the multifunctional machine may further include:

the human-computer interface is connected with the processing module and is used for realizing human-computer interaction; and/or

A pause module that can pause image projection to a number of display devices in response to receiving a pause instruction.

According to another aspect of the present invention, there is also provided herein an image processing method.

The image processing method provided by the invention comprises the following steps:

acquiring geometric characteristics of a display device;

acquiring an image of an object to be projected based on the geometric features of the display device; and

and converting the image of the object to be projected into a digital image signal, and projecting the digital image signal to the display device.

Preferably, in the above image processing method provided by the present invention, DPI parameters may be set based on the geometric features of the display device and the geometric features of the object to be projected to acquire an image of the object to be projected.

Preferably, in the above image processing method provided by the present invention, the geometric features of the display device may include a height h1 of the display device and a width w1 of the display device;

the geometric features of the object to be projected may include a height h0 of the object to be projected and a width w0 of the object to be projected;

in response to the height h0 of the object to be projected being greater than the width w0 of the object to be projected, the DPI parameter may be set to be proportional to h1/h 0;

in response to the height h0 of the object to be projected being smaller than the width w0 of the object to be projected, the DPI parameter may be set to be proportional to w1/w 0.

Alternatively, in the above image processing method provided by the present invention, the object to be projected placed in the sealed exposure area may be scanned line by line with a plurality of cameras to acquire an image of the object to be projected.

Optionally, in the image processing method provided by the present invention, the method may further include:

performing angle deflection on a character image in the digital image signal to identify text information in the digital image signal and acquiring a deflection angle when the identification is successful; and

and performing rotation processing on the digital image signal according to the deflection angle so as to erect the digital image signal.

Preferably, in the image processing method provided by the present invention, the method may further include:

dividing the digital image signals of a plurality of pages into a plurality of single-page digital image signals for text recognition, and acquiring the text information and the position information of the corresponding character images,

in response to the text information, translating the text information, and acquiring translated text information; and/or

Performing voice processing on the text information in response to obtaining the text information, and obtaining voice information,

in response to obtaining the translated text information and/or the voice information, associating the text information, the position information of the text image, and the translated text information and/or the voice information, and projecting to the display device along with the digital image signal to display a translated text and/or voice playing link associated with the text information at a corresponding position of the display device.

transmitting identity information of the multi-function machine to a plurality of display devices;

authorizing the passing display device to return the address information and the port information of the passing display device to the multifunctional machine so as to form an accessible list on the multifunctional machine; and

and establishing communication connection between the multifunctional machine and the display devices on the accessible list respectively.

obtaining a geometric feature of a display device on the accessible list;

in response to projecting the digital image signal to the display device, reacquiring a geometric feature of another display device on the accessible list; and

traversing all display devices on the accessible list for projection of multiple display devices.

Optionally, in the image processing method provided by the present invention, the display device that is authorized to pass through may return the address information and the ciphertext of the port information to the multifunctional machine, so as to establish the communication connection;

the ciphertext of the digital image signal may also be projected to the display device for display of an image.

performing human-computer interaction through a human-computer interaction interface; and/or

In response to receiving the suspension instruction, image projection to the plurality of display devices is suspended.

Drawings

The above features and advantages of the present disclosure will be better understood upon reading the detailed description of embodiments of the disclosure in conjunction with the following drawings. In the drawings, components are not necessarily drawn to scale, and components having similar relative characteristics or features may have the same or similar reference numerals.

Fig. 1 is a schematic structural diagram of a projection display performed by a multifunctional machine according to an embodiment of the present invention.

Fig. 2 is a schematic structural diagram of a multi-function machine for performing screen projection display of multiple display devices according to an embodiment of the present invention.

Fig. 3 is a flowchart illustrating an image processing method according to an embodiment of the present invention.

Reference numerals

100 multifunctional machine;

101 a communication module;

102 an imaging module;

103 a processing module;

104 a human-machine interface;

110 a display device;

111 a communication module;

112 a storage module;

113 a processing module;

114 a human-machine interface;

120 is externally connected with a server;

121 a communication module;

122 a storage module;

123 a processing module;

130-132 display device;

140 and 142 external server;

301-303 image processing method.

Detailed Description

The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure. While the invention will be described in connection with the preferred embodiments, there is no intent to limit its features to those embodiments. On the contrary, the invention is described in connection with the embodiments for the purpose of covering alternatives or modifications that may be extended based on the claims of the present invention. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. The invention may be practiced without these particulars. Moreover, some of the specific details have been left out of the description in order to avoid obscuring or obscuring the focus of the present invention.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

Additionally, the terms "upper," "lower," "left," "right," "top," "bottom," "horizontal," "vertical" and the like as used in the following description are to be understood as referring to the segment and the associated drawings in the illustrated orientation. The relative terms are used for convenience of description only and do not imply that the described apparatus should be constructed or operated in a particular orientation and therefore should not be construed as limiting the invention.

It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, regions, layers and/or sections, these elements, regions, layers and/or sections should not be limited by these terms, but rather are used to distinguish one element, region, layer and/or section from another element, region, layer and/or section. Thus, a first component, region, layer or section discussed below could be termed a second component, region, layer or section without departing from some embodiments of the present invention.

The invention provides an embodiment of a multifunctional machine and an embodiment of an image processing method, which aim to perform high-quality screen projection display aiming at display devices with different sizes and length-width ratios.

As shown in fig. 1, the multifunctional machine (multifunctional Peripheral/Printer/Product)100 provided in this embodiment may be a multifunctional office document processing device integrating functions of copying, scanning, printing, faxing, etc., and may include a communication module 101, an imaging module 102, and a processing module 103.

The communication module 101 is communicatively coupled to the display device 110 and may be configured to obtain the geometric characteristics of the display device 110. The communication connection includes, but is not limited to, a wired or wireless network connection.

The display device 110 may include a display server and a display terminal. Display servers include, but are not limited to, television boxes and computer hosts. The display terminal includes, but is not limited to, a television, a display, and a display screen with various length-width ratios and sizes. The geometric characteristics of the display device 110 include, but are not limited to, the height h1 of the display terminal and the width w1 of the display terminal.

The imaging module 102 may acquire an image of the object to be projected based on the geometric features of the display device 110.

The objects to be projected include, but are not limited to, paper documents, photographs, fabrics with patterns, screens with display contents, and other objects with contents to be projected. The geometric features of the object to be projected include, but are not limited to, the height h0 of the object to be projected and the width w0 of the object to be projected.

To acquire an image of the object to be projected, the imaging module 102 may set the DPI parameter based on the height h1 of the display terminal, the width w1 of the display terminal, the height h0 of the object to be projected, and the width w0 of the object to be projected.

In response to the height h0 of the object to be projected being greater than the width w0 of the object to be projected, the imaging module 102 may set its DPI parameter to h1/h0 times of the standard display DPI (e.g., 300) in proportion to the ratio of h1/h0, thereby acquiring an image of the object to be projected having a height h1 and a width w0 (h1/h 0).

The standard display DPI is used to indicate the lowest DPI value that can clearly display an image on any display device, and can be adaptively adjusted according to the geometric characteristics of a specific special display screen (e.g., an ultra-large screen, a special-shaped screen, etc.).

The height of the image indicates the ratio of pixel points to the DPI parameter in the height direction of the image. Accordingly, the width of the image indicates the ratio of the pixel point to the DPI parameter in the image width direction.

Accordingly, in response to the height h0 of the object to be projected being smaller than the width w0 of the object to be projected, the imaging module 102 may also set its DPI parameter to w1/w0 times of the standard display DPI (e.g., 300) in proportion to the ratio of w1/w0, thereby acquiring an image of the object to be projected with a height h0 (w1/w0) and a width w 1.

Those skilled in the art will appreciate that the above-mentioned scheme of setting DPI parameters to obtain an image of an object to be projected based on the height h1 of the display terminal, the width w1 of the display terminal, the height h0 of the object to be projected, and the width w0 of the object to be projected is only a specific embodiment, and is mainly used to adjust the resolution of scanning according to the length and width of the display terminal to obtain the most suitable image, thereby improving the display effect. By the scheme, the maximum image can be obtained on the premise of not changing the height-width ratio of the object to be projected, so that the display effect of the object to be projected on the display device 110 is improved. In other embodiments, a person skilled in the art may also use other means to obtain an image of an object to be projected based on the geometric features of the display device 110, so as to solve the problem that the prior art cannot perform high-quality screen projection display on display devices with different sizes and length-width ratios.

Optionally, in order to further prevent the problem that the acquired image is bent, deformed, or the acquired image includes a background image, the imaging module 102 may preferably include a plurality of cameras and sealed exposure areas. The imaging module 102 may scan the object to be projected placed in its exposure area line by line using several of the plurality of cameras according to the height h0 and the width w0 of the object to be projected, and specific DPI parameters, to acquire a still image of the object to be projected.

Those skilled in the art will appreciate that the imaging module 102 described above, which includes multiple cameras and sealed exposure areas, is only one preferred solution provided by the present embodiment. In other embodiments, other imaging modules may be used by those skilled in the art to acquire images of the object to be projected based on the geometric features of the display device 110.

Accordingly, the progressive scanning is also only a technical means for acquiring a high resolution image. Other scanning or imaging means may be used by those skilled in the art to acquire images of the object to be projected based on the geometric features of the display device 110.

As shown in fig. 1, the processing module 103 of the multifunctional machine 100 may be connected to the communication module 101 and the imaging module 102, respectively, for converting an image of an object to be projected into a digital image signal and projecting the digital image signal to the display device 110 through the communication module 101 for display on the display device 110.

By communicatively connecting the communication module 101 to the external text recognition device 120, a person skilled in the art can perform angle deflection on the text image in the digital image signal through the text recognition device 120 to recognize text information in the digital image signal, and return the deflection angle when recognition is successful to the multifunctional 100 machine.

The text recognition device 120 may be a cloud server in a wide area network, or may be a local server within a range of a local area network. The text Recognition device 120 may recognize the text image in the digital image signal by an Optical Character Recognition (OCR) technique. The text image refers to an image corresponding to text information in the digital image signal.

In response to receiving the deflection angle when the above recognition is successful, the processing module 103 of the multifunctional machine 100 may perform rotation processing on the digital image signal according to the deflection angle, and rotate the entire image by the same angle to erect the digital image signal.

It will be appreciated by those skilled in the art that rotating the image of the object to be projected according to the deflection angle at which the recognition succeeds is a preferred scheme for achieving an automatic upright projection of the image by applying OCR technology in reverse. In other embodiments, those skilled in the art can also adopt other means to achieve the purpose of automatically and vertically projecting the screen image.

Those skilled in the art will also appreciate that text recognition by the external text recognition device 120 is only one preferred solution to increase the speed of text recognition and reduce the manufacturing cost of the multi-function machine. In other embodiments, those skilled in the art can also implement the text recognition function by embedding an OCR module or other text recognition modules in the multifunctional machine.

Accordingly, in other embodiments, a person skilled in the art can also implement the function of rotating the projected image through an external processing device, thereby increasing the speed of vertically projecting the image and reducing the manufacturing cost of the multifunctional machine.

Preferably, for an object to be projected having multiple pages, its corresponding digital image signal may include multiple pages of images. The text recognition apparatus 120 may split the digital image signals of a plurality of pages into a plurality of single-page digital image signals for text recognition, and return the recognized text information and the position information of the corresponding text image to the multifunctional machine 100.

The text information and the position information of the text image can be correlated by the processing module 103 and projected to the display device 110 along with the digital image signal for retrieval and positioning. The position information of the text image can comprise the page number of the image and the specific coordinate position of the image in the single-page digital image signal.

By correlating the text information and the position information of the character image with each other, a function of retrieving a corresponding character image from the text information can be further provided. In response to receiving the text information to be retrieved, the multifunctional machine 100, the display device 110 or an external server may find the corresponding text information and the position information of the associated text image in the digital image signal, circle the corresponding text image in the display device 110, and/or mark the corresponding single-page digital image signal and the page number thereof.

The multifunction machine 100 can judge page by page whether each single-page digital image signal is subjected to the text recognition process and the screen projection according to the page number to realize the continuous projection of a plurality of pages. If the judgment result is negative, performing text recognition processing and screen projection of the corresponding page; and if so, indicating that all the pages are subjected to text recognition processing and screen projection.

The images corresponding to the single-page digital image signals may be displayed on the display screen of the display device 110 in real time by page, or alternatively displayed in a slide manner. The display mode of the image may be manually set by a user through a human-machine interface (not shown) disposed on the multifunctional machine 100, or may be preset in the multifunctional machine 100.

Preferably, the multifunctional machine 100 can also be communicatively connected with the translation processing device and the voice processing device. In response to receiving the text information, the translation processing means may perform translation processing on the text information and return the translated text information to the multifunction machine 100. In response to receiving the text message, the speech processing device may perform speech processing on the text message and return the speech message to the multifunction 100 machine. In response to receiving the translated text information and the voice information, the processing module 103 may associate the text information, the location information of the text image, the translated text information, and the voice information and project them to the display device 110 along with the digital image signal to display the translated text and the voice play link associated with the text information at the corresponding location of the display device 110.

Specifically, the display device 110 may mark a corresponding dotted frame on the text image in the screen according to the received digital image signal containing the text information, the position information of the text image, the translated text information, and the voice information. When the dotted line box gets the focus, a small dialog box is opened to display the translation text information corresponding to the text image. And when the dashed box is double-clicked, automatically downloading the audio file corresponding to the voice information for playing.

In the text retrieval function, the user may also use the direction keys on the display device 110 to switch the regions corresponding to the different text images matched thereto.

Those skilled in the art will understand that the translation processing device and the voice processing device may be a cloud server separately disposed in a wide area network or a local server disposed in a local area network, or may be one or more cloud servers or local servers 120 integrating a text recognition module, a translation processing module, and a voice processing module.

By using a plurality of parallel external servers 120 that integrate the character recognition module, the translation processing module, and the voice processing module, the processing module 103 of the multi-function machine 100 can automatically search for an idle external server 120 by respectively starting the program units of one thread to simultaneously perform OCR character recognition processing, translation processing, and voice processing, thereby more rapidly realizing high-quality screen projection.

As shown in fig. 2, the multi-function device 100 according to another embodiment can be connected to a plurality of

display devices

130 and 132 and a plurality of

external servers

140 and 142, respectively. The

display devices

130 and 132 have different models and types of display screens, respectively, with different aspect ratios and sizes. The

external server

140 and 142 are integrated with a text recognition module, a translation processing module and a voice processing module at the same time.

In the local area network, the communication module 103 of the multifunctional apparatus 100 may send the identity information of the multifunctional apparatus 100 to the UDP service ports of the plurality of

display devices

130 and 132 through a Network Interface (NIC). The above-mentioned identification information may be hash data containing CPU information of the multifunction machine 100.

The

display device

130 and 132 may compare whether the received identity information belongs to the pre-authorized equipment list. If the identity information of the multi-function device 100 is on the authorization list of the display device 130-131, the display device 130-131 authorized to pass can return the TCP address information and the port information to the multi-function device 100 to form an accessible list on the multi-function device 100. If the identity information of the multi-function machine 100 is not on the authorization list of the display device 132, the display device 132 may return no information or return a rejection information to mask the multi-function machine.

The TCP address information and the port information returned to the multifunction machine 100 may be encrypted ciphertext, thereby improving information security.

In response to receiving the returned TCP address information and port information, the multifunctional machine 100 can establish communication connections with the

display devices

130 and 131 on the accessible list, respectively.

Those skilled in the art will appreciate that the above-described lan scenario is merely one specific implementation. In the wide area network, the communication module of the multifunctional machine may send the identity information of the multifunctional machine to the TCP server address port of the designated remote display device through the network interface to attempt to connect with the designated display device.

The remote display device can judge whether the multifunctional machines are matched or not according to the pre-authorized equipment list. If a match is found, an access confirmation message is returned to the multi-function machine, otherwise a rejection message is returned to the multi-function machine, thereby forming an accessible list on the side of the multi-function machine.

Those skilled in the art will also appreciate that encrypting the TCP address information and port information returned to multifunction machine 100 is only one preferred solution for increasing information security. Based on the same concept, the communication module 103 may also encrypt the digital image signal and project the encrypted digital image signal to the

display device

130 and 131 for displaying the image.

As shown in fig. 2, in response to receiving an instruction to screen-up a display, the communication module 103 of the multi-function machine 100 may first obtain the geometric characteristics of one of the display devices 130 on the accessible list. The instruction may be input by a user through a human-machine interface (not shown) provided on the multifunction machine 100, or may be automatically generated by the multifunction machine 100 in response to detection of the object to be projected in the exposure area.

After the multifunctional machine 100 finishes the above-mentioned image acquisition, digital signal conversion, character recognition, translation processing, and voice processing, and projects the digital image signal matched with the display device 130 to the display device 130 for display, the communication module 103 acquires geometric features of another display device 131 on the accessible list to perform screen projection display of the display device 131, so as to match the specific size and length-width ratio of each display device for high-quality display.

The multi-function machine 100 can traverse all the

display devices

130 and 131 on the accessible list to perform the projection of multiple display devices. Due to the adoption of the external server 140 and the processing module 142, the character recognition, the translation processing and the voice processing only need to occupy three threads in the processing module 103 of the multifunctional machine 100, and can be simultaneously carried out in the external server 140 and the processing module 142 respectively, so that the screen projection display speed is increased.

It will be understood by those skilled in the art that traversing each

display device

130 and 131 one by one for screen projection display of a plurality of display devices is only one specific solution. In other embodiments, the multifunctional machine may also adopt a multi-core processor to simultaneously acquire geometric features of a plurality of display devices for processing, and perform any one of functions of character recognition, translation processing and voice processing through any one idle external server, thereby achieving the purpose of screen projection display to the plurality of display devices at the same time.

As shown in fig. 2, the multifunctional machine 100 may further include a stopping module (not shown). In response to receiving the suspend instruction, the suspend module may suspend image projection on the display device 130 for the purpose of protecting information security.

The pause command may be input by the user through the man-machine interface, or may be automatically generated by the multifunction machine 100 according to a preset rule (e.g., masking an image including specific text information to a designated display device 130).

According to another aspect of the present invention, there is also provided herein an embodiment of an image processing method.

As shown in fig. 3, the image processing method provided in this embodiment may include:

301: geometric features of a display device are acquired.

The display device may include a display server and a display terminal. Display servers include, but are not limited to, television boxes and computer hosts. The display terminal includes, but is not limited to, a television, a display, and a display screen with various length-width ratios and sizes. The geometric characteristics of the display device 110 include, but are not limited to, the height h1 of the display terminal and the width w1 of the display terminal.

302: based on the geometric features of the display device, an image of the object to be projected is acquired.

In order to acquire an image of the object to be projected, the DPI parameter may be set based on the height h1 of the display terminal, the width w1 of the display terminal, the height h0 of the object to be projected, and the width w0 of the object to be projected.

In response to the height h0 of the object to be projected being larger than the width w0 of the object to be projected, the DPI parameter thereof can be set to h1/h0 times of the standard display DPI (e.g., 300) in proportion to the ratio of h1/h0, thereby acquiring an image of the object to be projected having a height h1 and a width w0 (h1/h 0).

Accordingly, in response to the height h0 of the object to be projected being smaller than the width w0 of the object to be projected, the DPI parameter thereof can also be set to w1/w0 times of the standard display DPI (e.g., 300) in proportion to the ratio of w1/w0, thereby acquiring an image of the object to be projected with a height h0 (w1/w0) and a width w 1.

Those skilled in the art will appreciate that the above-mentioned scheme of setting DPI parameters to obtain an image of an object to be projected based on the height h1 of the display terminal, the width w1 of the display terminal, the height h0 of the object to be projected, and the width w0 of the object to be projected is only a specific embodiment, and is mainly used to adjust the resolution of scanning according to the length and width of the display terminal to obtain the most suitable image, thereby improving the display effect. By the scheme, the maximum image can be obtained on the premise of not changing the height-width ratio of the object to be projected, so that the display effect of the object to be projected on the display device is improved. In other embodiments, a person skilled in the art may also use other means to obtain an image of an object to be projected based on the geometric features of the display device, so as to solve the problem that the prior art cannot perform high-quality screen projection display on display devices of different sizes and length-width ratios.

Optionally, in order to further prevent the problems of the acquired image being bent, deformed, or the acquired image including a background image, etc., it may be preferable to scan the object to be projected placed in the exposure area line by line using several cameras among the plurality of cameras according to the height h0 and the width w0 of the object to be projected, and specific DPI parameters, to acquire a static image of the object to be projected.

It can be understood by those skilled in the art that the above-mentioned method of acquiring a static image of an object to be projected by using a plurality of cameras and a sealed exposure area is only one preferred solution provided by the present embodiment. In other embodiments, a person skilled in the art may also use other ways to obtain an image of the object to be projected based on the geometric features of the display device.

Accordingly, the progressive scanning is also only a technical means for acquiring a high resolution image. Other scanning or imaging means may be used by those skilled in the art to acquire images of the object to be projected based on the geometric features of the display device.

303: the image of the object to be projected is converted into a digital image signal, and the digital image signal is projected to a display device to be displayed on the display device.

The person skilled in the art can perform angular deflection on the text image in the digital image signal to identify the text information in the digital image signal, and obtain the deflection angle when the identification is successful. The text image refers to an image corresponding to text information in the digital image signal.

In response to the deflection angle when the recognition is successful, the digital image signal may be rotated according to the deflection angle, and the entire image may be rotated by the same angle to erect the digital image signal.

Preferably, for an object to be projected having multiple pages, its corresponding digital image signal may include multiple pages of images. Those skilled in the art can split the multi-page digital image signal into a plurality of single-page digital image signals for text recognition, and obtain the recognized text information and the position information of the corresponding text image.

The text information and the position information of the character image can be projected to a display device along with the digital image signal after being mutually associated and processed so as to carry out retrieval positioning. The position information of the text image can comprise the page number of the image and the specific coordinate position of the image in the single-page digital image signal.

By correlating the text information and the position information of the character image with each other, a function of retrieving a corresponding character image from the text information can be further provided. In response to receiving the text information to be retrieved, the corresponding text information and the position information of the associated text image can be found in the digital image signal, the corresponding text image is circled in the display device, and/or the corresponding single-page digital image signal and the page number thereof are marked.

One skilled in the art can determine, page by page, whether each single-page digital image signal is subjected to the text recognition process and the screen projection according to the page number, so as to realize the continuous projection of a plurality of pages. If the judgment result is negative, performing text recognition processing and screen projection of the corresponding page; and if so, indicating that all the pages are subjected to text recognition processing and screen projection.

The images corresponding to the single-page digital image signals can be displayed on the display screen of the display device in real time according to pages, and can also be displayed in a slide way alternatively. The display mode of the image may be manually set by the user or may be preset.

Preferably, in response to obtaining the text information, translation processing may be performed on the text information, and the translated text information may be obtained. In response to receiving the text message, speech processing may be performed on the text message and the speech message may be obtained. In response to obtaining the translated text information and the voice information, the text information, the location information of the text image, the translated text information, and the voice information may be associated and projected along with the digital image signal to a display device to display the translated text and the voice play link associated with the text information at a corresponding location of the display device.

Specifically, the display device may mark a corresponding dotted frame on the text image in the screen according to the received digital image signal including the text information, the position information of the text image, the translated text information, and the voice information. When the dotted line box gets the focus, a small dialog box is opened to display the translation text information corresponding to the text image. And when the dashed box is double-clicked, automatically downloading the audio file corresponding to the voice information for playing.

In the text retrieval function, the user can also use the direction keys on the display device to switch the corresponding areas of the matched different text images.

Optionally, for a plurality of display devices having different models and types of display screens and different length-width ratios and sizes, the image processing method provided in this embodiment may further include:

the display device which is authorized to pass returns the address information and the port information of the display device to the multifunctional machine so as to form an accessible list on the multifunctional machine; and

Such communication connections include, but are not limited to, wired or wireless network connections.

In the case of a local area Network, the multifunction machine may send the identification information of the multifunction machine to UDP service ports of a plurality of display devices through a Network Interface Controller (NIC). The above-mentioned identification information may be hash data containing CPU information of the multifunction machine.

The display means may compare whether the received identity information belongs to its list of pre-authorised devices. If the identity information of the multifunctional machine is on the authorization list of the display device, the display device which is authorized to pass through can return TCP address information and port information of the display device to the multifunctional machine so as to form an accessible list on the multifunctional machine. If the identity information of the multi-function machine is not on the authorization list of the display device, the display device may not return any information or return rejection information to shield the multi-function machine.

The TCP address information and the port information returned to the multifunctional machine can be encrypted ciphertext, so that the information security is improved.

In response to receiving the returned TCP address information and port information, the multi-function machine may establish a communication connection with the display devices on the accessible list, respectively.

Those skilled in the art will also appreciate that encrypting the TCP address information and port information returned to the multifunction machine is only one preferred solution to increase information security. Based on the same conception, the communication module can also encrypt the digital image signal and project the digital image signal to the display device in a form of ciphertext to display the image.

Preferably, in response to receiving an instruction to screen-up the display, the multi-function machine may first obtain the geometric features of one of the display devices on the accessible list. The instruction may be input by a user through a man-machine interaction interface provided on the multi-function machine, or may be automatically generated by the multi-function machine in response to detection of the object to be projected in the exposure area.

After the multifunctional machine finishes the image acquisition, the digital signal conversion, the character recognition, the translation processing and the voice processing in sequence, and projects the digital image signal matched with the display device to the display device for display, the multifunctional machine acquires the geometric characteristics of another display device on the accessible list again for screen projection display of the display device, so that the specific size and the length-width ratio of each display device are matched for high-quality display. The multi-function machine may traverse all of the display devices on the accessible list to perform the projection of the multiple display devices.

It will be appreciated by those skilled in the art that traversing each display device one by one for on-screen display of multiple display devices is only one specific approach. In other embodiments, the multifunctional machine may also adopt a multi-core processor to simultaneously acquire geometric features of a plurality of display devices for processing, and perform any one of functions of character recognition, translation processing and voice processing through any one idle external server, thereby achieving the purpose of screen projection display to the plurality of display devices at the same time.

Optionally, a pause module may be further provided in the multifunctional machine. In response to receiving the suspension instruction, the suspension module may suspend image projection on the display device to achieve the purpose of protecting information security.

The pause command can be input by the user through the man-machine interaction interface, or can be automatically generated by the multifunctional machine according to a preset rule (for example, shielding an image comprising specific text information to a specified display device).

While, for purposes of simplicity of explanation, the methodologies are shown and described as a series of acts, it is to be understood and appreciated that the methodologies are not limited by the order of acts, as some acts may, in accordance with one or more embodiments, occur in different orders and/or concurrently with other acts from that shown and described herein or not shown and described herein, as would be understood by one skilled in the art.

The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multi-function machine comprising:

2. The multi-function machine of claim 1, wherein the imaging module sets DPI parameters based on the geometric features of the display device and the geometric features of the object to be projected to acquire an image of the object to be projected.

3. The multi-function machine of claim 2, wherein the geometric features of the display device comprise: a height h1 of the display device and a width w1 of the display device;

the geometrical characteristics of the object to be projected include: the height h0 of the object to be projected and the width w0 of the object to be projected;

in response to the height h0 of the object to be projected being greater than the width w0 of the object to be projected, the imaging module sets the DPI parameter to be proportional to h1/h 0;

in response to the height h0 of the object to be projected being less than the width w0 of the object to be projected, the imaging module sets the DPI parameter to be proportional to w1/w 0.

4. The multi-function machine of claim 1, wherein the imaging module includes a plurality of cameras and a sealed exposure area, the plurality of cameras scanning an object to be projected placed in the exposure area line by line to acquire an image of the object to be projected.

5. The multi-function machine of claim 1, wherein said communication module is further communicatively connected to a text recognition device, said text recognition device angularly deflecting text images in said digital image signal to recognize text information in said digital image signal and returning a deflection angle at which recognition was successful to said multi-function machine;

and the processing module performs rotation processing on the digital image signal according to the deflection angle so as to erect the digital image signal.

6. The multi-function machine of claim 5, wherein said text recognition means splits the digital image signals of a plurality of pages into a plurality of single-page digital image signals for text recognition and returns location information of the text message and its corresponding text image to the multi-function machine,

7. The multi-function machine of claim 6, wherein in response to receiving said text message, translation processing means communicatively connected to said multi-function machine translates said text message and returns a translated text message to said multi-function machine; and/or

In response to receiving the text message, a voice processing device communicatively connected to the multi-function machine performs voice processing on the text message and returns a voice message to the multi-function machine,

in response to receiving the translated text information and/or the voice information, the processing module associates the text information, the position information of the text image, and the translated text information and/or the voice information and projects the associated text information and/or the voice information with the digital image signal to the display device to display a translated text and/or voice playing link associated with the text information at a corresponding position of the display device.

8. The multi-function machine of claim 1, wherein said communication module transmits identity information of said multi-function machine to a plurality of display devices;

authorizing the passing display device to return the address information and the port information of the passing display device to the multifunctional machine so as to form an accessible list on the multifunctional machine;

and the multifunctional machines respectively establish the communication connection with the display devices on the accessible lists.

9. The multi-function machine of claim 8, wherein said communication module obtains geometric characteristics of a display device on said accessible list;

the multi-function machine traverses all display devices on the accessible list for projection of multiple display devices.

10. The multi-function machine of claim 8, wherein the authorized display device returns its address information and the cryptogram of the port information to the multi-function machine to establish the communication connection;

and the communication module projects the ciphertext of the digital image signal to the display device so as to display the image.

11. The multi-function machine of claim 1, further comprising:

A pause module that pauses image projection to the plurality of display devices in response to receiving a pause instruction.

12. An image processing method comprising:

acquiring geometric characteristics of a display device;

13. The image processing method according to claim 12, wherein DPI parameters are set based on the geometric features of the display device and the geometric features of the object to be projected to acquire an image of the object to be projected.

14. The image processing method of claim 13, wherein the geometric features of the display device comprise: a height h1 of the display device and a width w1 of the display device;

in response to the height h0 of the object to be projected being greater than the width w0 of the object to be projected, setting the DPI parameter to be proportional to h1/h 0;

in response to the height h0 of the object to be projected being smaller than the width w0 of the object to be projected, the DPI parameter is set to be proportional to w1/w 0.

15. The image processing method according to claim 12, wherein the object to be projected placed in the sealed exposure area is scanned line by line with a plurality of cameras to acquire an image of the object to be projected.

16. The image processing method according to claim 12, further comprising:

17. The image processing method according to claim 16, further comprising:

18. The image processing method of claim 17, further comprising:

19. The image processing method according to claim 12, further comprising:

20. The image processing method of claim 19, further comprising:

obtaining a geometric feature of a display device on the accessible list;

21. The image processing method according to claim 19, wherein the authorized display device returns the address information and the port information of the authorized display device to the multifunctional machine to establish the communication connection;

and projecting the ciphertext of the digital image signal to the display device for image display.

22. The image processing method according to claim 12, further comprising: