CN115550706A

CN115550706A - Display device, image processing method and device

Info

Publication number: CN115550706A
Application number: CN202110739866.4A
Authority: CN
Inventors: 李小龙
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-06-30
Filing date: 2021-06-30
Publication date: 2022-12-30

Abstract

The embodiment belongs to the display technology, and provides a display device, an image processing method and an image processing device. The method and the device can greatly improve the quality of the output image, and further ensure that the color of the image is not distorted.

Description

Display device, image processing method and device

Technical Field

The present application relates to an image processing technology. And more particularly, to a display apparatus, an image processing method and device.

Background

With the continuous progress of science and technology, display devices are integrating more and more functions and developing towards intellectualization. The functions of large-screen video call, face recognition, motion sensing game, artificial Intelligence (AI) fitness and the like are gradually applied to the display device, and the functions can be realized without leaving a camera, so that the intellectualization of the display device is assisted by the image acquisition function of the camera.

When the shooting target is closer to the camera of the display device, the display device can irradiate the shooting target with light, and the light reflected by the shooting target can cause obvious interference to the imaging of the camera. For a display device having a large screen such as a television set, when the intensity of light emitted from the display device is strong, the display device displays an image acquired by a camera, and there is a case where the color of the image is distorted (e.g., reddish).

Disclosure of Invention

The exemplary embodiment of the application provides a display device, an image processing method and an image processing device, which can greatly improve the quality of an output image and further ensure that the color of the image is not distorted.

In a first aspect, an embodiment of the present application provides a display device, including:

a display;

a camera for taking images;

a processor coupled to the display, the processor configured to:

when the distance between a shooting target and the camera is smaller than a first threshold value, determining whether to correct the primary color ratio of an image output by the camera;

if yes, determining the correction weight corresponding to each primary color according to the primary color proportion;

and controlling the display to output the image according to the correction weight.

In some possible implementations, the processor, when configured to determine whether to correct a base color ratio of an image output by the camera, is specifically configured to: comparing the primary color ratio of the image output by the camera with the primary color ratio of a reference image, wherein the reference image is an image with the standard primary color ratio in the same color temperature environment as the image output by the camera; if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is larger than a second threshold value, determining to correct the primary color ratio of the image output by the camera; and if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is smaller than or equal to a second threshold value, determining not to correct the primary color ratio of the image output by the camera.

In some possible implementations, when the processor is configured to determine the correction weight corresponding to each primary color according to the primary color proportion, the processor is specifically configured to: and determining the correction weight corresponding to each primary color according to the difference value of the primary color ratio and the primary color ratio of the reference image, wherein the reference image is an image with the standard primary color ratio in the same color temperature environment as the image output by the camera.

In some possible implementations, the processor, when being configured to control the display to output the image in accordance with the correction weights, is specifically configured to: sending the correction right to the camera again so that the camera performs dynamic color matrix correction on the output image; and controlling the display to output the image from the camera after the dynamic color matrix correction.

In some possible implementations, the processor, when being configured to control the display to output the image in accordance with the correction weights, is specifically configured to: correcting the image parameters of the filter according to the correction weight; and controlling the display to output the corrected image.

In some possible implementations, the processor is further configured to: and determining the distance according to at least one frame of image output by the camera, wherein the image comprises a shooting target.

In some possible implementations, the processor, when configured to determine the distance according to at least one frame of image output by the camera, is specifically configured to: respectively extracting a characteristic diagram of a shooting target in each frame of image; determining the proportion of the characteristic diagram of the shooting target in the corresponding image; and determining the distance according to the proportion.

In some possible implementations, the processor, when configured to determine the distance according to at least one frame of image output by the camera, is specifically configured to: by means of the distance sensor, the distance is determined.

In a second aspect, an embodiment of the present application provides an image processing method, applied to a display device, the image processing method including:

In some possible implementations, determining whether to correct a base color ratio of an image output by a camera includes: comparing the primary color ratio of the image output by the camera with the primary color ratio of a reference image, wherein the reference image is an image with the standard primary color ratio in the same color temperature environment as the image output by the camera; if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is larger than a second threshold value, determining to correct the primary color ratio of the image output by the camera; and if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is smaller than or equal to a second threshold value, determining not to correct the primary color ratio of the image output by the camera.

In some possible implementations, determining the correction weight corresponding to each primary color according to the primary color proportion includes: and determining the correction weight corresponding to each primary color according to the difference value of the primary color proportion and the primary color proportion of a reference image, wherein the reference image is an image with the standard primary color proportion in the same color temperature environment as the image output by the camera.

In some possible implementations, controlling the display to output the image according to the correction weight includes: sending the correction right to the camera again so that the camera performs dynamic color matrix correction on the output image; and controlling the display to output the image from the camera after the dynamic color matrix correction.

In some possible implementations, controlling the display to output the image according to the correction weight includes: correcting the image parameters of the filter according to the correction weight; and controlling the display to output the corrected image.

In some possible implementations, the image processing method further includes: and determining the distance according to at least one frame of image output by the camera, wherein the image comprises a shooting target.

In some possible implementations, determining the distance according to at least one frame of image output by the camera includes: respectively extracting feature maps of the shooting targets in each frame of image; determining the proportion of the characteristic diagram of the shooting target in the corresponding image; and determining the distance according to the proportion.

In some possible implementations, determining the distance according to at least one frame of image output by the camera includes: by means of the distance sensor, the distance is determined.

In a third aspect, an embodiment of the present application provides an image processing apparatus applied to a display device, including:

the first determining module is used for determining whether to correct the primary color ratio of the image output by the camera when the distance between the shooting target and the camera is smaller than a first threshold value;

the processing module is used for determining the correction weight corresponding to each primary color according to the primary color proportion if the primary colors are matched;

and the control module is used for controlling the display to output the image according to the correction weight.

In some possible implementations, the first determining module is specifically configured to: comparing the primary color ratio of the image output by the camera with the primary color ratio of a reference image, wherein the reference image is an image with the standard primary color ratio in the same color temperature environment as the image output by the camera; if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is larger than a second threshold value, determining to correct the primary color ratio of the image output by the camera; and if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is smaller than or equal to a second threshold value, determining not to correct the primary color ratio of the image output by the camera.

In some possible implementations, the processing module is specifically configured to: and determining the correction weight corresponding to each primary color according to the difference value of the primary color proportion and the primary color proportion of a reference image, wherein the reference image is an image with the standard primary color proportion in the same color temperature environment as the image output by the camera.

In some possible implementations, the control module is specifically configured to: sending the correction right to the camera again so that the camera performs dynamic color matrix correction on the output image; and controlling the display to output the image from the camera after the dynamic color matrix correction.

In some possible implementations, the control module is specifically configured to: correcting the image parameters of the filter according to the correction weight; and controlling the display to output the corrected image.

In some possible implementations, the image processing apparatus further includes a second determining module, configured to determine a distance according to at least one frame of image output by the camera, where the image includes a shooting target.

In some possible implementations, the second determining module is specifically configured to: respectively extracting a characteristic diagram of a shooting target in each frame of image; determining the proportion of the characteristic diagram of the shooting target in the corresponding image; and determining the distance according to the proportion.

In some possible implementations, the second determining module is specifically configured to: by means of the distance sensor, the distance is determined.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer program instructions are stored, and when the computer program instructions are executed, the method for processing an image according to the second aspect of the present application is implemented.

In a fifth aspect, the present application provides a computer program product comprising a computer program, which when executed by a processor, implements any of the image processing methods described in the second aspect of the present application.

According to the display device, the image processing method and the image processing device, when the distance between a shooting target and the camera is smaller than a first threshold value, whether the primary color ratio of an image output by the camera is corrected or not is determined, if yes, correction weights corresponding to all primary colors are determined according to the primary color ratio, and the display is controlled to output the image according to the correction weights. According to the method and the device, the primary color proportion of the image output by the camera can be corrected according to the correction weight corresponding to each primary color, and the corrected image is output, so that the quality of the output image can be greatly improved, and the color of the image is guaranteed not to be distorted.

These and other aspects of the present application will be more readily apparent from the following description of the embodiment(s).

Drawings

In order to more clearly illustrate the embodiments of the present application or the implementation manner in the related art, a brief description will be given below of the drawings required for the description of the embodiments or the related art, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art according to the drawings.

Fig. 1 is a schematic view of an interaction scene between a display device and a camera according to an embodiment of the present application;

fig. 2 is a block diagram of a hardware configuration of a display device according to an embodiment of the present application;

fig. 3 is a schematic software system diagram of a display device according to an embodiment of the present application;

fig. 4 is a flowchart of an image processing method according to an embodiment of the present application;

FIG. 5 is a flowchart of an image processing method according to another embodiment of the present application;

fig. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present application.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following is a clear and complete description of exemplary embodiments of the present application with reference to the attached drawings in exemplary embodiments of the present application, and it is apparent that the exemplary embodiments described are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without making any inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of exemplary embodiment or embodiments, it should be appreciated that individual aspects of the disclosure can be utilized in a variety of forms and embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first", "second", "third", and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily meant to define a particular order or sequence Unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," as well as any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module" as used herein refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device, such as the display device disclosed in this application, that is typically wirelessly controllable over a short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in a common remote control device with a user interface in a touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand type or an action such as hand motion to convey an intended idea, action, purpose, or result.

Fig. 1 is a schematic view of an interaction scene between a display device and a camera according to an embodiment of the present application. As shown in fig. 1, the display apparatus 200 displays a user image acquired through the camera 100.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network television function of a computer support function including, but not limited to, a network television, an intelligent television, an Internet Protocol Television (IPTV), and the like, in addition to the broadcast receiving television function.

Fig. 2 is a block diagram of a hardware configuration of a display device according to an embodiment of the present application. As shown in fig. 2, in some embodiments, at least one of the controller 250, the tuner demodulator 210, the communicator 220, the detector 230, the input/output interface 255, the display 275, the audio output interface 285, the memory 260, the power supply 290, the user interface 265, the external device interface 240 is included in the display apparatus 200.

In some embodiments, the display 275 is configured to receive image signals from the output of the first processor and to display video content and images and components of the menu manipulation interface.

In some embodiments, the display 275, includes a display screen assembly for presenting a picture, and a driving assembly that drives the display of an image.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

In some embodiments, the display 275 is used to present a user-manipulated UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

In some embodiments, a driver assembly for driving the display is also included, depending on the type of display 275.

In some embodiments, display 275 is a projection display and may also include a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver.

In some embodiments, the display apparatus 200 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communicator 220.

In some embodiments, user interface 265 may be configured to receive infrared control signals from a control device (e.g., an infrared remote control, etc.).

The face detector 230 is in some embodiments a display device 200 for capturing signals of the external environment or interaction with the outside.

In some embodiments, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light, and parameters changes can be adaptively displayed by collecting the ambient light, and the like.

In some embodiments, the detector 230 may further include an image collector, such as a camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or gestures interacted with the user, adaptively change display parameters, and recognize user gestures, so as to implement a function of interaction with the user.

In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.

In some embodiments, the display apparatus 200 may adaptively adjust a display color temperature of an image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In some embodiments, the detector 230 may also be a sound collector or the like, such as a microphone, which may be used to receive the user's voice. Illustratively, a voice signal including a control instruction for the user to control the display device 200, or to collect an ambient sound for recognizing an ambient scene type, so that the display device 200 can adaptively adapt to an ambient noise.

In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to allow data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, or command instruction data, etc.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: any one or more of a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface, a composite video input interface, a USB input interface, a Red Green Blue (RGB) port, and the like can be used. The plurality of interfaces may form a composite input/output interface.

In some embodiments, as shown in fig. 2, the tuning demodulator 210 is configured to receive a broadcast television signal through a wired or wireless receiving manner, and may perform modulation and demodulation processes such as amplification, mixing, resonance, and the like, and demodulate an audio and video signal from a plurality of wireless or wired broadcast television signals, where the audio and video signal may include a television audio and video signal carried in a television channel frequency selected by a user, and an EPG data signal.

In some embodiments, the frequency points demodulated by the tuner demodulator 210 are controlled by the controller 250, and the controller 250 can send out control signals according to user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to the broadcasting system of the television signal. Or may be classified into a digital modulation signal, an analog modulation signal, and the like according to a modulation type. Or the signals are classified into digital signals, analog signals and the like according to the types of the signals.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. Therefore, the set top box outputs the television audio and video signals modulated and demodulated by the received broadcast television signals to the main body equipment, and the main body equipment receives the audio and video signals through the first input/output interface.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 may control the overall operation of the display apparatus 200. For example: the widget 250 may perform an operation related to an object selected by a user command in response to receiving the user command to select a UI object to be displayed on the display 275.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation of connecting to a hyperlink page, document, image, etc., or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

As shown in fig. 2, the cavity controller 250 includes at least one of a Random Access Memory 251 (RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a Graphics Processing Unit (GPU), a processor 254 (CPU), a Communication Interface (Communication Interface), and a Communication Bus 256 (Bus), which connects the respective components.

In some embodiments, the RAM 251 is used to store temporary data for the operating system or other programs that are running and in some embodiments, the ROM 252 is used to store instructions for various system boots.

In some embodiments, the ROM 252 is used to store a Basic Input Output System (BIOS). The system is used for completing power-on self-test of the system, initialization of each functional module in the system, a driver of basic input/output of the system and booting an operating system.

In some embodiments, when the power of the display apparatus 200 is started upon receiving the power-on signal, the CPU executes the system start-up command in the ROM 252, and copies the temporary data of the operating system stored in the memory into the RAM 251 so as to start or run the operating system. After the start of the operating system is completed, the CPU copies the temporary data of the various application programs in the memory to the RAM 251, and then, the various application programs are started or run.

In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include a main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is used to generate various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And the rendering device is used for rendering various objects obtained based on the arithmetic unit, and the rendered objects are used for being displayed on a display.

In some embodiments, video processor 270 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on directly displayable device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if M PEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 and the video processor may be integrated or separately configured, and when the graphics processor and the video processor are integrated, the graphics processor and the video processor may perform processing of graphics signals output to a display, and when the graphics processor and the video processor are separately configured, the graphics processor and the video processor may perform different functions, for example, a GPU + FRC (Frame Rate Conversion) architecture.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain an audio signal that can be played in a speaker.

In some embodiments, video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.

In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated together with the controller in one or more chips.

In some embodiments, the audio output, under the control of controller 250, receives sound signals output by audio processor 280, such as: the speaker 286, and an external sound output terminal of a generating device that can output to an external device, in addition to the speaker carried by the display device 200 itself, such as: external sound interface or earphone interface, etc., and may also include a near field communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The power supply 290 supplies power to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply interface installed outside the display apparatus 200 to provide an external power supply in the display apparatus 200.

A user interface 265 for receiving an input signal of a user and then transmitting the received user input signal to the controller 250. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

In some embodiments, the user inputs a user command through the control device or the mobile terminal, the user input interface responds to the user input through the controller 250 according to the user input, and the display apparatus 200 responds to the user input through the controller 250.

In some embodiments, the user may input a user command on a Graphical User Interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

The memory 260 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in the first memory, including: at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

The base module is a bottom layer software module for signal communication between various hardware in the display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example, the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is used for controlling the display to display the image content, and can be used for playing the multimedia image content, UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs. Meanwhile, the memory 260 may store a visual effect map for receiving external data and user data, images of various items in various user interfaces, and a focus object, etc.

Fig. 3 is a schematic software system diagram of a display device according to an embodiment of the present application. Referring to fig. 3, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as "Application layer"), an Application Framework (Application Framework) layer (referred to as "Framework layer"), an Android runtime (Android runtime) layer and a system library layer (referred to as "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs can be Window (Window) programs carried by an operating system, system setting programs, clock programs, camera applications and the like; or may be an application developed by a third party developer such as a hi program, a karaoke program, a magic mirror program, or the like. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which is not limited in this embodiment of the present application.

The framework layer provides an Application Programming Interface (API) and a Programming framework for the Application programs of the Application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 3, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: the system comprises an Activity Manager (Activity Manager) for interacting with all activities running in the system, a Location Manager (Location Manager) for providing system services or applications with access to the system Location services, a Package Manager (Package Manager) for retrieving various information related to application packages currently installed on the device, a Notification Manager (Notification Manager) for controlling the display and removal of Notification messages, and a Window Manager (Window Manager) for managing icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is to: managing the life cycle of each application program and the general navigation backspacing function, such as controlling the exit of the application program (including switching the user interface currently displayed in the display window to the system desktop), opening, backing (including switching the user interface currently displayed in the display window to the previous user interface of the user interface currently displayed), and the like.

In some embodiments, the window manager is configured to manage all window processes, such as obtaining a display size, determining whether a status bar is available, locking a screen, intercepting a screen, controlling a display change (e.g., zooming out, dithering, distorting, etc.) and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 3, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor etc.) etc..

In some embodiments, the kernel layer further comprises a power driver module for power management.

In some embodiments, software programs and/or modules corresponding to the software architecture of fig. 3 are stored in the first memory or the second memory shown in fig. 2.

In some embodiments, taking the magic mirror application (photographing application) as an example, when the remote control receiving device receives a remote control input operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into an original input event (including information such as the value of the input operation, the timestamp of the input operation, etc.). The raw input events are stored at the kernel layer. The application program framework layer obtains an original input event from the kernel layer, identifies a control corresponding to the input event according to the current position of the focus and uses the input operation as a confirmation operation, the control corresponding to the confirmation operation is a control of a magic mirror application icon, the magic mirror application calls an interface of the application framework layer to start the magic mirror application, and then the kernel layer is called to start a camera driver, so that a static image or a video is captured through the camera.

In some embodiments, for a display device with a touch function, taking a split screen operation as an example, the display device receives an input operation (such as a split screen operation) applied to a display screen by a user, and the kernel layer may generate a corresponding input event according to the input operation and report the event to the application framework layer. The window mode (such as multi-window mode) corresponding to the input operation, the position and size of the window and the like are set by an activity manager of the application framework layer. And the window management of the application program framework layer draws a window according to the setting of the activity manager, then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

The display equipment is assisted by the image acquisition function of the camera to realize intellectualization. When the shooting target is closer to the camera of the display device, the display device can irradiate the shooting target with light, and the light reflected by the shooting target can cause obvious interference to the imaging of the camera. When the intensity of light emitted from the display device is strong, there is a case where the color of the image is distorted (e.g., reddish) when the display device displays the image acquired by the camera. For example, in a display device having a large screen, such as a television, because the screen of the television is much larger than the screen of a mobile phone and the display brightness of the television is also relatively high, referring to fig. 1, when a person is relatively close to a camera of the television, the screen of the television may be strongly irradiated to the person, which significantly affects the imaging effect of the camera, and particularly when the light intensity of the light emitted by the screen of the television is strong, a shooting target, such as a human face, may be significantly reddish. This phenomenon is particularly noticeable in products such as laser television cameras, because the monochromaticity of laser light is very strong, and the light reflected to the face of a person by the light-resistant gain screen can significantly affect the imaging of the camera, and the face of the person is reddish and unnatural. Although the camera of the television is subjected to objective color calibration, the calibration of the color is performed under a standard ambient light source, the spectrum of the ambient light is close to natural light, and the calibration of the color is also based on sensor adjustment performed by the natural mixed spectrum to simulate the perception of human eyes on the color spectrum, but the "light source" of the specific spectrum emitted by the screen of the television is irradiated on the human body, so that the camera cannot perform correct processing, the phenomenon that the human face is reddish and unnatural is caused, namely the image color distortion is caused.

In view of the above problems, the present application provides a display device, an image processing method and an image processing apparatus, which perform post-processing intervention on an image output by a camera, so as to solve the problem of image color distortion (e.g., reddening) when the display device displays an image acquired by the camera, and improve the quality of the output image.

The following describes how the present application performs image processing with reference to a detailed example.

Fig. 4 is a flowchart of an image processing method according to an embodiment of the present application. As shown in fig. 4, the processor 254 in the display device 200 is configured to perform the following steps:

in S401, when the distance between the shooting target and the camera is smaller than a first threshold, it is determined whether to correct the base color ratio of the image output by the camera.

In the embodiment of the application, the shooting target is a human face, for example. Illustratively, the first threshold may be set according to a size of a display of the display apparatus 200. Illustratively, the primary colors of the image output by the camera include Red (Red, R), green (Green, G) and Blue (Blue, B), and the primary color proportion of the image output by the camera is an RGB proportion, which includes a Red proportion, a Green proportion and a Blue proportion. The distance of the photographic subject from the camera can be determined with reference to the related art or the subsequent embodiment. When the distance between the shooting target and the camera is smaller than the first threshold, because there may be a situation that the image color is distorted, it is necessary to determine whether to correct the base color ratio of the image output by the camera. For how to determine whether to correct the primary color ratio of the image output by the camera, reference may be made to related technologies or subsequent embodiments, which are not described herein again.

In S402, if yes, the correction weight corresponding to each primary color is determined according to the primary color ratio.

In this step, the correction weight is used to adjust the primary color ratio of the image output by the camera. After the primary color proportion of the image output by the camera is determined to be corrected, the correction weight corresponding to each primary color of the image output by the camera can be determined according to the primary color proportion of the image output by the camera. For how to determine the correction weight corresponding to each primary color according to the primary color ratio, reference may be made to related technologies or subsequent embodiments, which are not described herein again.

In S403, the display is controlled to output an image according to the correction weight.

After the correction weight corresponding to each primary color of the image output by the camera is determined, the primary color proportion of the image output by the camera is corrected according to the correction weight, and then the display is controlled to output the image. For how to control the display to output the image according to the correction weight, reference may be made to related art or subsequent embodiments, which are not described herein again.

According to the image processing method provided by the embodiment of the application, when the distance between the shooting target and the camera is smaller than the first threshold value, whether the primary color proportion of the image output by the camera is corrected or not is determined, if yes, the correction weight corresponding to each primary color is determined according to the primary color proportion, and the display is controlled to output the image according to the correction weight. According to the embodiment of the application, the primary color proportion of the image output by the camera can be corrected according to the correction weight corresponding to each primary color, and the corrected image is output, so that the quality of the output image can be greatly improved, and the color of the image is ensured not to be distorted.

On the basis of the above embodiment, the processor 254 is further configured to: and determining the distance according to at least one frame of image output by the camera, wherein the image comprises a shooting target.

The camera that captures the face illustratively outputs 25 frames of images containing the face per second to the processor 254, and the processor 254 can determine the distance between the face and the camera from the 25 frames of images output by the camera.

Further, in a possible implementation, when the processor is configured to determine the distance according to at least one frame of image output by the camera, the processor is specifically configured to: respectively extracting feature maps of the shooting targets in each frame of image; determining the proportion of the characteristic diagram of the shooting target in the corresponding image; and determining the distance according to the proportion.

Illustratively, for 25 frames of images output by the camera every second, the processor 254 extracts the feature map of the face in each frame of image, i.e. completes the recognition and extraction of the face features. For how to complete the recognition and extraction of the human face features, reference may be made to the existing related technologies, and details are not described herein. The processor 254 can determine the distance between the face and the camera according to the average value of the proportion of the area of the feature map of the face of the 25-frame image in the total area of the corresponding image.

Further, in another possible embodiment, when the processor is configured to determine the distance according to at least one frame of image output by the camera, the processor is specifically configured to: by means of the distance sensor, the distance is determined.

Illustratively, the distance sensor may be integrated in the camera or, alternatively, be a separate sensor for aiding in testing the distance of the person from the camera. The processor 254 can directly determine the distance between the photographic subject, such as a human face, and the camera head through the distance sensor.

The following describes the image processing method provided in the embodiments of the present application in detail with reference to specific steps. In the following embodiments of the present application, an image processing in which a photographic subject is a human face will be described as an example.

Fig. 5 is a flowchart of an image processing method according to another embodiment of the present application. As shown in fig. 5, the processor 254 in the display device 200 is configured to perform the following steps:

in the embodiment of the present application, the step S401 in fig. 4 may be further refined into the following three steps S501 to S503:

in S501, when the distance between the shooting target and the camera is smaller than a first threshold, the primary color proportion of the image output by the camera is compared with the primary color proportion of the reference image.

The reference image is an image with a standard primary color ratio in the same color temperature environment as the image output by the camera.

Illustratively, a shooting target is a human face, a reference image can be obtained through a machine deep learning model of an artificial neural network, specifically, a plurality of (for example, 20 ten thousand) standard human face skin color sample images in different color temperature environments can be obtained, and the human face skin color sample images are input into the machine deep learning model of the initial artificial neural network for iterative training until a calculated loss function value meets a preset evaluation condition to obtain the reference image and a feature value (namely, RGB ratio) corresponding to the reference image. How to obtain the reference image by the machine deep learning model of the artificial neural network can refer to related technologies, and details are not described here. For example, the RGB ratio of the reference image may be stored in a database for query, and the processor 254 compares the RGB ratio of the image output by the camera with the RGB ratio of the reference image stored in the database when it is determined that the distance between the shooting target and the camera is less than the first threshold.

In S502, if a difference between a primary color ratio of the image output by the camera and a primary color ratio of the reference image is greater than a second threshold, a primary color ratio of the image output by the camera is determined to be corrected.

In S503, if the difference between the primary color matching of the image output by the camera and the primary color matching of the reference image is less than or equal to a second threshold, it is determined that the primary color matching of the image output by the camera is not corrected.

The second threshold is used for determining whether the primary color matching of the image output by the camera needs to be corrected, and it can be understood that the smaller the second threshold is, the closer the primary color matching of the image output by the camera is to the primary color matching of the reference image. Illustratively, the processor 254 may determine a difference between the RGB ratios of the image output by the camera and the reference image stored in the database after comparing the RGB ratios of the image output by the camera with the RGB ratios of the reference image, compare the difference with a second threshold, determine to correct the base color ratio of the image output by the camera if the difference is greater than the second threshold, and determine not to correct the base color ratio of the image output by the camera if the difference is less than or equal to the second threshold.

In the embodiment of the present application, the step S402 in fig. 4 may be further refined into the following step S504:

in S504, if the primary color matching of the image output by the correction camera is determined, the correction weight corresponding to each primary color is determined according to the difference between the primary color matching and the primary color matching of the reference image.

The reference image is an image with the same color temperature environment as the image output by the camera and the standard base color ratio.

In this step, after determining the primary color proportion of the image output by the correction camera, for example, the processor 254 may determine the correction weight corresponding to each primary color of the image output by the camera, for example, obtain two correction weight values of R gain (gain) and B gain, by using a machine deep learning model of an artificial neural network, with a target that the difference between the primary color proportion of the image output by the correction camera and the primary color proportion of the reference image is smaller than or equal to a second threshold value. For how the machine deep learning model of the artificial neural network determines the correction weights corresponding to the primary colors of the image output by the camera, reference may be made to related technologies, which are not described herein again. Optionally, the correction weight corresponding to each primary color may be determined according to an average value of the correction weights corresponding to each primary color of the plurality of images output by the camera.

In the embodiment of the present application, the step S403 in fig. 4 may be further refined into the following two steps S505 and S506:

in S505, the correction weight is retransmitted to the camera so that the camera performs dynamic color matrix correction on the output image.

Illustratively, the processor 254 sends correction weights (e.g., R gain, B gain) to the cameras via a communication protocol with the cameras to cause the cameras to perform dynamic color matrix correction on the output images. Accordingly, after the camera receives the correction weight, the camera Image Signal Processor (ISP) readjusts the register value to perform dynamic color matrix correction, including correction of the white balance of the camera.

In S506, the display is controlled to output an image from the dynamic color matrix corrected camera.

After the camera performs dynamic color matrix correction on the output image, the image after dynamic color matrix correction is output to the processor 254, and considering the situation that the image output by the camera may need to be corrected for multiple times, therefore, after the processor 254 receives the image from the camera after dynamic color matrix correction, the steps S501 to S505 are executed until the primary color ratio of the image output by the camera is determined not to be corrected, that is, the step S503 is executed, and then the display is controlled to output the image from the camera after dynamic color matrix correction.

The image processing method provided by the embodiment of the application compares a primary color ratio of an image output by a camera with a primary color ratio of a reference image when a distance between a shooting target and the camera is smaller than a first threshold, determines to correct the primary color ratio of the image output by the camera if a difference between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is larger than a second threshold, determines not to correct the primary color ratio of the image output by the camera if the difference between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is smaller than or equal to the second threshold, determines a correction weight corresponding to each primary color according to the difference between the primary color ratio and the primary color ratio of the reference image if the primary color ratio of the image output by the camera is determined to be corrected, and retransmits the correction weight to the camera so that the camera performs dynamic color matrix correction on the image output by the camera, and controls a display to output the image from the camera after the dynamic color matrix correction. According to the embodiment of the application, the primary color proportion of the image output by the camera can be corrected according to the correction weight corresponding to each primary color, and the corrected image is output, so that the quality of the output image can be greatly improved, and the color of the image is ensured not to be distorted.

In the above-described embodiment shown in fig. 5, the processor 254 supports retransmission of correction weights to the camera as a specific implementation, and considering that the processor 254 does not support retransmission of correction weights to the camera, after determining the correction weights corresponding to the primary colors in S504, in another specific implementation (i.e., further refining the step S403 in fig. 4), the processor 254 is configured to: and correcting the image parameters of the filter according to the correction weight, and controlling the display to output the corrected image.

Illustratively, the filter of the processor 254 may be used for post-processing of the image. Specifically, the processor 254 corrects the image parameters of the filter according to the correction weight, and in consideration of the situation that the image parameters of the filter may need to be corrected for multiple times, after correcting the image parameters of the filter according to the correction weight, the processor 254 compares the primary color ratio of the image corrected by the filter with the RGB ratio of the reference image stored in the database, and if the difference between the primary color ratio of the image corrected by the filter and the primary color ratio of the reference image is greater than a second threshold value, it is determined to continue to correct the primary color ratio of the image corrected by the filter; and if the difference value between the primary color ratio of the image corrected by the filter and the primary color ratio of the reference image is less than or equal to a second threshold value, determining that the primary color ratio of the image corrected by the filter is not corrected any more. If the primary color proportion of the image after being corrected by the filter is determined to be corrected continuously, the correction weight corresponding to each primary color is determined again according to the difference value between the primary color proportion of the image after being corrected by the filter and the primary color proportion of the reference image, the image parameters of the filter are corrected according to the determined correction weight, the step of correcting the image parameters of the filter by the processor 254 according to the correction weight is repeated until the primary color proportion of the image after being corrected by the filter is determined not to be corrected, and then the display is controlled to output the corrected image.

The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.

Fig. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application. The image processing apparatus is applied to a display device. As shown in fig. 6, an image processing apparatus 600 according to an embodiment of the present application includes: a first determination module 601, a processing module 602, and a control module 603.

The first determining module 601 is configured to determine whether to correct a base color ratio of an image output by the camera when a distance between the shooting target and the camera is smaller than a first threshold.

And the processing module 602 is configured to determine, if yes, a correction weight corresponding to each primary color according to the primary color ratio.

And a control module 603 configured to control the display to output an image according to the correction weight.

In some possible implementations, the first determining module 601 may be specifically configured to: comparing the primary color proportion of the image output by the camera with the primary color proportion of a reference image, wherein the reference image is an image with the standard primary color proportion in the same color temperature environment as the image output by the camera; if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is larger than a second threshold value, determining to correct the primary color ratio of the image output by the camera; and if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is smaller than or equal to a second threshold value, determining not to correct the primary color ratio of the image output by the camera.

In some possible implementations, the processing module 602 may be specifically configured to: and determining the correction weight corresponding to each primary color according to the difference value of the primary color proportion and the primary color proportion of a reference image, wherein the reference image is an image with the standard primary color proportion in the same color temperature environment as the image output by the camera.

In some possible implementations, the control module 603 may be specifically configured to: sending the correction right to the camera again so that the camera performs dynamic color matrix correction on the output image; and controlling the display to output the image from the camera after the dynamic color matrix correction.

In some possible implementations, the control module 603 may be specifically configured to: correcting the image parameters of the filter according to the correction weight; and controlling the display to output the corrected image.

Fig. 7 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present application. As shown in fig. 7, the image processing apparatus 700 according to the embodiment of the present application may further include, in addition to the apparatus configuration shown in fig. 6:

the second determining module 604 is configured to determine a distance according to at least one frame of image output by the camera, where the image includes a shooting target.

In some possible implementations, the second determining module 604 may be specifically configured to: respectively extracting a characteristic diagram of a shooting target in each frame of image; determining the proportion of the characteristic diagram of the shooting target in the corresponding image; and determining the distance according to the proportion.

In some possible implementations, the second determining module 604 may be specifically configured to: by means of the distance sensor, the distance is determined.

It should be noted that the apparatus provided in this embodiment may be used to execute the image processing method, and the implementation manner and the technical effect are similar, which are not described herein again.

It should be noted that the division of the modules of the above apparatus is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or can be implemented in the form of hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the processing module may be a processing element that is separately configured, or may be integrated into a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and a processing element of the apparatus calls and executes a function of the processing module. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more ASICs (Application Specific Integrated circuits), or one or more DSPs (Digital Signal processors), or one or more FPGAs (Field Programmable Gate arrays), etc. For another example, when some of the above modules are implemented in the form of processing element dispatcher code, the processing element may be a general purpose processor, such as a CPU or other processor that can invoke the program code. As another example, these modules may be integrated together and implemented in the form of a System-on-a-Chip (SOC).

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs. The procedures or functions according to the embodiments of the present application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer program can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer program can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wirelessly (e.g., infrared, wireless, microwave, etc.). Computer-readable storage media can be any available media that can be accessed by a computer or a data storage device, such as a server, data center, etc., that includes one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.

The present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the image processing method according to any one of the above method embodiments is implemented.

Embodiments of the present application further provide a computer program product, which includes a computer program, where the computer program is stored in a computer-readable storage medium, and at least one processor can read the computer program from the computer-readable storage medium, and when the computer program is executed by the at least one processor, the at least one processor can implement the image processing method according to any one of the above method embodiments.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display;

a camera for taking an image;

a processor coupled to the display, the processor configured to:

and controlling the display to output images according to the correction weight.

2. The display device according to claim 1, wherein the processor, when configured to determine whether to correct a base color ratio of an image output by the camera, is specifically configured to:

comparing the primary color ratio of the image output by the camera with the primary color ratio of a reference image, wherein the reference image is an image with a standard primary color ratio in the same color temperature environment as the image output by the camera;

if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is larger than a second threshold value, determining to correct the primary color ratio of the image output by the camera;

and if the difference value between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is smaller than or equal to a second threshold value, determining not to correct the primary color ratio of the image output by the camera.

3. The display device according to claim 1, wherein the processor, when configured to determine the correction weight corresponding to each primary color according to the primary color ratio, is specifically configured to:

and determining a correction weight corresponding to each primary color according to the difference value of the primary color ratio and the primary color ratio of a reference image, wherein the reference image is an image with the standard primary color ratio in the same color temperature environment as the image output by the camera.

4. A display device according to any one of claims 1 to 3, wherein the processor, when being configured to control the display to output an image in dependence on the correction weight, is specifically configured to:

and retransmitting the correction right to the camera so that the camera performs dynamic color matrix correction on the output image:

and controlling the display to output the image from the camera after the dynamic color matrix correction.

5. A display device as claimed in any one of claims 1 to 3, wherein the processor, when being configured to control the display to output an image in dependence on the correction weight, is specifically configured to:

correcting the image parameters of the filter according to the correction weight;

and controlling the display to output the corrected image.

6. The display device according to any one of claims 1 to 3, wherein the processor is further configured to:

and determining the distance according to at least one frame of image output by the camera, wherein the image comprises the shooting target.

7. The display device according to claim 6, wherein the processor, when being configured to determine the distance based on at least one frame of image output by the camera, is specifically configured to:

respectively extracting a characteristic diagram of a shooting target in each frame of image;

determining the proportion of the characteristic diagram of the shooting target in the corresponding image;

and determining the distance according to the proportion.

8. The display device according to claim 6, wherein the processor, when being configured to determine the distance from the at least one frame of image output by the camera, is specifically configured to:

determining the distance by a distance sensor.

9. An image processing method applied to a display device, the image processing method comprising:

when the distance between a shooting target and a camera is smaller than a first threshold value, determining whether to correct the primary color ratio of an image output by the camera;

if yes, determining correction weight corresponding to each primary color according to the primary color proportion;

10. The method according to claim 9, wherein the determining whether to correct a base color ratio of the image output by the camera comprises:

comparing the primary color ratio of the image output by the camera with the primary color ratio of a reference image, wherein the reference image is an image with the standard primary color ratio in the same color temperature environment as the image output by the camera;