WO2020020161A1 - 显示屏状态控制系统、状态控制方法、装置和存储介质 - Google Patents

显示屏状态控制系统、状态控制方法、装置和存储介质 Download PDF

Info

Publication number
WO2020020161A1
WO2020020161A1 PCT/CN2019/097308 CN2019097308W WO2020020161A1 WO 2020020161 A1 WO2020020161 A1 WO 2020020161A1 CN 2019097308 W CN2019097308 W CN 2019097308W WO 2020020161 A1 WO2020020161 A1 WO 2020020161A1
Authority
WO
WIPO (PCT)
Prior art keywords
matrix data
signal
depth matrix
target
display screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/097308
Other languages
English (en)
French (fr)
Inventor
周新
陶炳俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shirui Electronics Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Publication of WO2020020161A1 publication Critical patent/WO2020020161A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Definitions

  • Embodiments of the present invention relate to the technical field of display devices and controls, and in particular, to a display screen state control system, a state control method, a device, and a storage medium.
  • the display of the smart terminal is controlled by judging the proximity or distance between the smart terminal and an external object, specifically through the infrared emitted by the infrared transmitter.
  • the light is reflected by the obstruction to form reflected light, and according to the intensity value of the reflected light, it is determined whether the obstruction is close to the smart interactive device or away from the smart interactive device, and then the bright state of the smart device display screen is controlled.
  • the judgment standard is single, and it is easy to cause misjudgment or omission of judgment, which causes the smart device to turn off the screen and control the bright screen. accurate.
  • Embodiments of the present invention provide a display screen state control system, a display screen state control method, a device, and a storage medium.
  • the target three-dimensional depth matrix data is used to identify the scene where the display screen is currently located, and then the display screen state is automatically controlled.
  • an embodiment of the present invention provides a display screen state control system.
  • the display screen state control system includes a display screen, a signal transmitter, a signal receiver, and a camera.
  • the display screen further includes a processor.
  • the signal transmitter and the signal receiver correspond to each other to form a plurality of signal detection groups
  • the signal transmitter is used to transmit the detection signal outward
  • the signal receiver is used to receive the reflection signal formed by the detection signal coming into contact with an external object
  • the camera is used to collect photos of external objects in the current scene
  • the processor is configured to generate the target 3D depth matrix data of the area directly opposite the display surface according to the detection signal, the reflection signal and the photo, and compare the target 3D depth matrix data and the system 3D depth matrix data to determine the working mode of the display screen.
  • an embodiment of the present invention further provides a method for controlling a display screen state, the method includes:
  • the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal.
  • the detection signal is transmitted to the external object by the signal transmitter.
  • the reflection signal is formed by the reflection of the detection signal when it contacts the external object.
  • an embodiment of the present invention further provides a display screen state control device, where the device includes:
  • Data calculation module for calculating the depth matrix data, wherein the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal, the detection signal is transmitted to the external object by the signal transmitter, and the reflection signal is the detection signal contacting the external object Reflections formed and received by the signal receiver;
  • a data processing module for analyzing photos of external objects, and synthesizing the analysis result and the depth matrix data into a target three-dimensional depth matrix data
  • a working mode determining module is used to determine the working mode of the display screen by comparing the target three-dimensional depth matrix data with the system three-dimensional depth matrix data.
  • an embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the method for controlling a display screen state as in any of the embodiments of the present invention is implemented.
  • the display screen state control system includes: a display screen, a signal transmitter, a signal receiver, and a camera.
  • the display screen further includes a processor; the signal transmitter and the signal receiver correspond to each other to form a plurality of signal detection groups. ;
  • the signal transmitter is used to transmit the detection signal outward, and the signal receiver is used to receive the reflection signal formed by the detection signal coming into contact with the external object;
  • the camera is used to collect photos of external objects in the current scene;
  • the processor is used to detect the The photo generates the target 3D depth matrix data of the area directly opposite the display area, and compares the target 3D depth matrix data with the system 3D depth matrix data to determine the working mode of the display screen.
  • the target three-dimensional depth matrix data is used to identify the scene where the display is currently located, and then the status of the display is automatically controlled.
  • the display area and the detection area are integrated into the design, which improves the use of the design space. Rate, the industrial design space of the whole machine is reserved, and the upper limit of the industrial design of the whole machine is increased.
  • FIG. 1a is a schematic structural diagram of a display screen state control system according to the first embodiment of the present invention
  • FIG. 1b is a schematic diagram of interaction between a display screen and a person applicable in the first embodiment of the present invention
  • FIG. 1c is a working principle diagram of a signal transmitter and a signal receiver in a display screen applicable to the first embodiment of the present invention
  • FIG. 2 is a flowchart of a method for controlling a display screen state according to a second embodiment of the present invention
  • FIG. 3 is a flowchart of a method for controlling a display screen state according to a third embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a display screen state control device in Embodiment 4 of the present invention.
  • FIG. 1a is a schematic structural diagram of a display screen state control system according to Embodiment 1 of the present invention.
  • the display screen state control system includes a signal transmitter 110, a signal receiver 120, a camera 130, and a display screen 150.
  • the display screen 150 further includes a processor 140.
  • the signal transmitter 110 and the signal receiver 120 correspond to each other to form a plurality of signal detection groups; the signal transmitter 110 is used to transmit a detection signal outward, and the signal receiver 120 is used to receive a reflection formed by the detection signal contacting an external object and reflecting the reflection Signal; camera 130 is used to collect photos of external objects in the current scene; processor 140 is used to generate three-dimensional depth matrix data of the area directly opposite the display surface based on the detection signals, reflection signals and photos, and compare the target three-dimensional depth matrix data with the system three-dimensional Depth matrix data to determine the operating mode of the display.
  • the signal transmitter 110 is configured to transmit a detection signal outward, and the detection signal is reflected after contacting an external object to form a reflection signal.
  • the signal receiver 120 is configured to receive the signal.
  • the reflected signal, the signal transmitter 110 and the signal receiver 120 correspond to each other to form a plurality of signal detection groups.
  • the camera 130 is used to collect photos of external objects in the current scene, and the photos are two-dimensional plan views.
  • the external objects include people and other obstacles, such as walls, tables, chairs, or doors.
  • the processor 140 in the display screen 150 is configured to generate the three-dimensional depth matrix data of the area directly opposite the display surface according to the detection signal, the reflection signal and the photo, and compare the target three-dimensional depth matrix data and the system three-dimensional depth matrix data to determine the working mode of the display screen. . Specifically, the processor 140 compares the target three-dimensional depth matrix data with the system three-dimensional depth matrix data, and determines the working mode of the display screen according to the comparison result.
  • the working modes of the display screen include a standby working mode, a normal startup working mode, and a low power consumption working mode.
  • the relationship between the setting positions of the signal transmitter 110, the signal receiver 120, and the camera 130 and the position of the display screen is not limited, that is, the signal transmitter 110, the signal receiver 120, and the camera 130 may be disposed on the display screen 150 or may not be disposed on the display screen 150.
  • FIG. 1a is only used to illustrate the positional relationship and / or connection relationship of the signal transmitter 110, the signal receiver 120, the camera 130, and the display screen 150, and is not specifically limited.
  • the signal transmitter 110, the signal receiver 120, and the camera 130 can all be set on the display screen 150 for description.
  • FIG. 1b shows a schematic diagram of a display screen interacting with a person Among them, each signal detection group is evenly disposed on the display screen, and the camera 130 is disposed at the center of the frame directly above the display screen. It should be noted that FIG. 1b is only for illustration, and cannot limit the number and positions of the signal detection group and the camera 130.
  • the signal transmitter is usually a micro signal transmitter
  • the signal receiver is usually a micro signal receiver.
  • Each group of RGB sub-pixels constitutes an RGB sub-pixel, and a signal transmitter or signal receiver is set between two adjacent RGB pixels.
  • the size of the signal transmitter and signal receiver is not limited, and the signal transmission is guaranteed.
  • the receiver and signal receiver do not affect the normal operation of other sensor devices in the display to display the display screen normally.
  • the display screen is not only used to display the screen, but also can automatically adjust the display state of the display screen in response to the reflected signal received by the signal receiver.
  • Figure 1c shows the working principle of a signal transmitter and a signal receiver in a display screen, where 36 groups of RGB sub-pixels are exemplarily drawn, Xm is a signal transmitter, Yn is a signal receiver, and m is 14 , 24, 34, 44, 54, 64, 74, 84, 94, 104, 114, 124; 112, 212, 312, 412, 512, 612, 712, 812, 912, 1012, 1112, 1212, etc .; take n 18, 28, 38, 48, 58, 68, 78, 88, 98, 108, 118, 128.
  • X14 and Y18 are the first signal detection group, X14 is the first signal transmitter, Y18 is the first signal receiver, and point A is the first signal detection point; X84 and Y88 are the second signal detection group, X84 Is the second signal transmitter, Y88 is the second signal receiver, point B is the second signal detection point; X124 and Y128 are the third signal detection group, X124 is the third signal transmitter, and Y128 is the third signal receiver, Point C is the third signal detection point.
  • the signal detection groups in FIG. 1c are only for illustration, and do not represent the number and positions of the actual signal detection groups.
  • the signal transmitter transmits the detection signal to the signal detection point to form a reflected signal, and the signal receiver receives the reflected signal.
  • the RGB sub-pixel area in FIG. 1c is a display area
  • the setting areas of the signal transmitter and the signal receiver are detection areas.
  • Different types of sensor devices can be set in the display area according to the different materials of the display.
  • the displays can be divided into cathode ray tube displays, plasma displays, and liquid crystal displays.
  • the detection area and the display area are integrated and designed to improve the utilization rate of the design space.
  • a time-depth matrix can be generated based on the transmission time of the detection signal and the reception time of the reflection signal.
  • the original RGB sub-pixels of the display screen can be adjusted to RGBX (Y) sub-pixels, and the X (Y) sub-pixels can be adjusted. Pixels are defined for signal transmission (reception) coding. R, G, and B represent red, green, and blue sub-pixels, X is the signal transmitter, and Y is the signal receiver.
  • the photo information is combined with the depth matrix data to obtain three-dimensional depth matrix data, thereby achieving three-dimensional ranging, and comparing and identifying the three-dimensional depth matrix data with the system three-dimensional depth matrix data to meet the identification of the current scene where the display screen is located. Then, the display state of the display screen is determined according to the current scene.
  • the signal transmitter 110 is an invisible light transmitter
  • the signal receiver 120 is an invisible light receiver
  • the signal detection group is evenly disposed on the display screen 150.
  • visible light is a part of the electromagnetic spectrum that human eyes can perceive. There is no precise range in the visible spectrum.
  • the wavelength of electromagnetic waves that can be perceived by human eyes is between 400 and 760 nm.
  • the visible light transmitter is a transmitter that can emit visible light.
  • Invisible light usually refers to electromagnetic waves of wavelengths that are invisible to everyone's eyes except visible light, including radio waves, microwaves, infrared light, ultraviolet light, gamma rays, and far infrared rays.
  • Invisible light emitters are emissions that emit invisible light. Device.
  • the signal transmitter emits light (detection signal) with a specific wavelength, and when it encounters an obstacle, it reflects to form a transmission signal, and the signal receiver receives the reflected signal.
  • the invisible light transmitter and the invisible light receiver are adopted to avoid interference with the visible light sensor device set in the display area of the display screen and affect the display effect of the display screen.
  • the display screen state control system disclosed in the embodiment of the present invention a display screen, a signal transmitter, a signal receiver, and a camera, and the display screen further includes a processor; the signal transmitter and the signal receiver correspond to each other to form a plurality of signal detection groups; The detection group is evenly arranged on the display screen, and the detection direction of the signal detection group is the same as that of the display surface of the display screen; the signal transmitter is used to transmit the detection signal outward, and the signal receiver is used to receive the reflection signal formed by the detection signal contacting the external object and reflecting ;
  • the camera is used to collect photos of external objects in the current scene; the processor is used to generate three-dimensional depth matrix data of the area directly opposite the display surface based on the detection signals, reflection signals and photos, and compare the target three-dimensional depth matrix data with the system three-dimensional depth matrix data, Determine the operating mode of the display.
  • the current three-dimensional depth matrix data is used to identify the current scene of the display screen, and then the display screen state is automatically controlled.
  • sensors such as : Laser transmitters, time-of-flight receivers, time-of-flight modules, infrared transmitters and infrared receivers, etc. It is difficult to implement such sensors in narrow or borderless products.
  • sensors or other hardware modules are usually added to the display screen to achieve the collection of depth data in the following two ways, and then to identify the scene where the intelligent interactive device is located according to the depth data: First, the structured light solution, through Structured light projection module, ordinary RGB module, structured light receiving module, which achieves depth data collection through distortion. Second, the time-of-flight scheme is composed of an invisible light transmitter module, a receiving module and an image processing system. Time difference enables deep data acquisition.
  • the embodiments of the present invention solve the above-mentioned problems in the prior art. Specifically, by setting a signal transmitter and a signal receiver in the display area, the display area and the detection area are integrated and designed, thereby improving the utilization rate of the design space and retaining The industrial design space of the whole machine raises the upper limit of the whole machine industrial design.
  • the following problems existing in the prior art are solved: a large amount of space needs to be reserved for installing sensors in the frame of the whole machine, the operating space for the industrial design of the whole machine is limited, and the upper limit of the industrial design of the whole machine is low.
  • FIG. 2 is a flowchart of a display screen state control method provided in Embodiment 2 of the present invention. This embodiment is applicable to a case where the current scene is automatically identified to control the display screen state.
  • the method may be implemented by the display screen provided by the embodiment of the present invention.
  • the state control device executes the device, and the device may be implemented by software and / or hardware, and is generally integrated in a processor of a display screen. Referring to FIG. 2, the method may specifically include the following steps:
  • the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal.
  • the detection signal is transmitted to the external object by the signal transmitter.
  • the reflection signal is formed by the reflection of the detection signal upon contact with the external object. Received by the signal receiver.
  • the process of calculating the depth matrix data is completed by the processor of the display screen.
  • the specific implementation process is as follows.
  • the time when the recording signal transmitter transmits the detection signal to an external object is recorded as T1
  • the detection signal is reflected by the external object to form a reflection signal
  • the time when the signal receiver receives the transmission signal is recorded as T2.
  • the signal transmitter and the signal receiver correspond to each other to form a plurality of signal detection groups, and calculate the depth matrix data corresponding to each signal detection group, that is, the depth matrix data stores the transmission time and reception time of each signal detection group. If the display screen includes 30 signal detection groups, and each signal detection group includes a one-to-one corresponding signal transmitter and signal receiver, the depth matrix data stores data corresponding to 30 groups of transmission time and reception time.
  • S220 Analyze the photo of the external object, and synthesize the analysis result and the depth matrix data into the target three-dimensional depth matrix data.
  • the analysis of the photos of the external objects and the synthesis of the target three-dimensional depth matrix data are performed by the processor of the display screen.
  • the camera of the display screen takes pictures of external objects, and the external objects include all objects in the area that the camera can take.
  • the set image synthesis algorithm may be PCA (Principal Component Analysis), and the set image synthesis algorithm is used to combine the image analysis result and the depth matrix data into the target three-dimensional depth matrix data.
  • S230 Compare the target three-dimensional depth matrix data with the system three-dimensional depth matrix data to determine the working mode of the display screen.
  • the processor in the display screen compares the target three-dimensional depth matrix data with the system three-dimensional depth matrix data, and determines the working mode of the display screen according to the comparison result.
  • the working modes of the display screen include a standby working mode, a normal startup working mode, and a low power consumption working mode.
  • the calculation of the depth matrix data may be implemented by: calculating a time difference according to the transmission time of the detection signal and the reception time of the reflection signal; calculating the depth matrix data according to the relationship between the time difference and the target position, where the target position relationship is determined by the target detection point The positional relationship with the detection area of the external object is determined.
  • the target detection point is a target point formed by the detection signal transmitted to the external object, and the detection area of the external object is the area of the external object that the detection signal can detect.
  • the external object detection area is an area where external signals can be detected by the detection signal.
  • the size of the external object detection area is related to the position of the signal transmitter on the display screen and the position of the signal receiver on the display screen.
  • the display is a standard rectangle as an example.
  • the size of the external object detection area is determined by a quadrilateral size consisting of a sequence of linearly connected signal transmitters or signal receivers installed at the top, bottom, left, and right of the display screen. .
  • the size of the external object detection area can be set to be slightly larger than the size of the quadrangle to ensure that the external object is detected to obtain its depth matrix data.
  • the size of the detection area of the external object refers to the planar size of the detection area of the external object.
  • the plane size is 2m ⁇ 2m as an example.
  • the target detection point is a target point formed by the detection signal transmitted to the external object.
  • the positional relationship between the detection point and the detection area of the external object refers to the relative positional relationship of the target detection point in the detection area of the external object. For example, if the upper left corner of the detection area of the external object is the reference point O, the target detection point is located at the distance point.
  • the distance of O is 1m ⁇ 1m, that is, the target detection point is located at 1m ⁇ 1m in the external object detection area of 2m ⁇ 2m.
  • points A, B, and C can be used as target detection points, respectively.
  • a set image synthesis algorithm to synthesize the analysis result and depth matrix data into the target three-dimensional depth matrix data, which can be implemented as follows: intercepting photos of external objects corresponding to the size of the display screen as the target photos ; Use the set image synthesis algorithm to correspond the depth matrix data to the pixels of the target photo one by one to determine the target three-dimensional depth matrix data.
  • the size of the photo of the external object is related to the size of the display screen, and also related to the installation position of the camera on the display screen. Since the area corresponding to the depth matrix data is an external object detection area, in order to make the size of the external object detection area correspond to the target photo size in order to achieve an undistorted image synthesis effect, a photo of the external object corresponding to the size of the display screen is taken as Target photo.
  • the distance between the display screen and the external object and the position of the camera in the display screen determine the range of the external object taken by the external object photo.
  • the camera is located at the center of the frame on the display screen.
  • the size of the external object detection area is 2m ⁇ 2m as an example. Taking a photo of an external object corresponding to the size of the display screen refers to taking a photo with a shooting area of 2m ⁇ 2m as the target photo.
  • the pixel points of the target photo are determined according to the resolution of the display screen, and the depth matrix data is corresponding to the pixel points of the target photo one by one using the set image synthesis algorithm to determine the target three-dimensional depth matrix data.
  • the depth matrix data is calculated, wherein the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal, the detection signal is transmitted to the external object by the signal transmitter, and the reflection signal is the detection signal contacting the external object
  • the reflection is formed and received by the signal receiver; the photos of the external objects are analyzed, and the analysis results and depth matrix data are combined into the target three-dimensional depth matrix data; the target three-dimensional depth matrix data and the system three-dimensional depth matrix data are compared to determine the working mode of the display screen.
  • Depth matrix data is introduced.
  • the transmission time of the detection signal and the reception time of the reflection signal are combined with photos of external objects in the current scene to determine the screen display status of the display screen from multiple perspectives.
  • the display screen state control method provided by the embodiment of the present invention is implemented based on the display screen provided in the foregoing embodiment.
  • the display screen state control method can be implemented.
  • a terminal device such as a smart interactive device (such as a smart interactive tablet) ), Smart TV, etc.
  • the processor in the display screen may be integrated in the processor or processing unit of the terminal device.
  • the components of the terminal device include, but are not limited to, one or more processors or processing units, system memory, and connecting different system components. (Including system memory and processing unit) data bus.
  • Terminal devices typically include a variety of computer system-readable media. These media can be any available media that can be accessed by the end device, including volatile and non-volatile media, removable and non-removable media.
  • the terminal device may also communicate with one or more external devices (such as a keyboard, pointing device, display, etc.), may also communicate with one or more devices that enable a user to interact with the terminal device, and / or with the terminal device Any device (such as a network card, modem, etc.) that can communicate with one or more other computing devices.
  • the processing unit of the terminal device executes various functional applications and data processing by running a program stored in a system memory, for example, to implement a display screen state control method provided by an embodiment of the present invention:
  • the processing unit realizes when executing the program: calculating the depth matrix data, wherein the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal, the detection signal is transmitted to the external object by the signal transmitter, and the reflection signal is the detection signal Reflected by contact with external objects and received by the signal receiver; Analyze photos of external objects, and combine the analysis results with depth matrix data to target three-dimensional depth matrix data; compare the target three-dimensional depth matrix data with the system three-dimensional depth matrix data to determine the display Working mode.
  • FIG. 3 is a flowchart of a method for controlling a display screen state according to Embodiment 3 of the present invention. Based on the foregoing embodiment, this embodiment determines a display screen by comparing the target three-dimensional depth matrix data with the system three-dimensional depth matrix data. Work mode "has been optimized. Referring to FIG. 3, the method may specifically include the following steps:
  • the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal.
  • the detection signal is transmitted to the external object by the signal transmitter.
  • the reflection signal is formed by the reflection of the detection signal upon contact with the external object. Received by the signal receiver.
  • S320 Analyze the photos of the external objects, and synthesize the analysis result and the depth matrix data into the target three-dimensional depth matrix data.
  • system three-dimensional depth matrix data includes system character three-dimensional depth matrix data and system environment three-dimensional depth matrix data.
  • the terminal device uses an intelligent interactive tablet as an example.
  • the system's three-dimensional depth matrix data is stored in the intelligent interactive tablet in advance for the product designer.
  • the system's three-dimensional depth matrix data is obtained by the product designer through multiple experiments, for example, through multiple experiments.
  • a person enters the conference room multiple times, assuming that one person enters each time as an example, at a set distance from the display screen in the conference room, obtain a two-dimensional photo of the tester, record the emission of the signal transmitted by the signal transmitter
  • the detection signal is sent to the tester to form a reflection signal, that is, the tester acts as an obstacle, records the reception time of the signal receiver to receive the reflection signal, and determines the time-depth matrix data according to the transmission time and the reception time.
  • the three-dimensional depth matrix data of the system character is determined.
  • the method of determining the three-dimensional depth matrix data of the system environment is the same, and the tester is replaced with a test object, such as a table or a chair, which is not repeated here.
  • the display screen is instructed to enter the working mode, where the target three-dimensional depth matrix data is the same as the data of the system character three-dimensional depth matrix data that is greater than the first set threshold value. .
  • the target three-dimensional depth matrix data is also time data. It is determined that the target three-dimensional depth matrix data is the same as the system character three-dimensional depth matrix data. If the number is greater than the first set threshold, the target three-dimensional depth matrix data and The three-dimensional depth matrix data of the system characters is the same, which indicates that the corresponding character is in front of the display screen in the current scene, that is, the recognition result is a person mode, indicating that the display screen enters the working mode, and the display screen is automatically turned on.
  • an automatic sign-in can also be implemented, for example, recording the start and end time of today's meeting for reference by people who use the meeting room next time.
  • target three-dimensional depth matrix data is the same as the system environment three-dimensional depth matrix data, instruct the display screen to remain in a standby state, where the target three-dimensional depth matrix data is the same as the data in the system environment three-dimensional depth matrix data that is greater than the second set number threshold. .
  • the target three-dimensional depth matrix data is also time data. It is determined that the target three-dimensional depth matrix data is the same as the system environment three-dimensional depth matrix data. If the number is greater than the second set number threshold, the target three-dimensional depth matrix data and the The three-dimensional depth matrix data of the system environment is the same, which indicates that the front of the display screen in the current scene is the corresponding environment, that is, if it is recognized that no one enters the current scene in the unmanned mode (environment mode), it indicates that the display screen remains in a standby state. To reduce the power consumption of the display. Optionally, when it is detected that the participant leaves the conference room, the display screen is automatically turned off.
  • the application scenario of the intelligent interactive tablet may be a conference scenario, one is a conference room unmanned scenario (environment scenario), and the other is a conference room meeting scenario (character scenario).
  • the display screen automatically confirms whether it is the same as the figure (the target 3D depth matrix data is the same as the system character 3D depth matrix data) to determine the display state of the display screen.
  • the display screen in the embodiment of the present invention can also be applied in the field of smart home.
  • the display screen is instructed to enter the working mode; if the target 3D depth matrix data is the same as the system environment 3D depth matrix data, the display screen is maintained on standby. status.
  • FIG. 4 is a schematic structural diagram of a display screen state control device according to a fourth embodiment of the present invention.
  • the device is suitable for executing a display screen state control method provided by an embodiment of the present invention, and is generally integrated into a display screen processor. in. As shown in FIG. 4, the device may specifically include:
  • a data calculation module 410 is configured to calculate depth matrix data, where the depth matrix data is determined by a transmission time of a detection signal and a reception time of a reflection signal, the detection signal is transmitted to an external object by a signal transmitter, and the reflection signal is that the detection signal contacts the outside The object is formed by reflection and is received by the signal receiver;
  • a data processing module 420 configured to analyze photos of external objects, and synthesize the analysis result and the depth matrix data into a target three-dimensional depth matrix data
  • the working mode determining module 430 is configured to compare the target three-dimensional depth matrix data with the system three-dimensional depth matrix data to determine the working mode of the display screen.
  • the data calculation module 410 is specifically configured to:
  • the depth matrix data is calculated according to the time difference and the target position relationship.
  • the target position relationship is determined by the position relationship between the target detection point and the detection area of the external object.
  • the target detection point is the target point formed by the detection signal transmitted to the external object.
  • the detection area is an area of an external object that can be detected by a detection signal.
  • the data processing module 420 is specifically configured to:
  • one-to-one correspondence between the depth matrix data and the pixels of the target photo is performed to determine the target three-dimensional depth matrix data.
  • system three-dimensional depth matrix data includes a system character three-dimensional depth matrix data and a system environment three-dimensional depth matrix data;
  • the working mode determination module 430 is specifically configured to:
  • the display screen is instructed to maintain a standby state.
  • the same target three-dimensional depth matrix data as the system character three-dimensional depth matrix data includes:
  • the target three-dimensional depth matrix data is the same as the data in the system character three-dimensional depth matrix data that is greater than the first set number threshold;
  • the target 3D depth matrix data is the same as the system environment 3D depth matrix data including:
  • the target three-dimensional depth matrix data is the same as the data in the system environment three-dimensional depth matrix data that is greater than the second set number threshold.
  • the display screen state control device provided by the embodiment of the present invention can execute the display screen state control method provided by any embodiment of the present invention, and has function modules and beneficial effects corresponding to the execution method.
  • Embodiment 5 of the present invention provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the method for controlling a display screen state provided by all the embodiments of the present invention is implemented:
  • the program is implemented when the processor executes: calculating the depth matrix data, wherein the depth matrix data is determined by the transmission time of the detection signal and the reception time of the reflection signal, and the detection signal is transmitted to the external object by the signal transmitter, and the reflection signal is The detection signal is reflected by contact with an external object and is received by the signal receiver; the photos of the external object are analyzed, and the analysis result and depth matrix data are combined into the target 3D depth matrix data; the target 3D depth matrix data and the system 3D depth matrix data are compared to determine The operating mode of the display.
  • the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium.
  • the computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.
  • the computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave, which carries a computer-readable program code. Such a propagated data signal may take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
  • the computer program code for performing the operations of the present invention may be written in one or more programming languages or combinations thereof.
  • the programming languages include object-oriented programming languages such as Java, Smalltalk, C ++, and also conventional procedural Programming language—such as "C" or a similar programming language.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, as an independent software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider) Internet connection).
  • LAN local area network
  • WAN wide area network
  • Internet service provider Internet service provider
  • a display screen state control system which includes a display screen, a signal transmitter, a signal receiver, and a camera.
  • the display screen includes a processor, a signal transmitter and a signal receiver to form a plurality of signal detection groups one by one; the signal transmitter is used to transmit a detection signal outward, and the signal receiver is used to receive a reflection signal formed by the detection signal contacting an external object and reflecting;
  • the integrated design of the display area and the detection area has been improved. Utilization of design space, retaining the industrial design space of the whole machine, and improving the upper limit technical effect of the whole machine industrial design.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本申请公开了一种显示屏状态控制系统、状态控制方法、装置和存储介质，该显示屏状态控制系统包括显示屏、信号发射器、信号接收器和摄像头显示屏进一步包括处理器；信号发射器和信号接收器一一对应组成多个信号检测组；信号发射器用于向外发射探测信号，信号接收器用于接收探测信号接触到外部物体反射形成的反射信号；摄像头用于采集当前场景中外部物体的照片；处理器用于根据探测信号、反射信号和照片生成显示面正对区域的目标三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。

Description

显示屏状态控制系统、状态控制方法、装置和存储介质 技术领域
本发明实施例涉及显示设备及其控制技术领域，尤其涉及一种显示屏状态控制系统、状态控制方法、装置和存储介质。
背景技术
随着智能终端技术的发展，智能设备的应用越来越普及，通常通过判断智能终端与外部物体之间的接近或远离状态来控制智能终端显示屏的亮灭，具体通过红外发射器发出的红外光线经过遮挡物反射后形成反射光线，根据反射光线的强度值来判断遮挡物是靠近智能交互设备还是远离智能交互设备，进而控制智能设备显示屏的亮屏状态。
在实现本发明的过程中，发明人发现现有技术中至少存在如下问题：现有技术中，判断标准单一，很容易出现误判或漏判，从而导致智能设备的熄屏、亮屏控制不准确。
发明内容
本发明实施例提供一种显示屏状态控制系统、显示屏状态控制方法、装置和存储介质，通过目标三维深度矩阵数据来识别显示屏当前所处场景，进而自动控制显示屏状态。
第一方面，本发明实施例提供了一种显示屏状态控制系统，该显示屏状态控制系统包括：显示屏、信号发射器、信号接收器和摄像头，显示屏进一步包括处理器；
信号发射器和信号接收器一一对应组成多个信号检测组；
信号发射器用于向外发射探测信号，信号接收器用于接收探测信号接触到外部物体反射形成的反射信号；
摄像头用于采集当前场景中外部物体的照片；
处理器用于根据探测信号、反射信号和照片生成显示面正对区域的目标三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
第二方面，本发明实施例还提供了一种显示屏状态控制方法，该方法包括：
计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收；
解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据；
对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
第三方面，本发明实施例还提供了一种显示屏状态控制装置，该装置包括：
数据计算模块，用于计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收；
数据处理模块，用于解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据；
工作模式确定模块，用于对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
第四方面，本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本发明实施例中任一的显示屏状态控制方法。
本发明实施例中提供的显示屏状态控制系统包括：显示屏、信号发射器、信号接收器和摄像头，显示屏进一步包括处理器；信号发射器和信号接收器一一对应组成多个信号检测组；信号发射器用于向外发射探测信号，信号接收器用于接收探测信号接触到外部物体反射形成的反射信号；摄像头用于采集当前场景中外部物体的照片；处理器用于根据探测信号、反射信号和照片生成显示面正对区域的目标三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。通过目标三维深度矩阵数据来识别显示屏当前所处场景，进而自动控制显示屏状态，通过在显示区域设置信号发射器和信号接收器，将显示区域和检测区域集成设计，提高了设计空间的利用率，保留了整机的工业设计空间，提高了整机工业设计的上限。
附图说明
图1a是本发明实施例一中的一种显示屏状态控制系统的结构示意图；
图1b是本发明实施例一中所适用的一种显示屏与人交互的示意图；
图1c是本发明实施例一中所适用的一种显示屏中信号发射器和信号接收器的工作原理图；
图2是本发明实施例二中的一种显示屏状态控制方法的流程图；
图3是本发明实施例三中的一种显示屏状态控制方法的流程图；
图4是本发明实施例四中的一种显示屏状态控制装置的结构示意图。
具体实施方式
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部结构。
实施例一
图1a为本发明实施例一提供的一种显示屏状态控制系统的结构示意图。参考图1a，该显示屏状态控制系统包括信号发射器110、信号接收器120、摄像头130和显示屏150，显示屏150进一步包括处理器140。
其中，信号发射器110和信号接收器120一一对应组成多个信号检测组；信号发射器110用于向外发射探测信号，信号接收器120用于接收探测信号接触到外部物体反射形成的反射信号；摄像头130用于采集当前场景中外部物体的照片；处理器140用于根据探测信号、反射信号和照片生成显示面正对区域的三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
具体的，本发明实施例提供的显示屏状态控制系统中，信号发射器110用于向外发射探测信号，探测信号接触到外部物体后进行反射，形成反射信号，信号接收器120用于接收该反射信号，信号发射器110和信号接收器120一一对应组成多个信号检测组。摄像头130用于采集当前场景中外部物体的照片，照片为二维平面图，其中，外部物体包括人物和其他障碍物，如墙壁、桌椅或门等。显示屏150中的处理器140用于根据探测信号、反射信号和照片生成显示面正对区域的三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。具体的，处理器140将目标三维深度矩阵数据和系统三维深度矩阵数据进行对比，根据对比结果确定显示屏的工作模式。其中，显示屏的工作模式包括待机工作模式、正常启动工作模式以及低功耗工作模式等。需要说明的是，本发明实施例中对信号发射器110、信号接收器120和摄像头130的设置位置与显示屏的位置关系不做限定，也即，信号发射器110、信号接收器120和摄像头130可以设置在显示屏150上，也可以不设置 在显示屏150上。此外，图1a只是用来示意信号发射器110、信号接收器120、摄像头130和显示屏150的位置关系和/或连接关系，并不形成具体限定。
在一个具体的例子中，以信号发射器110、信号接收器120和摄像头130可以均设置在显示屏150上进行说明，这种情况下，图1b示出了一种显示屏与人交互的示意图，其中，各个信号检测组均匀设置于显示屏，摄像头130设置于显示屏正上方边框的中心处。需要说明的是，图1b只是用来示意，并不能对信号检测组和摄像头130的数量和位置形成限定。
示例性的，信号发射器通常采用微型信号发射器，信号接收器通常采用微型信号接收器。每组RGB子像素点组成一个RGB子像素，相邻两个RGB像素之间设置一个信号发射器或者信号接收器，其中，对信号发射器和信号接收器的尺寸不做限定，保证该信号发射器和信号接收器不影响显示屏中其他传感器件的正常工作来正常显示显示屏画面。本发明实施例中，显示屏不仅用来显示画面，还可以通过响应信号接收器接收到的反射信号来自动调整显示屏的显示状态。
图1c示出了一种显示屏中信号发射器和信号接收器的工作原理图，其中，示例性的画出36组RGB子像素，Xm为信号发射器，Yn为信号接收器，m取14、24、34、44、54、64、74、84、94、104、114、124；112、212、312、412、512、612、712、812、912、1012、1112、1212等；n取18、28、38、48、58、68、78、88、98、108、118、128。可选的，X14和Y18为第一信号检测组，X14为第一信号发射器，Y18为第一信号接收器，A点为第一信号探测点；X84和Y88为第二信号检测组，X84为第二信号发射器，Y88为第二信号接收器，B点为第二信号探测点；X124和Y128为第三信号检测组，X124为第三信号发射器，Y128为第三信号接收器，C点为第三信号探测点。需要说明的是，图1c中的信号检测组只是用来示意，并不代表实际的信号检测组的数量和位置。信号发射器将探测信号发射到信号探测点，形成反射信号，信号接收器接收该反射信号。
示例性的，图1c中的RGB子像素区域为显示区域，信号发射器和信号接收器的设置区域为检测区域。可根据显示器制造材料的不同在显示区域中设置不同类型的传感器件，显示器可分为阴极射线管显示器、等离子显示器和液晶显示器等。本发明实施例中将检测区域和显示区域集成设计，提高了设计空间利用率。
在一个具体的例子中，可以根据探测信号的发射时间和反射信号的接收时间进行处理生成时间深度矩阵，将显示屏原本的RGB子像素调整为RGBX(Y)子像素，对X(Y)子像素进行信号发射(接收)编码定义，R、G、B分别代表红、绿、蓝子像素，X代表信号发射器，Y代表信号接收器。
也即，将照片信息与深度矩阵数据结合，获取三维深度矩阵数据，进而实现三维测距，将三维深度矩阵数据与系统三维深度矩阵数据进行对比识别，满足对显示屏所处当前场景的识别，进而根据当前场景确定显示屏的显示状态。
可选的，信号发射器110为不可见光发射器，信号接收器120为不可见光接收器，信号检测组均匀设置于显示屏150。
其中，可见光是电磁波谱中人眼可以感知的部分，可见光谱没有精确的范围，一般人的眼睛可以感知的电磁波的波长在400～760nm之间，可见光发射器为能发射可见光的发射器。不可见光通常是指除可见光外其他所有人眼所不能感知的波长的电磁波，包括无线电波，微波，红外光，紫外光，γ射线、远红外线等，不可见光发射器为能发射不可见光的发射器。本发明实施例中，信号发射器发射特定波长的光(探测信号)，遇到障碍物进行反射形成发射信号，信号接收器接收该反射信号。采用不可见光发射器和不可见光接收器，避免对显示屏中显示区域设置的可见光传感器件造成干扰，影响显示屏的显示效果。
本发明实施例公开的显示屏状态控制系统：显示屏、信号发射器、信号接收器和摄像头，显示屏进一步包括处理器；信号发射器和信号接收器一一对应组成多个信号检测组；信号检测组均匀设置于显示屏，信号检测组的检测方向与显示屏的显示面的朝向相同；信号发射器用于向外发射探测信号，信号接收器用于接收探测信号接触到外部物体反射形成的反射信号；摄像头用于采集当前场景中外部物体的照片；处理器用于根据探测信号、反射信号和照片生成显示面正对区域的三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。通过目标三维深度矩阵数据来识别显示屏当前所处场景，进而自动控制显示屏状态。
现有技术中，面对智能交互设备逐渐向全面屏、轻薄化、智能化发展的趋势，通常设置成窄边框或无边框，而智能交互设备的一些功能是通过加入相应的传感器来实现，例如：激光发射器、飞行时间接收器、飞行时间模组、红外发射器和红外接收器等，将这类传感器加入窄边框或无边框产品的实现难度大。现有技术中，通常通过以下两种方式将传感器或其他硬件模组加入显示屏中实现对深度数据的采集，进而根据深度数据来识别智能交互设备所处场景：第一、结构光方案，通过结构光投影模组、普通RGB模组、结构光接收模组，通过畸变实现深度数据采集；第二、飞行时间方案，通过由不可见光发射器模组、接收模组和图像处理系统组成，通过时间差实现深度数据采集。
此外，本发明实施例解决了上述现有技术中的问题，具体是通过在显示区域设置信号发射器和信号接收器，将显示区域和检测区域集成设计，提高了设计空间的利用 率，保留了整机的工业设计空间，提高了整机工业设计的上限。解决了现有技术中存在的如下问题：整机设备中需要在边框预留大量空间安装传感器，整机进行工业设计的操作空间受到限制，整机工业设计的上限偏低。
实施例二
图2为本发明实施例二提供的一种显示屏状态控制方法的流程图，本实施例可适用于自动识别当前场景来控制显示屏状态的情况，该方法可以由本发明实施例提供的显示屏状态控制装置来执行，该装置可采用软件和/或硬件的方式实现，并一般集成在显示屏的处理器中。参考图2，该方法具体可以包括如下步骤：
S210、计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收。
其中，计算深度矩阵数据的过程由显示屏的处理器完成。具体实现过程如下，记录信号发射器将探测信号发射到外部物体的时间，记为T1，探测信号接触到外部物体反射形成反射信号，记录信号接收器接收发射信号的时间，记为T2。其中，信号发射器和信号接收器一一对应形成多个信号检测组，计算每个信号检测组对应的深度矩阵数据，也即，深度矩阵数据存储有每个信号检测组的发射时间及接收时间，若显示屏包括30个信号检测组，每个信号检测组包括一一对应的信号发射器和信号接收器，则深度矩阵数据中存储有30组发射时间和接收时间对应的数据。
S220、解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据。
具体的，解析外部物体的照片以及合成目标三维深度矩阵数据由显示屏的处理器完成。其中，显示屏的摄像头拍着外部物体的照片，外部物体包括摄像头能拍到的区域内的全部物体，在会议应用场景，具体可以包括：会议桌椅、与会人员等。设定的图像合成算法可以是PCA(Principal Component Analysis，主成份分析法)，利用设定的图像合成算法将图片解析结果与深度矩阵数据合成目标三维深度矩阵数据。
S230、对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
具体的，显示屏中的处理器将目标三维深度矩阵数据和系统三维深度矩阵数据进行对比，根据对比结果确定显示屏的工作模式。其中，显示屏的工作模式包括待机工作模式、正常启动工作模式以及低功耗工作模式等。
可选的，计算深度矩阵数据，可以通过如下方式实现：根据探测信号的发射时间和反射信号的接收时间计算时间差；根据时间差与目标位置关系计算深度矩阵数据，其中，目标位置关系由目标探测点与外部物体的探测区域的位置关系确定，目标探测点为探测信号发射到外部物体上形成的目标点，外部物体的探测区域为探测信号能探测到的外部物体的区域。
其中，针对每个信号检测组，分别计算探测信号的发射时间T1和反射信号的接收时间T2的时间差，记为△T＝T2-T1。可选的，外部物体探测区域为探测信号能探测到的外部物体的区域，外部物体探测区域的尺寸和信号发射器在显示显示屏中的位置、信号接收器在显示屏中的位置有关，以显示屏为标准矩形为例，则由安装在显示屏屏幕最上方、最下方、最左侧和最右侧的信号发射器或信号接收器顺序直线连接组成的四边形尺寸确定外部物体探测区域的尺寸。在实际的应用中，可以将外部物体探测区域的尺寸设置为稍大于四边形尺寸，以保证完成检测到外部物体以获取其深度矩阵数据。
在一个具体的例子中，外部物体探测区域的尺寸是指外部物体探测区域的平面尺寸，该平面尺寸以2m×2m为例，目标探测点为探测信号发射到外部物体上形成的目标点，目标探测点与外部物体探测区域的位置关系是指，目标探测点对应在外部物体探测区域中的相对位置关系，例如，将外部物体探测区域中左上角为参考点O，则目标探测点位于距离点O的距离为1m×1m处，也即，在2m×2m的外部物体探测区域中，目标探测点位于1m×1m处。在一个具体的例子中，参考图1c，点A、点B和点C分别可以作为目标探测点。
示例性的，解析外部物体的照片，利用设定的图像合成算法将解析结果与深度矩阵数据合成目标三维深度矩阵数据，可以通过如下方式实现：截取与显示屏尺寸对应的外部物体照片作为目标照片；利用设定的图像合成算法将深度矩阵数据与目标照片的像素点一一进行对应，确定目标三维深度矩阵数据。
具体的，外部物体照片的尺寸和显示屏尺寸有关，还和显示屏上摄像头的安装位置有关。由于深度矩阵数据所对应的区域为外部物体探测区域，因此，为了使外部物体探测区域的尺寸和目标照片尺寸对应，以便达到不失真的图像合成效果，截取与显示屏尺寸对应的外部物体照片作为目标照片。
在一个具体的例子中，显示屏距离外部物体的距离和显示屏中摄像头的位置决定了外部物体照片所拍摄的外部物体的范围，通常情况下，摄像头位于显示屏上边框的中心处。外部物体探测区域的尺寸以2m×2m为例，截取与显示屏尺寸对应的外部物体照片是指，截取外部物体照片中，拍摄区域为2m×2m的照片作为目标照片。
此外，按照显示屏分辨率确定目标照片的像素点，利用设定的图像合成算法，将深度矩阵数据与目标照片的像素点一一进行对应，确定目标三维深度矩阵数据。
本发明实施例中，计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收；解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据；对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。引入了深度矩阵数据，利用探测信号的发射时间和反射信号的接收时间，结合当前场景中外部物体的照片，从多角度出发，确定显示屏的屏幕显示状态。
本发明实施例提供的显示屏状态控制方法基于上述实施例中提供的显示屏实现，将显示屏应用于终端设备时，可实现显示屏状态控制方法，终端设备例如智能交互设备(如智能交互平板)、智能电视等。在终端设备中，显示屏中的处理器可以集成在终端设备的处理器或处理单元中，终端设备的组件包括但不限于：一个或多个处理器或处理单元、系统存储器、连接不同系统组件(包括系统存储器和处理单元)的数据总线。
终端设备典型地包括多种计算机系统可读介质。这些介质可以是任何能够被终端设备访问的可用介质，包括易失性和非易失性介质，可移动的和不可移动的介质。终端设备也可以与一个或多个外部设备(例如键盘、指向设备、显示器等)通信，还可与一个或者多个使得用户能与该终端设备交互的设备通信，和/或与使得该终端设备能与一个或多个其它计算设备进行通信的任何设备(例如网卡，调制解调器等等)通信。
终端设备的处理单元通过运行存储在系统存储器中的程序，从而执行各种功能应用以及数据处理，例如实现本发明实施例所提供的显示屏状态控制方法：
也即，处理单元执行程序时实现：计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收；解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据；对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
实施例三
图3为本发明实施例三提供的一种显示屏状态控制方法的流程图，本实施例在上述实施例的基础上，对“对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式”进行了优化。参考图3，该方法具体可以包括如下步骤：
S310、计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收。
S320、解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据。
可选的，系统三维深度矩阵数据包括系统人物三维深度矩阵数据和系统环境三维深度矩阵数据。
其中，终端设备以智能交互平板为例，系统三维深度矩阵数据为产品设计人员预先存储在智能交互平板中，该系统三维深度矩阵数据通过产品设计人员通过多次试验获得，例如，通过多个试验人员多次进入会议室的场景中，假设每次进入一个人员为例，在距离会议室中的显示屏设定距离处，获取该试验人员的二维照片，记录信号发射器发射探测信号的发射时间，探测信号发送至该试验人员形成反射信号，也即，该试验人员作为障碍物，记录信号接收器接收该反射信号的接收时间，根据发射时间和接收时间确定时间深度矩阵数据。根据时间深度矩阵数据，结合该实验人员的二维照片，确定系统人物三维深度矩阵数据。
同理，系统环境三维深度矩阵数据的确定方法相同，将试验人员换成试验物体，例如，桌子或椅子等，在此不再赘述。
S331、若目标三维深度矩阵数据与系统人物三维深度矩阵数据相同，则指示显示屏进入工作模式，其中，目标三维深度矩阵数据与系统人物三维深度矩阵数据中大于第一设定数量阈值的数据相同。
其中，目标三维深度矩阵数据也为时间数据，判断目标三维深度矩阵数据与系统人物三维深度矩阵数据中相同的数据数量，若该数量大于第一设定数量阈值，则确定目标三维深度矩阵数据与系统人物三维深度矩阵数据相同，则表明，当前场景中显示屏前面为对应的人物，也即，识别结果为有人模式，指示显示屏进入工作模式，显示屏自动开机。可选的，在指示显示屏自动开机后，还可以实现自动签到，例如，记录今天的会议起止时间等，以供下次使用会议室的人参考。
S332、若目标三维深度矩阵数据与系统环境三维深度矩阵数据相同，则指示显示屏维持待机状态，其中，目标三维深度矩阵数据与系统环境三维深度矩阵数据中大于第二设定数量阈值的数据相同。
其中，目标三维深度矩阵数据也为时间数据，判断目标三维深度矩阵数据与系统环境三维深度矩阵数据中相同的数据数量，若该数量大于第二设定数量阈值，则确定 目标三维深度矩阵数据与系统环境三维深度矩阵数据相同，则表明，当前场景中显示屏前面为对应的环境，也即，识别到无人模式(环境模式)无人进入到当前场景中，则指示显示屏维持待机状态，以降低显示屏的功耗。可选的，在检测到与会人员离开会议室时，显示屏自动关机。
在一个具体的例子中，智能交互平板的应用场景可以是会议场景，一种是会议室无人场景(环境场景)，另一种是会议室开会场景(人物场景)。当有人进入会议室时，显示屏自动确认是否与人物图相同(目标三维深度矩阵数据是否与系统人物三维深度矩阵数据相同)，来确定显示屏的显示状态。本发明实施例中的显示屏还可以应用在智能家居领域。
本发明实施例中，若目标三维深度矩阵数据与系统人物三维深度矩阵数据相同，则指示显示屏进入工作模式；若目标三维深度矩阵数据与系统环境三维深度矩阵数据相同，则指示显示屏维持待机状态。通过对当前场景识别，结合不同的场景调整显示屏不同的工作状态，提高了显示屏利用率，节约了显示屏功耗。
实施例四
图4是本发明实施例四提供的一种显示屏状态控制装置的结构示意图，该装置适用于执行本发明实施例提供给的一种显示屏状态控制方法，并一般集成在显示屏的处理器中。如图4所示，该装置具体可以包括：
数据计算模块410，用于计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收；
数据处理模块420，用于解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据；
工作模式确定模块430，用于对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
可选地，数据计算模块410具体用于：
根据探测信号的发射时间和反射信号的接收时间计算时间差；
根据时间差与目标位置关系计算深度矩阵数据，其中，目标位置关系由目标探测点与外部物体的探测区域的位置关系确定，目标探测点为探测信号发射到外部物体上形成的目标点，外部物体的探测区域为探测信号能探测到的外部物体的区域。
可选地，数据处理模块420具体用于：
截取与显示屏尺寸对应的外部物体照片作为目标照片；
利用设定的图像合成算法将深度矩阵数据与目标照片的像素点一一进行对应，确定目标三维深度矩阵数据。
可选地，系统三维深度矩阵数据包括系统人物三维深度矩阵数据和系统环境三维深度矩阵数据；
相应的，工作模式确定模块430具体用于：
在目标三维深度矩阵数据与系统人物三维深度矩阵数据相同时，指示显示屏进入工作模式；
在目标三维深度矩阵数据与系统环境三维深度矩阵数据相同时，指示显示屏维持待机状态。
可选地，目标三维深度矩阵数据与系统人物三维深度矩阵数据相同包括：
目标三维深度矩阵数据与系统人物三维深度矩阵数据中大于第一设定数量阈值的数据相同；
目标三维深度矩阵数据与系统环境三维深度矩阵数据相同包括：
目标三维深度矩阵数据与系统环境三维深度矩阵数据中大于第二设定数量阈值的数据相同。
本发明实施例提供的显示屏状态控制装置可执行本发明任意实施例提供的显示屏状态控制方法，具备执行方法相应的功能模块和有益效果。
实施例五
本发明实施例五提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本申请所有发明实施例提供的显示屏状态控制方法：
也即，该程序被处理器执行时实现：计算深度矩阵数据，其中，深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，探测信号由信号发射器发射到外部物体，反射信号为探测信号接触到外部物体反射形成，并由信号接收器接收；解析外部物体的照片，将解析结果与深度矩阵数据合成目标三维深度矩阵数据；对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算 机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括——但不限于——电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。
计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括——但不限于——无线、电线、光缆、RF等等，或者上述的任意合适的组合。
可以以一种或多种程序设计语言或其组合来编写用于执行本发明操作的计算机程序代码，程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。
工业实用性
本申请实施例提供的方案可应用于显示设备及其控制领域，在本申请实施例中， 提供了一种显示屏状态控制系统，包括：显示屏、信号发射器、信号接收器和摄像头，该显示屏包括处理器，信号发射器和信号接收器一一对应组成多个信号检测组；信号发射器用于向外发射探测信号，信号接收器用于接收探测信号接触到外部物体反射形成的反射信号；摄像头用于采集当前场景中外部物体的照片；处理器用于根据探测信号、反射信号和照片生成显示面正对区域的目标三维深度矩阵数据，并对比目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。通过目标三维深度矩阵数据来识别显示屏当前所处的场景，进而自动控制显示屏的状态，并且通过在显示区域设置信号发射器和信号接收器，将显示区域和检测区域集成设计，取得了提高设计空间的利用率，保留整机的工业设计空间，提高整机工业设计的上限技术效果。

Claims (10)

  1. 一种显示屏状态控制系统，包括：显示屏、信号发射器、信号接收器和摄像头，所述显示屏进一步包括处理器；
    所述信号发射器和所述信号接收器一一对应组成多个信号检测组；
    所述信号发射器用于向外发射探测信号，所述信号接收器用于接收所述探测信号接触到外部物体反射形成的反射信号；
    所述摄像头用于采集当前场景中所述外部物体的照片；
    所述处理器用于根据所述探测信号、所述反射信号和所述照片生成显示面正对区域的目标三维深度矩阵数据，并对比所述目标三维深度矩阵数据和系统三维深度矩阵数据，确定所述显示屏的工作模式。
  2. 根据权利要求1所述的显示屏状态控制系统，其中，所述信号发射器为不可见光发射器；所述信号接收器为不可见光接收器；所述信号检测组均匀设置于所述显示屏。
  3. 一种显示屏状态控制方法，所述方法包括：
    计算深度矩阵数据，其中，所述深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，所述探测信号由信号发射器发射到外部物体，所述反射信号为所述探测信号接触到所述外部物体反射形成，并由信号接收器接收；
    解析所述外部物体的照片，将解析结果与所述深度矩阵数据合成目标三维深度矩阵数据；
    对比所述目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式。
  4. 根据权利要求3所述的方法，其中，计算深度矩阵数据，包括：
    根据探测信号的发射时间和反射信号的接收时间计算时间差；
    根据所述时间差与目标位置关系计算深度矩阵数据，其中，所述目标位置关系由目标探测点与外部物体的探测区域的位置关系确定，所述目标探测点为所述探测信号发射到所述外部物体上形成的目标点，所述外部物体的探测区域为探测信号能探测到的外部物体的区域。
  5. 根据权利要求3所述的方法，其中，解析外部物体的照片，利用设定的图像合成算法将解析结果与所述深度矩阵数据合成目标三维深度矩阵数据，包括：
    截取与显示屏尺寸对应的外部物体照片作为目标照片；
    利用设定的图像合成算法将所述深度矩阵数据与所述目标照片的像素点一一进行对应，确定目标三维深度矩阵数据。
  6. 根据权利要求3所述的方法，其中，所述系统三维深度矩阵数据包括系统人物三维深度矩阵数据和系统环境三维深度矩阵数据；
    相应的，对比所述目标三维深度矩阵数据和系统三维深度矩阵数据，确定显示屏的工作模式，包括：
    若所述目标三维深度矩阵数据与系统人物三维深度矩阵数据相同，则指示显示屏进入工作模式；
    若所述目标三维深度矩阵数据与系统环境三维深度矩阵数据相同，则指示显示屏维持待机状态。
  7. 根据权利要求6所述的方法，其中，所述目标三维深度矩阵数据与系统人物三维深度矩阵数据相同包括：
    所述目标三维深度矩阵数据与所述系统人物三维深度矩阵数据中大于第一设定数量阈值的数据相同；
    目标三维深度矩阵数据与系统环境三维深度矩阵数据相同包括：
    所述目标三维深度矩阵数据与所述系统环境三维深度矩阵数据中大于第二设定数量阈值的数据相同。
  8. 一种显示屏状态控制装置，包括：
    数据计算模块，设置为计算深度矩阵数据，其中，所述深度矩阵数据由探测信号的发射时间和反射信号的接收时间确定，所述探测信号由信号发射器发射到外部物体，所述反射信号为所述探测信号接触到所述外部物体反射形成，并由信号接收器接收；
    数据处理模块，设置为解析所述外部物体的照片，将解析结果与所述深度矩阵数据合成目标三维深度矩阵数据；
    工作模式确定模块，设置为对比所述目标三维深度矩阵数据和系统三维深度 矩阵数据，确定显示屏的工作模式。
  9. 根据权利要求8所述的装置，其中，所述数据计算模块具体设置为：
    根据探测信号的发射时间和反射信号的接收时间计算时间差；
    根据所述时间差与目标位置关系计算深度矩阵数据，其中，所述目标位置关系由目标探测点与外部物体的探测区域的位置关系确定，所述目标探测点为所述探测信号发射到所述外部物体上形成的目标点，所述外部物体的探测区域为探测信号能探测到的外部物体的区域。
  10. 一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如权利要求3至7中任意一项所述的方法。
PCT/CN2019/097308 2018-07-27 2019-07-23 显示屏状态控制系统、状态控制方法、装置和存储介质 Ceased WO2020020161A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810844831.5A CN108958689A (zh) 2018-07-27 2018-07-27 显示屏状态控制系统、状态控制方法、装置和存储介质
CN201810844831.5 2018-07-27

Publications (1)

Publication Number Publication Date
WO2020020161A1 true WO2020020161A1 (zh) 2020-01-30

Family

ID=64465841

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/097308 Ceased WO2020020161A1 (zh) 2018-07-27 2019-07-23 显示屏状态控制系统、状态控制方法、装置和存储介质

Country Status (2)

Country Link
CN (1) CN108958689A (zh)
WO (1) WO2020020161A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108958689A (zh) * 2018-07-27 2018-12-07 广州视源电子科技股份有限公司 显示屏状态控制系统、状态控制方法、装置和存储介质
CN115480632A (zh) * 2021-05-31 2022-12-16 华为技术有限公司 一种具有摄像头组件的显示设备及摄像角度调节方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140192259A1 (en) * 2013-01-08 2014-07-10 Leap Motion, Inc. Power consumption in motion-capture systems with audio and optical signals
CN104049708A (zh) * 2014-07-08 2014-09-17 山东超越数控电子有限公司 一种自动开关机和待机唤醒的方法
CN106293076A (zh) * 2016-07-29 2017-01-04 北京奇虎科技有限公司 通信终端及智能终端手势识别方法和装置
CN106933227A (zh) * 2017-03-31 2017-07-07 联想(北京)有限公司 一种引导智能机器人的方法以及电子设备
CN107621867A (zh) * 2017-08-09 2018-01-23 广东欧珀移动通信有限公司 熄屏控制方法、装置和终端设备
CN108958689A (zh) * 2018-07-27 2018-12-07 广州视源电子科技股份有限公司 显示屏状态控制系统、状态控制方法、装置和存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110289455A1 (en) * 2010-05-18 2011-11-24 Microsoft Corporation Gestures And Gesture Recognition For Manipulating A User-Interface
WO2014157847A1 (ko) * 2013-03-25 2014-10-02 엘지전자 주식회사 깊이 영상 획득 장치 및 그를 이용한 디스플레이 장치
EP2871843B1 (en) * 2013-11-12 2019-05-29 LG Electronics Inc. -1- Digital device and method for processing three dimensional image thereof
CN107608454B (zh) * 2017-08-31 2020-01-14 Oppo广东移动通信有限公司 显示屏及电子设备
CN107422571B (zh) * 2017-09-20 2020-08-21 京东方科技集团股份有限公司 显示面板、装置及其操控方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140192259A1 (en) * 2013-01-08 2014-07-10 Leap Motion, Inc. Power consumption in motion-capture systems with audio and optical signals
CN104049708A (zh) * 2014-07-08 2014-09-17 山东超越数控电子有限公司 一种自动开关机和待机唤醒的方法
CN106293076A (zh) * 2016-07-29 2017-01-04 北京奇虎科技有限公司 通信终端及智能终端手势识别方法和装置
CN106933227A (zh) * 2017-03-31 2017-07-07 联想(北京)有限公司 一种引导智能机器人的方法以及电子设备
CN107621867A (zh) * 2017-08-09 2018-01-23 广东欧珀移动通信有限公司 熄屏控制方法、装置和终端设备
CN108958689A (zh) * 2018-07-27 2018-12-07 广州视源电子科技股份有限公司 显示屏状态控制系统、状态控制方法、装置和存储介质

Also Published As

Publication number Publication date
CN108958689A (zh) 2018-12-07

Similar Documents

Publication Publication Date Title
US8887043B1 (en) Providing user feedback in projection environments
JP2002091683A (ja) 座標検出方法、座標入力／検出装置、電子黒板システム及び記憶媒体
WO2021135288A1 (zh) 显示器的触摸控制方法、终端设备及存储介质
US11157111B2 (en) Ultrafine LED display that includes sensor elements
CN110751735B (zh) 一种基于增强现实的远程指导的方法与设备
US9658702B2 (en) System and method of object recognition for an interactive input system
WO2020020161A1 (zh) 显示屏状态控制系统、状态控制方法、装置和存储介质
US11972512B2 (en) Directional editing of digital images
WO2019214641A1 (zh) 基于光标签的信息设备交互方法及系统
CN117939091A (zh) 投影图像处理方法和装置、电子设备、存储介质
CN117768628A (zh) 投影设备及一种投影处理方法
US10609305B2 (en) Electronic apparatus and operating method thereof
US20250285394A1 (en) Systems and methods for managing network devices using augmented reality
US20170195528A1 (en) Electronic device comprising a support device to which an imaging device is coupled
US20250292437A1 (en) Conferencing system with intelligent calibration
CN113076031B (zh) 显示设备、触摸定位方法及装置
WO2025260606A1 (zh) 显示屏的信息确定方法、系统及发送卡
CN112752088B (zh) 深度图像生成方法及装置、参考图像生成方法、电子设备
US20160091966A1 (en) Stereoscopic tracking status indicating method and display apparatus
KR101700121B1 (ko) 인터렉티브 빔 프로젝터 및 이의 구동방법
US20200389746A1 (en) Sound reproducing apparatus capable of self-diagnostic and self-diagnostic method for a sound reproducing apparatus
CN115842964A (zh) 图像采集装置、显示设备、图像处理方法及装置
CN114694544A (zh) 激光投影系统及图像校正方法
US20260104778A1 (en) Interactive system and input area setting method
CN118113176B (zh) 红外触摸屏的触控处理方法、装置、介质以及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19840434

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19840434

Country of ref document: EP

Kind code of ref document: A1