WO2023226817A1 - Procédé et appareil de traitement d'informations d'affichage, support de stockage et dispositif électronique associés - Google Patents

Procédé et appareil de traitement d'informations d'affichage, support de stockage et dispositif électronique associés Download PDF

Info

Publication number
WO2023226817A1
WO2023226817A1 PCT/CN2023/094417 CN2023094417W WO2023226817A1 WO 2023226817 A1 WO2023226817 A1 WO 2023226817A1 CN 2023094417 W CN2023094417 W CN 2023094417W WO 2023226817 A1 WO2023226817 A1 WO 2023226817A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
value
image
display
displayed
Prior art date
Application number
PCT/CN2023/094417
Other languages
English (en)
Chinese (zh)
Inventor
李理
邵雷
房浩
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Publication of WO2023226817A1 publication Critical patent/WO2023226817A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels

Definitions

  • Embodiments of the present disclosure relate to the technical field of image processing, and specifically, to a processing method for display information, a processing device for display information, a computer-readable storage medium, and an electronic device.
  • the legitimacy of the information screen can be monitored by adding visual identifiers such as QR codes to the played information screen.
  • this method will affect the integrity of the information screen during display.
  • a method for processing display information including:
  • a first digital logo image with a preset display mode is generated; wherein the preset display mode is that the Alpha channel of the first digital logo image is fully transparent ;
  • the information to be displayed is identified based on the first digital identification image, and the identified information to be displayed is placed on the display terminal.
  • the attribute information includes the display screen information of the display terminal and/or the appearance image of the display screen side seam; the display screen information includes the screen resolution of the display screen and/or display type.
  • generating a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed includes:
  • the display information processing method further includes:
  • the preset collection scene includes at least one of a preset illumination intensity, a preset collection environment, and a preset collection distance.
  • calculating the first pixel color light value of the display screen side seam based on the appearance image of the display screen side seam includes:
  • the first HSV chromaticity value of the center point of the appearance image of the edge seam of the display screen and calculate the second HSV chromaticity value according to the first HSV chromaticity value and the first random color difference value; wherein, the first The random color difference value is less than or equal to the first preset threshold;
  • the second HSV color light value is converted to obtain the first pixel color light value of the edge seam of the display screen.
  • calculating the second HSV color value according to the first HSV color value and the first random color difference value includes:
  • the first spatial coordinate value includes a first x-axis coordinate value, a first y-axis coordinate value, and a first z-axis coordinate value;
  • the first x-axis coordinate value and the first x-axis random color difference value, the first y-axis coordinate value and the first y-axis random color difference value, and the first z-axis coordinate value and the first z-axis random color difference value are respectively performed. Sum operation to obtain the second x-axis coordinate value, the second y-axis coordinate value and the second z-axis coordinate value;
  • the bias principle of the first x-axis random color difference value, the first y-axis random color difference value and the first z-axis random color difference value is the cosine between the first spatial coordinate value and the second spatial coordinate value.
  • the similarity value is less than or equal to the first preset threshold.
  • a hash operation is performed on the preset plan code, plan type, and information identifier of the information to be displayed to obtain a first code array with a preset array length, including:
  • the preset plan code, plan type and information identification of the information to be displayed are spliced to obtain an identified digital identification string, and a hash operation is performed on the identified digital identification string to obtain a preset The first encoded array of array length;
  • the length of the preset array is determined based on the horizontal resolution and vertical resolution of the target rectangular image;
  • the plan code includes the delivery time and delivery location of the information to be displayed and the information of the terminal device to be delivered.
  • the plan type includes the planned delivery type of the information to be displayed.
  • calculating the second pixel color value according to the first pixel color value and the first encoding array includes:
  • the first offset value is less than the second preset threshold
  • the second pixel color value is calculated according to the first offset value and the first pixel color value; wherein the second pixel color value is an offset value corresponding to the first pixel color value.
  • the second pixel color value is used to assign a value to the target rectangular image, and other areas in the target rectangular image except for the area assigned the second pixel color value are Set the Alpha channel of the area to fully transparent to obtain the first digital logo image, including:
  • identifying the information to be displayed based on the first digital identification image, and delivering the identified information to be displayed to the display terminal includes:
  • the display control board controls the display panel of the display terminal to display the arranged information to be displayed and the first digital logo image.
  • the display information processing method further includes:
  • first alarm prompt information corresponding to the display terminal is generated.
  • the display information processing method further includes:
  • abnormality recognition is performed on the current frame image to obtain the
  • the image recognition results associated with the previous frame image include:
  • the image recognition result is obtained according to the judgment result of the current pixel value and the second pixel color light value.
  • determining whether the current pixel value is consistent with the second pixel color value of the pixel in the first digital identification image includes:
  • generating second alarm prompt information according to the image recognition result includes:
  • the recognition result between the digital identification string to be recognized and the recognized digital identification string is generated. Second alarm prompt information.
  • the display information processing method further includes:
  • the display terminal is controlled to power off. .
  • a processing device for displaying information including:
  • the information acquisition module is used to obtain the attribute information of the display terminal required to display the information to be displayed;
  • a first digital identification image generation module configured to generate a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed; wherein the preset display mode is the third The Alpha channel of a digital logo image is fully transparent;
  • the information to be displayed identification module is configured to identify the information to be displayed based on the first digital identification image, and place the identified information to be displayed on the display terminal.
  • a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the method for processing display information described in any one of the above is implemented.
  • an electronic device including:
  • the processor is configured to execute any one of the above display information processing methods by executing the executable instructions.
  • FIG. 1 schematically illustrates a flowchart of a method for processing display information according to an exemplary embodiment of the present disclosure.
  • FIG. 2 schematically illustrates a block diagram of a processing system for displaying information according to an example embodiment of the present disclosure.
  • FIG. 3 schematically shows an example structural diagram of a display terminal according to an example embodiment of the present disclosure.
  • Figure 4 schematically shows a flow chart of a method for generating a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed according to an exemplary embodiment of the present disclosure.
  • FIG. 5 schematically shows an example diagram of a pixel area to be assigned in a target rectangular image according to an exemplary embodiment of the present disclosure.
  • FIG. 6 schematically shows an example diagram of a first digital identification image obtained after assignment according to an exemplary embodiment of the present disclosure.
  • FIG. 7 schematically illustrates an example diagram of a display terminal displaying identified information to be displayed and a first digital identification image according to an exemplary embodiment of the present disclosure.
  • FIG. 8 schematically shows an example of marking and displaying information to be displayed by superimposing visual marks such as QR codes.
  • Figure 9 schematically shows a flow chart of a method for performing abnormal recognition on the current frame image and obtaining an image recognition result associated with the current frame image according to an example embodiment of the present disclosure.
  • FIG. 10 schematically illustrates a flowchart of another display information processing method according to an example embodiment of the present disclosure.
  • FIG. 11 schematically illustrates a block diagram of a processing device for displaying information according to an example embodiment of the present disclosure.
  • FIG. 12 schematically illustrates an electronic device for implementing the above method for processing display information according to an example embodiment of the present disclosure.
  • Example embodiments will now be described more fully with reference to the accompanying drawings.
  • Example embodiments may, however, be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concepts of the example embodiments. To those skilled in the art.
  • the described features, structures or characteristics may be combined in any suitable manner in one or more embodiments.
  • the information provider needs to monitor the screen; in the process of monitoring the information played on the display screen of the display terminal, the specific monitoring content includes but is not limited to: monitoring whether the display screen is correctly The correct content is played at the time (playback time) and location (the position set by the display terminal) (whether the content played on the display screen of the display terminal is consistent with the preset content that needs to be played).
  • the existing methods of monitoring the information can be implemented in the following two ways:
  • the other method is to superimpose visual identifiers such as QR codes or barcodes on the information screen in advance, and then install a monitoring camera in front of the screen where the information is played to collect the video stream of the screen played by the display screen, and then detect the visible
  • the way of identification is to prevent the display screen from playing unauthorized information.
  • this type of method requires additional related hardware and engineering costs; for example, each display screen needs to be equipped with a monitoring camera, and the camera needs to be installed according to specific standards such as height and angle, and the camera-related structures and wiring need to be installed. Projects are often restricted in actual sites and difficult to implement; in addition, the presence of cameras and visual signs on information screens will destroy the information audience's overall perception of the information program, making it impossible for the audience to fully watch the displayed consultation screen.
  • this example implementation first provides a method for processing display information.
  • This method can be run on terminal devices, servers, server clusters or cloud servers, etc.; of course, those skilled in the art can also run it on other platforms according to needs.
  • the method of the present disclosure is not particularly limited in this exemplary embodiment.
  • the display information processing method may include the following steps:
  • Step S110 Obtain the attribute information of the display terminal to which the information to be displayed needs to be placed;
  • Step S120 Generate a first digital logo image with a preset display mode according to the attribute information and the information identifier of the information to be displayed; wherein the preset display mode is the Alpha channel of the first digital logo image To be fully transparent;
  • Step S130 Identify the information to be displayed based on the first digital identification image, and place the identified information to be displayed on the display terminal.
  • the attribute information of the display terminal to which the information to be displayed is obtained; and then a first digital identification image with a preset display mode is generated based on the attribute information and the information identification of the information to be displayed. ; Finally, the information to be displayed is marked based on the first digital logo image, and the marked information to be displayed is delivered to the display terminal.
  • the marked information to be displayed is When placed on the display terminal, the first digital logo image is displayed in a non-sensory display mode, and the information to be displayed is not blocked during the display process, ensuring the integrity of the information to be displayed during the display process; on the other hand, , because in the process of generating the first digital logo image, the attribute information of the display terminal is taken into account, so that the generated first digital logo image can be more adapted to the display terminal, thereby achieving the purpose of non-inductive display and improving the user experience. viewing experience of the displayed information.
  • a method for processing display information recorded in the exemplary embodiments of the present disclosure can monitor the playback of information programs on the screen and automatically alarm for abnormal situations; at the same time, it can also monitor the playback of information programs without damaging the audience.
  • the only way to achieve the best viewing and viewing of information programs is to save equipment engineering costs and personnel verification workload, prevent unauthorized playback of illegal information, and achieve content security protection, thereby ensuring the display requirements of the display terminal.
  • complete display of information is achieved.
  • the display information processing system may include an editing and broadcasting server 210 and a display terminal 220; wherein the display terminal may be connected to the editing and broadcasting server network through a wired or wireless manner; the editing and broadcasting server may use
  • the editing and broadcasting server may be a local server, a cloud server, a server cluster, etc., and this example does not place any special restrictions on this.
  • the above-mentioned display terminal may include a broadcast control host 301, a display control board 302 and a display screen 303; wherein, during the display terminal displaying the identified information to be displayed, the display terminal may The broadcast control host receives the first digital identification image and the information to be displayed after the identification, and controls the display screen to display the first digital identification image and the information to be displayed after the identification through the display control board.
  • step S110 attribute information of the display terminal to which the information to be displayed is required is obtained.
  • the attribute information of the display terminal required to display the information to be displayed can be obtained from the database or cluster;
  • the attribute information may include the display screen information of the display terminal, the appearance image of the edge seam of the display screen, the device identification of the display terminal, etc.;
  • the display screen information includes the screen resolution and display screen of the display screen. Screen type, etc.; wherein, the display screen type may include an LED (Liquid Crystal Display, liquid crystal display) display screen or an LCD (Light Emitting Diode, light-emitting diode) display screen, etc.
  • the above-mentioned information to be displayed may include image information, video information, text information and their corresponding combination information, etc. This example does not impose special restrictions on this.
  • the appearance image of the edge seam of the display screen refers to the outer boundary of the effective display range of the display screen of the display terminal, and the area adjacent to the display screen shell is the appearance image of the edge seam of the display screen.
  • the appearance image of the display screen side seam can be collected in the following manner: based on the preset collection scene and the preset collection angle, the appearance image of the display screen side seam of the display terminal is collected through a preset image collection device ;
  • the preset collection scene includes at least one of a preset illumination intensity, a preset collection environment and a preset collection distance. That is to say, in the process of collecting the appearance images of the side seams of the display screen, the collection can be carried out according to the standard engineering survey process as shown below.
  • the standard engineering survey process may include but is not limited to the following process: collect display screen device information at the deployment site of the display terminal, and perform , use the specified camera to collect the appearance image of the display screen edge seam.
  • the light intensity is between 400lux-1000lux; the collection environment is regular sunny day lighting or indoor lighting, the surface brightness of the display device is uniform, the lighting is natural, and there is no overexposure or overdarkness to achieve normal color restoration; the preset collection The distance is between 20cm-100cm; the preset collection angle is directly above the center of the target area (the center point of the display screen side seam); and, in the process of collecting the appearance image of the display screen side seam, the The resolution of the camera is not less than 2 million pixels, thereby ensuring that the captured image of the appearance of the display's edge seams can be clearer, so as to facilitate subsequent processing.
  • step S120 a first digital identification image with a preset display mode is generated according to the attribute information and the information identification of the information to be displayed; wherein the preset display mode is the first digital identification image.
  • the alpha channel is fully transparent.
  • the Alpha channel refers to the transparency and translucency of a picture.
  • a bitmap stored using 16 bits per pixel may have 5 bits for red, 5 bits for green, 5 bits for blue, and the last bit is alpha for each pixel in the image.
  • the alpha bit can also represent 256 levels of translucency, because the alpha channel has 8 bits and can have 256 different data representation possibilities.
  • generating a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed may include the following steps:
  • Step S410 Calculate the first pixel color light value of the side seam of the display screen based on the appearance image of the side seam of the display screen, and generate a color light value with the screen resolution based on the screen resolution and the preset blank rectangular image. Target rectangular image of the same resolution.
  • the first pixel color light value of the display screen side seam is calculated according to the appearance image of the display screen side seam. Specifically, this can be achieved in the following manner: first, obtain the first HSV chromaticity value of the center point of the appearance image of the edge seam of the display screen, and calculate the first HSV chromaticity value and the first random color difference value based on the first HSV chromaticity value and the first random color difference value. Two HSV color values; wherein the first random color difference value is less than or equal to the first preset threshold; convert the second HSV color value to obtain the first pixel color value of the edge seam of the display screen.
  • the process of calculating the second HSV color value according to the first HSV color value and the first random color difference value it can be implemented in the following manner: first, calculate the first spatial coordinate of the first HSV color value value; wherein, the first spatial coordinate value includes the first x-axis coordinate value, the first y-axis coordinate value, and the first z-axis coordinate value; secondly, for the first x-axis coordinate value, the first y-axis coordinate value value and the first z-axis coordinate value are offset to obtain the first x-axis random color difference value, the first y-axis random color difference value and the first z-axis random color difference value; then, the first x-axis coordinate value is Perform a summation operation with the first x-axis random color difference value, the first y-axis coordinate value and the first y-axis random color difference value, and the first z-axis coordinate value and the first z-axis random color difference value to obtain the second x axis
  • the specific calculation process of the first pixel chromaticity value may include the following steps: first, input the appearance image of the edge seam of the display screen into the approximate chromaticity value calculation module; secondly, given the first similarity Threshold (first preset threshold), input into the approximate color light value calculation module; wherein, the preset threshold is less than or equal to 0.05, specifically it can be between 0.01 and 0.05; specifically, when two color light values are calculated, the similarity is obtained When not greater than the first preset threshold, the two approximate chromaticity values can be considered to be in line with human visual approximation; therefore, the second HSV chromaticity value can be generated based on this principle; then, the cvtColor function of the OpenCV library is called, and the parameter is set to cv2.
  • the first HSV color light value refers to: Hue: hue; Saturation: saturation and Value: lightness; further, when the first HSV color light is obtained
  • the second HSV color value can be calculated based on the first HSV color value, and then the first pixel color value can be calculated based on the second HSV color value.
  • the first pixel color value may include a color value displayed in RGBA or RGBW; it may also be a color value displayed in RGBX (X represents a display mode that may appear in the future). This example imposes no special restrictions on this.
  • the specific calculation steps of the second HSV color light value are: first, calculate the first spatial coordinate value of the first HSV color light value of the center point of the appearance image of the edge seam of the display screen.
  • the second spatial coordinate value can be calculated based on the first spatial coordinate value and the first random color difference value.
  • the specific calculation process of the second spatial coordinate value is as follows: the first spatial coordinate value of the first HSV color light value of the center point of the appearance image of the edge seam of the display screen is deflected by random increments ( ⁇ 1, ⁇ 2 and ⁇ 3), and then On the basis of x1, y1, z1, add ⁇ 1, ⁇ 2 and ⁇ 3 to get x2, y2, z2; then based on x2, y2, z2, we can get the second spatial coordinate value (x2, y2) that approximates the HSV color light value , z2).
  • a blank rectangular image can be generated; wherein the size of the blank rectangular image can be determined according to the size information of the display screen included in the attribute information; that is, the size of the blank rectangle and the size of the display screen are consistent; then, adjust the resolution of the blank rectangular image according to the screen resolution of the display screen, thereby obtaining a target rectangular image with the same resolution as the screen resolution.
  • Step S420 Perform a hash operation on the preset plan code, plan type, and information identifier of the information to be displayed to obtain a first code array with a preset array length, and calculate the code array according to the first pixel color light value and the information identifier.
  • the first encoding array calculates the color light value of the second pixel.
  • a hash operation is performed on the preset plan code, plan type, and information identifier of the information to be displayed to obtain a first code array with a preset array length.
  • it can be implemented in the following manner: splicing the preset plan code, plan type, and the information identification of the information to be displayed to obtain an identified digital identification string, and comparing the identified digital identification string Perform a hash operation to obtain a preset number
  • the first coding array of group length wherein, the preset array length is determined according to the horizontal resolution and vertical resolution of the target rectangular image;
  • the plan coding includes the delivery time, delivery time of the information to be displayed, The location and the device identification of the terminal device to be delivered;
  • the plan type includes the planned delivery type of the information to be displayed.
  • calculate the second pixel color value according to the first pixel color value and the first encoding array Specifically, it can be implemented in the following manner: starting from the zeroth digit value included in the first encoding array, perform decimal point left shift calculation on all the values included in the first encoding array to obtain the first encoding The first offset value of the array; wherein the first offset value is less than the second preset threshold; calculating the second pixel color value according to the first offset value and the first pixel color value; Wherein, the second pixel color value is an offset value corresponding to the first pixel color value.
  • the given similarity threshold (the second preset threshold) is 0.02; then, starting from the 0 bit included in the first encoding array, the same decimal point left shift calculation is performed on the bit value to obtain the digital identification encoding bit.
  • An offset value so that the first offset value is less than the given similarity threshold (preset threshold); then, call the approximate color light value calculation module, input the digital identification encoding bit offset value and the display screen boundary appearance image obtained by the above calculation
  • the approximate pixel color value of the center point is used to obtain the offset value (the second pixel color value) of the approximate pixel color value of the center point of the appearance image of the edge seam of the display screen.
  • Step S430 use the second pixel color value to assign a value to the target rectangular image, and set the Alpha channel of other areas in the target rectangular image to be fully transparent except for the area assigned the second pixel color value. Obtain the first digital identification image.
  • first, determine the coordinate origin of the target rectangular image for example, it can be the upper left corner vertex or the lower left corner vertex, this example does not impose special restrictions on this
  • the pixel area to be assigned can be an area with a width of 1 pixel in the target rectangular image.
  • the rectangle can be assigned clockwise.
  • step S130 the information to be displayed is identified based on the first digital identification image, and the identified information to be displayed is placed on the display terminal.
  • the specific identification and delivery process of the information to be displayed can be realized in the following manner: arranging the first digital identification image to the top layer of the playback window of the information to be displayed, and placing the first digital identification image
  • a digital logo image and arranged information to be displayed are transmitted to the display terminal, so that the display control board in the display terminal controls the display panel of the display terminal to perform processing on the arranged information to be displayed and the first digital logo image. show. That is to say, when the information to be displayed is released, the non-sensitive digital logo image (the first digital logo image) can be used as a file and arranged to the top layer of the play window; then, the non-sensitive digital logo image can be added to the program (to be displayed).
  • the display information are delivered to the broadcast control host in the designated display terminal.
  • the information to be displayed after the logo and the first digital logo image displayed by the terminal are shown in Figure 7.
  • 701 is the edge seam of the display screen
  • 702 is the assigned area in the target rectangular image.
  • 703 is the specific display area of the information to be displayed.
  • the method described in the exemplary embodiments of the present disclosure can avoid errors caused by superimposing QR codes.
  • the first digital identification image is as follows
  • the floating form is set at the top level of the information to be displayed; in the process of displaying different frame images of the same information to be displayed, only the frame number of the image changes, and the first digital identification image always exists; based on this , can realize the identification of information information; and, because the assigned area only occupies one pixel value, even if the information information is blocked by one pixel value, it will not have any visual impact on the audience; at the same time, because The difference between the second pixel color value assigned to the assigned area and the first pixel color value at the edge of the display screen is controlled within the first preset threshold; therefore, the assigned area is visually considered to be the display screen
  • the side seams further realize the senseless display of the assigned area, improving the audience's viewing experience.
  • the delivery status of the display terminal also needs to be monitored.
  • monitoring the delivery status of the display terminal can be achieved in the following two ways:
  • monitoring the offline status of the display terminal can be achieved in the following manner: first, obtain the current status information of the broadcast control host in the display terminal, and determine the status information based on the heartbeat data included in the current status information. Whether the display terminal is in an offline state; secondly, if the display terminal is in an offline state, first alarm prompt information corresponding to the display terminal is generated.
  • the process of judging the offline status it is detected whether the display control board is offline, and if it is offline, the first alarm message is issued; that is, if the display control board of the display terminal is offline for a certain period of time If the heartbeat frequency in the device is too low, it can be considered offline; if it is offline, the first alarm message needs to be generated.
  • the other is to monitor the legality of the information displayed on the display terminal.
  • monitoring the legality of the displayed information can be achieved in the following ways: first, obtain the information currently displayed by the display terminal and The current frame image corresponding to the marked information to be displayed; secondly, perform abnormal recognition on the current frame image to obtain an image recognition result associated with the current frame image, and provide second alarm prompt information based on the image recognition result.
  • abnormality recognition is performed on the current frame image to obtain an image recognition result associated with the current frame image, which may include the following steps:
  • Step S910 extract the second digital identification image included in the current frame image, and analyze the second digital identification image to obtain the pixel assignment area included in the second digital identification image;
  • Step S920 extract the current pixel value of each pixel included in the pixel assignment area, and determine whether the current pixel value is consistent with the second pixel color value of the pixel in the first digital identification image;
  • Step S930 Obtain the image recognition result based on the judgment result of the current pixel value and the second pixel color value.
  • Determining whether the current pixel value is consistent with the second pixel color value of the pixel in the first digital logo image can be achieved by: first, calculating the current pixel value and the display screen of the display terminal The similarity value between the color and light values of the second pixels of the side seams is calculated, and the similarity value is offset calculated to obtain the offset calculated value; secondly, a hash operation is performed on the offset calculated value to obtain the second encoding array, and converting the second encoding array to obtain a digital identification string to be identified; further, determining whether the digital identification string to be identified is consistent with the device identification and display screen type of the display terminal. and the recognized digital identification string composed of the information identification of the information to be displayed is consistent.
  • generating the second alarm prompt information according to the image recognition result can be implemented in the following manner: if the image recognition result is a digital identification string to be recognized and a digital identification string that has been recognized are inconsistent, then according to the digital identification string to be recognized, The recognition result between the digital identification string and the recognized digital identification string generates the second alarm prompt information.
  • the current frame of the code stream is saved as a picture to obtain the current frame image; further, after the current frame image is obtained, the second digital identification image in the current frame image can be extracted, and the second digital identification image can be extracted
  • the surrounding area with a width of 1 pixel is obtained as the above-mentioned pixel assignment area; further, starting from the origin of the pixel assignment area, the current pixel value of each pixel is obtained clockwise, and the approximate color light value calculation module is called, and the current pixel value is input to obtain
  • the similarity value of the pixel color light value corresponding to the current pixel value further, for each similarity value, do the same decimal point right shift calculation, and then perform the same offset calculation so that the
  • the communication channel refers to the HDMI (High Definition Multimedia Interface, high-definition multimedia interface), DVI (Digital Visual Interface, digital video interface) or SDI (Serial Digital Interface, digital component serial interface) of the display control board, etc.
  • the terminal's display screen is powered off.
  • the specific judgment process can be implemented in the following manner: first, judging whether the number of first alarm prompts of the first alarm prompt information is greater than the first preset threshold; and/or the second alarm of the second alarm prompt information Whether the number of prompts is greater than the second preset threshold; secondly, if the first number of warning prompts of the first warning prompt information is greater than the first preset threshold, or if the second number of warning prompts of the second warning prompt information is greater than the second If the threshold is preset, the display terminal is controlled to power off.
  • the abnormal comparison alarm information (second alarm prompt information) sent by the non-inductive digital logo image comparison module can be listened to and counted (number of second alarm prompts). When counting (number of second alarm prompts) ) is greater than the given threshold, perform a screen power-off operation; or listen to the abnormal heartbeat alarm information (first alarm prompt information) sent by the heartbeat detection module and count (number of first alarm prompts), when counting (first alarm prompt information) When the number of times) is greater than the given threshold, perform the screen power-off operation.
  • the processing method of the display information can also include: taking screenshots of the final playback content of the display control board according to the specified frequency and saving it in the specified path, through the Ethernet
  • the communication protocol sends the screenshot image to the program encryption and editing module.
  • the display information processing method may include the following steps:
  • Step S1001 Obtain the attribute information of the display terminal to which the information to be displayed needs to be placed;
  • Step S1002 Generate a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed;
  • Step S1003 identify the information to be displayed based on the first digital identification image, and place the identified information to be displayed on the display terminal;
  • Step S1004 obtain the current status information of the broadcast control host in the display terminal, and determine whether the display terminal is offline based on the heartbeat data included in the current status information;
  • Step S1005 if the display terminal is offline, generate first alarm prompt information corresponding to the display terminal;
  • Step S1006 Obtain the current frame image currently displayed by the display terminal corresponding to the identified information to be displayed;
  • Step S1007 perform abnormal recognition on the current frame image, obtain an image recognition result associated with the current frame image, and provide second alarm prompt information based on the image recognition result;
  • Step S1008 determine whether the first number of alarm prompts of the first alarm prompt information is greater than the first preset threshold; and/or whether the second number of alarm prompts of the second alarm prompt information is greater than the second preset threshold;
  • Step S1009 If the first number of alarm prompts of the first alarm prompt information is greater than the first preset threshold, or the second number of alarm prompts of the second alarm prompt information is greater than the second preset threshold, control the display terminal to power off.
  • the display information processing method provided by the exemplary embodiments of the present disclosure does not require manually photographing the screen playing the information with mobile phones, cameras, etc., and then manually processing the returned photos. Auditing can monitor the information displayed on the display terminal; there is no need to appear the newspaper of the day in the photos taken to ensure the authenticity of the photos; it improves the real-time nature of the information review and improves the monitoring efficiency; On the other hand, there is no need to add related hardware and engineering costs, and there is no need to equip each screen with a monitoring camera and follow specific height angles and other standards to install the camera, which solves the structural, wiring and other engineering related to installing cameras in the existing technology. In actual venues, it is often restricted and difficult to implement.
  • the processing device for displaying information may include an information acquisition module 1110 , a first digital identification image generation module 1120 and an information identification module 1130 to be displayed. in:
  • the information acquisition module 1110 can be used to obtain the attribute information of the display terminal to which the information to be displayed needs to be placed;
  • the first digital identification image generation module 1120 may be configured to generate a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed; wherein the preset display mode is the The Alpha channel of the first digital logo image is fully transparent;
  • the information to be displayed identification module 1130 may be used to identify the information to be displayed based on the first digital identification image, and deliver the identified information to be displayed to the display terminal.
  • the attribute information includes the display screen information of the display terminal and/or the appearance image of the display screen side seam; the display screen information includes the screen resolution of the display screen , display type, and one or more of the display types.
  • generating a first digital identification image with a preset display mode according to the attribute information and the information identification of the information to be displayed includes:
  • the display information processing device further includes:
  • the appearance image acquisition module that first flattens the edge seam can be used to collect the appearance image of the edge seam of the display screen of the display terminal through a preset image acquisition device based on the preset collection scene and the preset collection angle;
  • the preset collection scene includes at least one of a preset illumination intensity, a preset collection environment, and a preset collection distance.
  • calculating the first pixel color light value of the display screen side seam based on the appearance image of the display screen side seam includes:
  • the first HSV chromaticity value of the center point of the appearance image of the edge seam of the display screen and calculate the second HSV chromaticity value according to the first HSV chromaticity value and the first random color difference value; wherein, the first The random color difference value is less than or equal to the first preset threshold;
  • the second HSV color light value is converted to obtain the first pixel color light value of the edge seam of the display screen.
  • calculating the second HSV color value according to the first HSV color value and the first random color difference value includes:
  • the first spatial coordinate value includes a first x-axis coordinate value, a first y-axis coordinate value, and a first z-axis coordinate value;
  • the first x-axis coordinate value and the first x-axis random color difference value, the first y-axis coordinate value and the first y-axis random color difference value, and the first z-axis coordinate value and the first z-axis random color difference value are respectively performed. Sum operation to obtain the second x-axis coordinate value, the second y-axis coordinate value and the second z-axis coordinate value;
  • the bias principle of the first x-axis random color difference value, the first y-axis random color difference value and the first z-axis random color difference value is the cosine between the first spatial coordinate value and the second spatial coordinate value.
  • the similarity value is less than or equal to the first preset threshold.
  • a hash operation is performed on the preset plan code, plan type, and information identifier of the information to be displayed to obtain a first code array with a preset array length, including:
  • the preset plan code, plan type and information identification of the information to be displayed are spliced to obtain an identified digital identification string, and a hash operation is performed on the identified digital identification string to obtain a preset The first encoded array of array length;
  • the length of the preset array is determined based on the horizontal resolution and vertical resolution of the target rectangular image;
  • the plan code includes the delivery time and delivery location of the information to be displayed and the information of the terminal device to be delivered.
  • the plan type includes the planned delivery type of the information to be displayed.
  • calculating the second pixel color value according to the first pixel color value and the first encoding array includes:
  • the second pixel color value is calculated according to the first offset value and the first pixel color value; wherein the second pixel color value is an offset value corresponding to the first pixel color value.
  • the second pixel color value is used to assign a value to the target rectangular image, and other areas in the target rectangular image except for the area assigned the second pixel color value are Set the Alpha channel of the area to fully transparent to obtain the first digital logo image, including:
  • identifying the information to be displayed based on the first digital identification image, and delivering the identified information to be displayed to the display terminal includes:
  • the display control board controls the display panel of the display terminal to display the arranged information to be displayed and the first digital logo image.
  • the display information processing device further includes:
  • An offline status determination module may be used to obtain the current status information of the broadcast control host in the display terminal, and determine whether the display terminal is in an offline status based on the heartbeat data included in the current status information;
  • the first alarm prompt information generating module may be used to generate first alarm prompt information corresponding to the display terminal if the display terminal is in an offline state.
  • the display information processing device further includes:
  • the current frame image acquisition module may be used to acquire the current frame image currently displayed by the display terminal corresponding to the identified information to be displayed;
  • the second alarm prompt information generation module may be used to perform abnormal recognition on the current frame image, obtain an image recognition result associated with the current frame image, and generate second alarm prompt information based on the image recognition result.
  • abnormality recognition is performed on the current frame image to obtain an image recognition result associated with the current frame image, including:
  • the image recognition result is obtained according to the judgment result of the current pixel value and the second pixel color light value.
  • determining whether the current pixel value is consistent with the second pixel color value of the pixel in the first digital identification image includes:
  • generating second alarm prompt information according to the image recognition result includes:
  • the recognition result between the digital identification string to be recognized and the recognized digital identification string is generated. Second alarm prompt information.
  • the display information processing device further includes:
  • the alarm prompt number judgment module can be used to determine whether the first alarm prompt number of the first alarm prompt information is greater than the first preset threshold; and/or whether the second alarm prompt number of the second alarm prompt information is greater than the first alarm prompt number. 2 preset thresholds;
  • the display terminal power-off control module can be used if the first number of alarm prompts of the first alarm prompt information is greater than the first preset threshold, or the second number of alarm prompts of the second alarm prompt information is greater than the second preset threshold. threshold, the display terminal is controlled to power off.
  • an electronic device capable of implementing the above method is also provided.
  • FIG. 12 An electronic device 1200 according to this embodiment of the present disclosure is described below with reference to FIG. 12 .
  • the electronic device 1200 shown in FIG. 12 is only an example and should not bring any limitations to the functions and usage scope of the embodiments of the present disclosure.
  • electronic device 1200 is embodied in the form of a general computing device.
  • the components of the electronic device 1200 may include, but are not limited to: the above-mentioned at least one processing unit 1210, the above-mentioned at least one storage unit 1220, a bus 1230 connecting different system components (including the storage unit 1220 and the processing unit 1210), and the display unit 1240.
  • the storage unit stores program code, and the program code can be executed by the processing unit 1210, so that the processing unit 1210 performs various exemplary methods according to the present disclosure described in the "Example Method" section of this specification.
  • the processing unit 1210 can perform the steps shown in Figure 1.
  • Step S110 Obtain the attribute information of the display terminal to which the information to be displayed needs to be placed;
  • Step S120 According to the attribute information and the information of the information to be displayed Logo, generate a first digital logo image with a preset display mode; wherein the preset display mode is that the Alpha channel of the first digital logo image is fully transparent;
  • Step S130 Based on the first digital logo image
  • the information to be displayed is marked, and the marked information to be displayed is delivered to the display terminal.
  • the storage unit 1220 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 12201 and/or a cache storage unit 12202, and may further include a read-only storage unit (ROM) 12203.
  • RAM random access storage unit
  • ROM read-only storage unit
  • Storage unit 1220 may also include a program/utility 12204 having a set of (at least one) program modules 12205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, Each of these examples, or some combination, may include the implementation of a network environment.
  • program/utility 12204 having a set of (at least one) program modules 12205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, Each of these examples, or some combination, may include the implementation of a network environment.
  • Bus 1230 may be a local area representing one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or using any of a variety of bus structures. bus.
  • Electronic device 1200 may also communicate with one or more external devices 1300 (e.g., keyboard, pointing device, Bluetooth device, etc.), may also communicate with one or more devices that enable a user to interact with electronic device 1200, and/or with Any device that enables the electronic device 1200 to communicate with one or more other computing devices (eg, router, modem, etc.). This communication may occur through an input/output (I/O) interface 1250.
  • the electronic device 1200 may also communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 1260. As shown, network adapter 1260 communicates with other modules of electronic device 1200 via bus 1230.
  • network adapter 1260 communicates with other modules of electronic device 1200 via bus 1230.
  • the example embodiments described here can be implemented by software, or can be implemented by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to A computing device (which may be a personal computer, a server, a terminal device, a network device, etc.) is caused to execute a method according to an embodiment of the present disclosure.
  • a non-volatile storage medium which can be a CD-ROM, U disk, mobile hard disk, etc.
  • a computing device which may be a personal computer, a server, a terminal device, a network device, etc.
  • a computer-readable storage medium is also provided, on which a program product capable of implementing the method described above in this specification is stored.
  • various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code.
  • the program product is run on a terminal device, the program code is used to cause the The terminal device performs the steps according to various exemplary embodiments of the present disclosure described in the above "Example Method" section of this specification.
  • the program product for implementing the above method according to an embodiment of the present disclosure may adopt a portable compact disk read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer.
  • a readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.
  • the program product may take the form of any combination of one or more readable media.
  • the readable medium may be a readable signal medium or a readable storage medium.
  • the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
  • a readable signal medium may also be any readable medium other than a readable storage medium that can send, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or device.
  • Program code embodied on a readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical cable, RF, etc., or any suitable combination of the foregoing.
  • Program code for performing operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., as well as conventional procedural Programming language—such as "C" or a similar programming language.
  • the program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server execute on.
  • the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device, such as provided by an Internet service. (business comes via Internet connection).
  • LAN local area network
  • WAN wide area network

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

La présente invention a trait au domaine technique du traitement d'image, et concerne en particulier un procédé et un appareil de traitement d'informations d'affichage, ainsi qu'un support de stockage et un dispositif électronique associés. Le procédé consiste : à acquérir des informations d'attributs d'un terminal d'affichage vers lequel des informations à afficher doivent être émises; selon les informations d'attributs et un identifiant desdites informations, à générer une première image d'identification numérique avec un mode d'affichage prédéfini, le mode d'affichage prédéfini étant qu'un canal Alpha de la première image d'identification numérique est complètement transparent; et à identifier lesdites informations en fonction de la première image d'identification numérique, et à émettre lesdites informations identifiées vers le terminal d'affichage. Le procédé garantit l'intégrité des informations à afficher pendant le processus d'affichage. (FIG. 1)
PCT/CN2023/094417 2022-05-27 2023-05-16 Procédé et appareil de traitement d'informations d'affichage, support de stockage et dispositif électronique associés WO2023226817A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210594518.7A CN114860182A (zh) 2022-05-27 2022-05-27 显示信息的处理方法及装置、存储介质、电子设备
CN202210594518.7 2022-05-27

Publications (1)

Publication Number Publication Date
WO2023226817A1 true WO2023226817A1 (fr) 2023-11-30

Family

ID=82640444

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/094417 WO2023226817A1 (fr) 2022-05-27 2023-05-16 Procédé et appareil de traitement d'informations d'affichage, support de stockage et dispositif électronique associés

Country Status (2)

Country Link
CN (1) CN114860182A (fr)
WO (1) WO2023226817A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117455465A (zh) * 2023-12-21 2024-01-26 广东须臾科技有限公司 基于设备物联平台多阶段运行数据的分析管理系统

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114860182A (zh) * 2022-05-27 2022-08-05 京东方科技集团股份有限公司 显示信息的处理方法及装置、存储介质、电子设备
CN117957835A (zh) * 2022-08-29 2024-04-30 京东方科技集团股份有限公司 多媒体监播系统、方法及电子设备

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102185837A (zh) * 2011-04-20 2011-09-14 北京鸿天伟业安全技术有限公司 智能多媒体信息发布系统
US8813154B1 (en) * 2012-12-07 2014-08-19 American Megatrends, Inc. Injecting a code into video data without or with limited human perception by flashing the code
CN104143200A (zh) * 2014-07-16 2014-11-12 华南理工大学 一种图像附加信息的边框型编码与智能识别方法
CN104980799A (zh) * 2014-04-04 2015-10-14 北京秒针信息咨询有限公司 一种对广告进行监播的方法和系统
WO2017076338A1 (fr) * 2015-11-06 2017-05-11 沈维 Panneau d'affichage contenant des informations codées
US20180131976A1 (en) * 2016-10-11 2018-05-10 Sasha Zabelin Serializable visually unobtrusive scannable video codes
CN112565922A (zh) * 2020-11-30 2021-03-26 成都新潮传媒集团有限公司 一种广告监播方法、广告监播装置及计算机可读存储介质
CN112967080A (zh) * 2018-01-29 2021-06-15 河北三川科技有限公司 广告投放效果监控系统
CN113487473A (zh) * 2021-08-03 2021-10-08 北京百度网讯科技有限公司 一种添加图像水印的方法、装置、电子设备及存储介质
CN114860182A (zh) * 2022-05-27 2022-08-05 京东方科技集团股份有限公司 显示信息的处理方法及装置、存储介质、电子设备

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102185837A (zh) * 2011-04-20 2011-09-14 北京鸿天伟业安全技术有限公司 智能多媒体信息发布系统
US8813154B1 (en) * 2012-12-07 2014-08-19 American Megatrends, Inc. Injecting a code into video data without or with limited human perception by flashing the code
CN104980799A (zh) * 2014-04-04 2015-10-14 北京秒针信息咨询有限公司 一种对广告进行监播的方法和系统
CN104143200A (zh) * 2014-07-16 2014-11-12 华南理工大学 一种图像附加信息的边框型编码与智能识别方法
WO2017076338A1 (fr) * 2015-11-06 2017-05-11 沈维 Panneau d'affichage contenant des informations codées
US20180131976A1 (en) * 2016-10-11 2018-05-10 Sasha Zabelin Serializable visually unobtrusive scannable video codes
CN112967080A (zh) * 2018-01-29 2021-06-15 河北三川科技有限公司 广告投放效果监控系统
CN112565922A (zh) * 2020-11-30 2021-03-26 成都新潮传媒集团有限公司 一种广告监播方法、广告监播装置及计算机可读存储介质
CN113487473A (zh) * 2021-08-03 2021-10-08 北京百度网讯科技有限公司 一种添加图像水印的方法、装置、电子设备及存储介质
CN114860182A (zh) * 2022-05-27 2022-08-05 京东方科技集团股份有限公司 显示信息的处理方法及装置、存储介质、电子设备

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117455465A (zh) * 2023-12-21 2024-01-26 广东须臾科技有限公司 基于设备物联平台多阶段运行数据的分析管理系统
CN117455465B (zh) * 2023-12-21 2024-04-26 广东须臾科技有限公司 基于设备物联平台多阶段运行数据的分析管理系统

Also Published As

Publication number Publication date
CN114860182A (zh) 2022-08-05

Similar Documents

Publication Publication Date Title
WO2023226817A1 (fr) Procédé et appareil de traitement d'informations d'affichage, support de stockage et dispositif électronique associés
JP4696099B2 (ja) 表示画像変換装置
AU2007202102B2 (en) Function command system, function command device, function command analysis system, presentation system, and computer readable medium
US20160210516A1 (en) Method and apparatus for providing multi-video summary
CN111310134B (zh) 屏幕水印生成方法、装置及设备
CN103376921A (zh) 激光标注系统及标注方法
CN105487834A (zh) 拼接墙回显方法和系统
CN102147684B (zh) 一种触摸屏屏幕扫描方法及其系统
WO2020159319A1 (fr) Dispositif électronique pour lire une vidéo à plage dynamique élevée et procédé correspondant
CN113740035A (zh) 投影质量检测方法、装置、设备及可读存储介质
US10382717B2 (en) Video file playback system capable of previewing image, method thereof, and computer program product
US20200275091A1 (en) Display apparatus, apparatus for proof of play, and method for proof of play of contents
CN115278217A (zh) 图像画面检测方法、装置、电子设备及存储介质
TWI572224B (zh) A network camera structure and method for detecting the strength of wireless network signals
KR20200025481A (ko) 전자 장치 및 그 제어 방법
JP2019185004A (ja) 再生証明システムおよび方法
KR102485368B1 (ko) 전자 장치, 그 제어 방법 및 컴퓨터 판독가능 기록 매체
CN113875231A (zh) 实时视频动态范围分析
US11849244B2 (en) System and method for temporal keying in a camera
JP2019139491A (ja) 位置情報管理装置、位置情報管理システム、位置情報管理方法、およびプログラム
US11683581B2 (en) Image displaying apparatus and method thereof
CN111447171B (zh) 自动化内容数据分析平台及方法
CN114387913B (zh) Led显示屏的edid调整方法及系统
WO2022246653A1 (fr) Système de traitement d'image, extrémité de service en nuage et procédé
CN100568325C (zh) 影像显示装置的品质检测设备与方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23810890

Country of ref document: EP

Kind code of ref document: A1