LU508145B1 - AN APPLICATION SYSTEM OF CONTEMPORARY COMPUTER VISION ART IN THE FIELD OF DIGITAL MEDIA - Google Patents

Abstract

The present invention relates to the field of digital media technology and discloses an application system of contemporary computer vision art in the field of digital media, comprising: an image sensing module for sensing an external scene and generating image data; and a digital media terminal module for displaying the image data obtained by sensing the image sensing module; and an image type selection module for selecting the type of image presented by the digital media terminal module. The present invention is capable of capturing a screen of an external scene through computer vision and displaying it through the digital media terminal module, and at the same time, it is capable of recognizing a person's expression and judging the person's emotional state through computer vision. At the same time, the current seasonal conditions, the current temperature conditions, and the current weather conditions can be determined and then combined with the emotional state of the personnel to analyze the results of adjusting the screen presented by the digital media terminal device.

Description

An application system of contemporary computer vision art in the field of digital media

Technical area

The present invention relates to the field of digital media technology and, in particular, discloses an application system of contemporary computer vision art in the field of digital media.

Technology in the background

With the rapid development of modern electronic and multimedia technology, digital media technology has flowed into every aspect of people's lives and has become an indispensable tool in people's long lives. In contemporary art, the use of computer vision to create images on digital media

Equipment has become an important form of art, compared to traditional

art forms, it can not only expand the scope of art, and in the digital

Media on the image is more delicate, and a higher degree of exquisite, can better meet the public's love of beauty psychology. However, the existing computer vision on the screen image acquisition, and displayed on the digital media equipment, can only

Image static presentation. And the process of presentation, the image is static, can not be used according to the current mood of the staff, the external environment to the image of dynamic real-time adjustment, which leads to the presentation of the image image is not vivid, can not be directly achieved on the effect of the staff's state of mind, so it does not resonate with the staff.

Content of the invention

The main technical problem solved by the present invention is to provide an application system of contemporary computer vision art in the field of digital media, which can solve the problem that the existing computer

Vision can only make the image static when it is captured and stored on the digital

media device. When the image is displayed on a digital media device, it can only be displayed statically, and during the display, the image is static and cannot be dynamically changed in real time according to the user's current mood and external

Environmental conditions can be adapted.

To solve the above-mentioned technical problems, according to one aspect of the present invention, in particular, an application system of contemporary computer

Vision art in the field of digital media, including:

An image sensing module for sensing an external scene and generating image data;

A digital media terminal module for displaying the image data generated by scanning the

image scanning module;

An image type selection module for selecting a type of image produced by the digital

Media terminal module is displayed;

An environmental situation detection module for detecting environmental situation data and sending this data to a data processing module;

A person's facial expression recognition module to capture and recognize a person's facial expression and then send the recognized data to the

data processing module;

A data processing module for receiving data sent from the environmental situation detection module and the human expression recognition module, and for processing and analyzing the data; LUS08145

A real-time adjustment module for making dynamic real-time adjustments to the image displayed by the digital media terminal module according to the results of the

Processing and analysis of the data by the data processing module.

Furthermore, the system includes a wireless transmission module, which is used for wireless

transmission of data; the image data generated by the image scanning module through

Sampling a scene in the outside world can be transmitted to the digital media terminal module for presentation via the wireless transmission module.

Furthermore, the digital media terminal module comprises a fixed digital media terminal and a mobile digital media terminal, wherein both the fixed digital media terminal and the mobile digital media terminal receive data transmitted by the wireless transmission module.

Receive image data and display the image data.

Furthermore, the facial expression recognition module includes a facial image

input module, an image size detection module, an image segmentation module and a

Feature recognition module;

Wherein the facial image capture module is used to capture the facial image of the personnel for registration;

An image size acquisition module for acquiring the length and width dimensions of the personnel's facial images acquired by the facial image acquisition module;

An image segmentation module for separating the length and width dimensions of the

Image size detection module captures the image so that the image is separated into a number of small parts;

Fin feature recognition module to identify features in each small

Image section and finally to summarize the recognition results to obtain a final recognition result.

The facial expression recognition module recognizes the person’s facial expression in the following procedure:

First, the facial image of the staff is captured and recorded by the facial image capture module; then the length and width dimensions of the facial image of the staff are captured and recorded by the image size capture module; and then the facial image of the

Personnel segmented by the image segmentation module according to the following formula, and a

Number of small image blocks is obtained:

TX, = ((L + D)/L) + ((L + D)/D)

Where TX is the number of small block images after segmentation, L is the length of the person's face image, D is the width of the person's face image, and if the

Segmentation is performed, each vertex of the person’s facial image is considered

Origin used for segmentation;

Then the features in each small block image are represented by a

Feature recognition module, and the recognition process is:

TZ(Xc,Ye)i = N _ 9 S(On — gc)2"

Here (Xc,Yc) is the central pixel coordinate of the image, TZ(a,b); the

Feature detection result of each small image section, P is the number of sample points, g, is the gray value of the n-th sample point, g is the gray value of the central pixel point, s(x) is the

Sign function, s(x)=1 if x>0, otherwise s(x)=0;

Then the results of all small parts of image recognition are combined by the following

Equation integrated to obtain the final feature detection results: i=1 z=) (ZG yo)

Where Z stands for the final recognition result and 1 for each small image section;

Then, the final recognition result is compared with the preset threshold Y. If Z<Y, it means the person is in a happy state, and conversely, if Z>Y, it means the person is in an unhappy state; finally, the recognition of the person's expression is completed.

Furthermore, the module for recording the environmental situation includes a module for recording the seasonal situation, a module for recording the ambient temperature and a module for

Collecting weather data; the seasonal data collection module is used to collect the current seasonal situation;

An ambient temperature detection module for carrying out the detection of the current

Ambient temperature data;

A weather data acquisition module to carry out the acquisition of the current

Weather condition data.

Furthermore, the data processing module comprises a data conversion module, a

Data analysis module and a result feedback module;

Where the data conversion module is used to convert the data received from the

environmental situation detection module and the personal expression recognition module into a type that can be processed by the system;

A data analysis module is used to analyze and process the data converted by the data conversion module;

A result feedback module for feeding back the results obtained after analysis and processing by the data analysis module to a real-time adjustment module in order to perform dynamic real-time adjustment of the image displayed by the digital media terminal module.

Furthermore, the data processing module processes the data as follows:

First, the data sent by the module for detecting the environmental situation and the module for recognizing the facial expression of the staff are processed by the

Data conversion module into a type that can be processed by the system; then the data is processed by the data analysis module according to the following formula, so that the color system of the image displayed by the digital media terminal module

Image can be obtained:

SC Z Z Z Ww (sx A 7X,

where SC is the obtained color system result, Z is the final structure ab508145

Facial recognition of the staff, ZSXp, ZSXc and ZSXg are the RGB values of the

are main colors of the images of the external scene captured by the image sensing module, and W is the value of the ambient temperature;

The SC results are then compared using the data collected by the module for recording the

seasons and the module for recording weather data in the module for recording the

Environmental situation data were micro-adjusted as weights to obtain more accurate results of the

image color system;

Finally, the result of the image color system is sent to the

Real-time setting module, which allows the real-time setting module to

The overall effect of the image can be dynamically adjusted in real time.

Furthermore, the image sensing module and the face image capturing module are both capable of

Images of external landscapes and facial images of people through a high-resolution

Camera to collect and capture.

The advantageous effect of the present invention of a computer vision

Application system for contemporary art in the field of digital media is as follows:

The present invention is capable of generating images of external landscapes through computer

Vision and present it through a digital media terminal module, and at the same time, it is able to recognize a person's expression through computer vision and judge the person's emotional state. At the same time, the current seasonal situation, the current temperature situation, and the current weather data can be obtained and then combined with the emotional state of the staff to analyze the results of the digital media terminal and adjust the display of the screen, thus achieving dynamic adjustment of the screen in real time according to the external

Environmental conditions and the current emotional state of the staff. It can make the image more vivid and directly address the mood of the staff, allowing it to resonate with the staff, and the image presented by the digital media terminals has a greater sense of the image.

Description of the attached drawings

The present invention will be described below in conjunction with the attached

Drawings and specific embodiments are described in more detail.

Figure 1 shows a schematic representation of the system principle.

Detailed description

In the following, the present invention will be described with reference to the attached

Drawings and in conjunction with exemplary embodiments are described in detail. It should be noted that the embodiments and the features of the embodiments can be combined with one another in the present application without conflict.

According to one aspect of the present invention, as shown in Figure 1, a

Application system for contemporary computer vision technology in the field of digital

Media provided, which includes:

An image sampling module for sampling an external scene and generating image data.

A digital media terminal module for presenting the image data obtained by scanning the image scanning module; the module comprises a fixed digital media terminal and a mobile digital media terminal, wherein both the fixed digital media terminal and the mobile digital media terminal receive the image data transmitted by the wireless transmission module / 908145

Receive image data and present the image data.

A wireless transmission module for data transmission between other modules and the digital media terminal module. 5 An image type selection module is used to select the type of image displayed by the digital

Media terminal module; the image screen can be selected to display in the form of an ink painting, an oil painting, a sketch, and so on.

An environmental conditions acquisition module is used to collect data on the

environmental conditions and send them to the data processing module; the module includes a module for recording seasonal conditions, a module for recording

Ambient temperature and a module for recording weather data;

A seasonal recording module is used to record the current seasonal situation;

An ambient temperature detection module for detecting the current

Ambient temperature data;

A weather data acquisition module for recording current weather conditions.

A person’s facial expression recognition module to capture and recognize a person’s facial expression and then send the recognized data to a

data processing module, the module comprising a facial image capture module, a

image size detection module, an image segmentation module and a feature detection module;

Wherein the facial image capture module is used to capture and record facial images of the personnel;

An image size acquisition module for capturing and recording the length and

Width dimensions of the facial images of the personnel captured by the facial image capture module;

An image segmentation module for separating the image length and width dimensions of the image acquired by the image size acquisition module so that the image is separated into a number of small parts;

A feature detection module to detect the features in each small

Image section and finally the summary of the recognition results to obtain the final recognition result;

The recognition process of the staff facial expression module is as follows:

First, a facial image of the person is captured and

facial image capture module; then the length and width dimensions of the

facial image of the person is captured and detected by an image size detection module; and then the facial image of the person is detected by an image segmentation module according to the following

Formula segmented to obtain a number of small image pieces:

TXs = ((L + D)/L) + ((L + D)/D)

Where TX is the number of small block images after segmentation, L is the length of the person's face image, D is the width of the person's face image, and if the

Segmentation is performed, each vertex of the person’s facial image is considered

Origin used for segmentation; LUS08145

Then the features in each small block image are represented by a

Feature recognition module, and the recognition process is:

TZ(Xe, Ye)i = P _ 1 S(In a gc)" n=0

Here (Xc,Yc) is the central pixel coordinate of the image, TZ(a,b); the

Feature detection result of each small image section, P is the number of sample points, g, is the gray value of the n-th sample point, g is the gray value of the central pixel point, s(x) is the

Sign function, s(x)=1 if x>0, otherwise s(x)=0;

Then the results of all small parts of image recognition are combined by the following

Equation integrated to obtain the final feature detection results: i=1 z=) (ZG yo)

Where Z stands for the final recognition result and 1 for each small image section;

Then, the final recognition result is compared with the preset threshold Y. If Z<Y, it means the person is in a happy state, and conversely, if Z>Y, it means the person is in an unhappy state; finally, the recognition of the person's expression is completed.

A data processing module for receiving data from a

environmental situation detection module and a person expression recognition module, and for processing and analyzing such data; wherein the module is a

Contains a data conversion module, a data analysis module and a result feedback module;

Wherein the data conversion module is used to convert the data from the

Environmental situation detection module and the person expression recognition module

data into a type that can be processed by the system;

A data analysis module for analyzing and processing the data generated by the

Data conversion module converted data;

A result reporting module is used to report the results obtained after the analysis and

Processing of the data by the data analysis module, to the real-time

adjustment module to make dynamic real-time adjustments to the digital

to be able to make adjustments to the image displayed on the media terminal module;

The process of data processing by the module is as follows:

First, the data from the module for detecting the environmental situation and from the module for

Recognition of the facial expression of the staff sent data by the

Data conversion module into a type that can be processed by the system; then the data is processed by the data analysis module according to the following formula, so that the color system of the image displayed by the digital media terminal module can be obtained: sc Z Z Z Ww (sx A 7X,

where SC is the obtained color system result, Z is the final structure ab508145

Facial recognition of the staff, ZSXp, ZSXc and ZSXg are the RGB values of the

are main colors of the images of the external scene captured by the image sensing module, and W is the value of the ambient temperature;

The SC results are then compared using the data collected by the module for recording the

seasons and the module for recording weather data in the module for recording the

Environmental situation data were micro-adjusted as weights to obtain more accurate results of the

image color system;

Finally, the result of the image color system is sent to the

Real-time setting module, which allows the real-time setting module to

The overall effect of the image can be dynamically adjusted in real time.

The real-time adjustment module is used to make dynamic real-time adjustments to the

images generated by the digital media terminal module according to the results of the

Data processing and analysis are displayed by the data processing module.

In this embodiment, said image sensing module and the

Facial image capture module using a high-resolution camera images from external

Collect and capture landscapes and facial images of people.

The electrical components mentioned here are real electrical components

components.

Of course, the above description is not a limitation of the present invention, and the present invention is not limited to the above examples, and the changes,

Modifications, additions or replacements made by ordinary technicians on the

Field of the present invention within the essential scope of the present

invention are also within the scope of protection of the present

Invention.

Claims (9)

Claims LU508145 1. An application system of contemporary computer vision in the field of digital media, characterized in that it comprises: an image sensing module for sensing a scene in the outside world and generating image data; a digital media terminal module for displaying the image data obtained by the sensing of the image sensing module; an image type selection module for selecting a type of image presented by the digital media terminal module; an environmental condition detection module for sensing environmental condition data and sending it to the data processing module; a person expression recognition module for capturing and recognizing a person's expression and then sending the recognized data to the data processing module; a data processing module for receiving data sent from the environmental situation detection module and the facial expression recognition module, and for processing and analyzing the data; A real-time adjustment module for performing dynamic real-time adjustment of an image displayed by a digital media terminal module according to the results of data processing analysis of the data by the data processing module. 2. A contemporary computer vision art application system in the field of digital media according to claim 1, characterized in that: the system further comprises a wireless transmission module used for wirelessly transmitting data; the image data obtained by the image sensing module by scanning an external scene can be transmitted to the digital media terminal module for display via the wireless transmission module. 3. An application system of contemporary computer vision art in the field of digital media according to claim 2, characterized in that: the digital media terminal module comprises a fixed digital media terminal and a mobile digital media terminal, wherein both the fixed digital media terminal and the mobile digital media terminal can receive image data transmitted by a wireless transmission module and can display the image data. 4. A contemporary computer vision application system in the field of digital media according to claim 1, characterized in that: the person's facial expression recognition module comprises a face image capturing module, an image size detecting module, an image segmentation module, and a feature recognition module; wherein the face image capturing module is used to capture and capture a face image of the person; an image size detecting module is used to capture and capture the length and width dimensions of the face images of the person captured by the face image capturing module; an image segmentation module is used to separate the image length and width dimensions of the image captured by the image size detecting module so that the image is separated into a number of small parts; A feature detection module to identify the features in each smaller 508145 image patch and finally summarize the detection results to obtain the final detection results. 5. An application system of contemporary computer vision art in the field of digital media according to claim 4, characterized in that: the staff facial expression recognition module recognizes the staff's facial expression as follows: First, a face image of the staff is captured and acquired by a face image capture module; then, the length and width dimensions of the staff's face image are captured and acquired by an image size capture module; and then, the staff's face image is segmented by an image segmentation module according to the following formula, and a number of small image pieces are obtained: TXs = ((L + D)/L) + ((L + D)/D) Where, TX is the number of small block images after segmentation, L is the length of the person's face image, D is the width of the person's face image, and when segmentation is performed, each vertex of the person's face image is used as the origin for segmentation; Then, the features in each small block image are detected by a feature detection module, and the detection process is: P=1 TZ(xe,Ye)i = _ 0 S(gn — gc)2" n= Where, (Xc,Yc) is the central pixel coordinate of the image, TZ(a,b) is the feature detection result of each small block image, P is the number of sampling points, g, is the gray value of the nth sampling point, g is the gray value of the central pixel point, s(x) is the sign function, s(x)=1 if x>0, otherwise s(x)=0; Then, the results of all small blocks of image detection are integrated by the following equation to obtain the final feature detection results: i=1 2=) (y) 1 Where Z represents the final detection result and 1 represents each small block image; Then, the final detection result is compared with the preset threshold Y. If Z<Y, this means that the person is in a happy state, and conversely, if Z>Y, it means that the person is in an unhappy state; finally, the recognition of the person's expression is completed. 6. A contemporary computer vision art application system in the field of digital media according to claim 5, characterized in that the environmental situation detection module comprises a seasonal situation detection module, an ambient temperature detection module, and a weather data detection module; wherein the season detection module is used to detect the current seasonal situation; The ambient temperature acquisition module for acquiring the current ambient temperature data; the weather data acquisition module for acquiring the current weather condition data. 7. An application system of contemporary computer vision art in the field of digital media according to claim 6, characterized in that the data processing module comprises a data conversion module, a data analysis module, and a result feedback module; wherein the data conversion module serves to convert the data sent from the environmental situation detection module and the human expression recognition module into a type that can be processed by the system; a data analysis module serves to analyze and process the data converted by the data conversion module; a result feedback module is used to feed back the results obtained after analysis and processing by the data analysis module to the real-time adjustment module so as to make dynamic real-time adjustments to the images displayed by the digital media terminal module. 8. An application system of contemporary computer vision art in the field of digital media according to claim 7, characterized in that the data processing module processes the data as follows: First, the data sent from the environmental situation detection module and the human expression recognition module are converted by the data conversion module into types that can be processed by the system; Then, the data is processed by the data analysis module according to the following formula to obtain the color system situation of the image displayed by the digital media terminal module: SC Z Z Z Ww Zsa "7SX¢ 75K, where SC is the obtained color system result, Z is the final structure of the personnel's face recognition, ZSXp, ZSXg, and ZSXg are the RGB values of the main colors of the external scene images acquired by the image sensing module, and W is the ambient temperature value; then, the SC results are micro-adjusted using the data acquired by the season acquisition module and the weather data acquisition module in the environmental situation acquisition module as weights to obtain more accurate image color system results; finally, the image color system result is fed back to the real-time adjustment module through the result feedback module, which enables the real-time adjustment module to dynamically adjust the overall effect of the image in real time. 9. A contemporary computer vision art application system in the field of digital media according to claim 8, characterized in that the image sensing module and the facial image acquisition module can collect and capture images of external scenes and facial images of people using a high-resolution camera.