WO2020259402A1

WO2020259402A1 - Method and device for image processing, terminal device, medium, and wearable system

Info

Publication number: WO2020259402A1
Application number: PCT/CN2020/097056
Authority: WO
Inventors: 李文宇; 张�浩; 陈丽莉; 苗京花; 孙玉坤; 王雪丰; 鄢名扬; 李治富
Original assignee: 京东方科技集团股份有限公司; 北京京东方光电科技有限公司
Priority date: 2019-06-24
Filing date: 2020-06-19
Publication date: 2020-12-30
Also published as: CN110166758A; CN110166758B

Abstract

The present disclosure relates to the technical field of displays. Disclosed are a method and device for image processing, a terminal device, a medium, and a wearable system. The image processing method comprises: acquiring the speed of movement of a wearable device; determining, on the basis of the speed of movement, the resolution of an image to be rendered, the resolution being inversely correlated to the speed of movement; employing the resolution for rendering the image; and outputting the image produced by rendering to the wearable device. By using different resolutions for image rendering in different scenarios, without changing display card performance, a user is enabled to view a smooth and clear picture, thus reducing requirements on display card performance, and reducing the barrier to the popularization of VR.

Description

Image processing method, device, terminal equipment, medium, wearable system

This application claims the priority of the Chinese patent application filed on June 24, 2019, with the application number 201910551530.8 and the invention title "Image processing method, device, terminal equipment and storage medium", the entire content of which is incorporated into this application by reference in.

Technical field

The present disclosure relates to the field of display technology, and in particular to an image processing method, device, terminal device, medium, and wearable system.

Background technique

With the development of Virtual Reality (VR) and Augmented Reality (AR) technologies, wearable devices such as VR and AR are gradually entering people's field of vision and are being applied and popularized in various industries.

Take a VR device as an example. Generally speaking, a VR device needs to correspond to a computer, and the image rendering of VR applications (such as VR games) is realized through the computer's graphics card.

Summary of the invention

The embodiments of the present disclosure provide an image processing method, device, terminal device, medium, and wearable system.

On the one hand, an embodiment of the present disclosure provides an image processing method, and the image processing method includes:

Obtain the movement speed of the wearable device;

Determining the resolution of the image to be rendered according to the movement speed, where the resolution is negatively related to the movement speed;

Image rendering using the resolution;

The rendered image is output to the wearable device.

Optionally, the determining the resolution of the image to be rendered according to the motion speed includes:

Determine a first movement speed range in which the movement speed is located, where the first movement speed range is one of at least two preset movement speed ranges;

Based on the corresponding relationship between the motion speed range and the resolution, the resolution corresponding to the first motion speed range is determined.

Optionally, the movement speed includes at least one of an angular velocity and a linear velocity.

Optionally, when the movement speed includes an angular velocity and a linear velocity, the determining the resolution corresponding to the first movement speed range based on the corresponding relationship between the movement speed range and the resolution includes:

Determine the first candidate resolution corresponding to the first angular velocity range in which the angular velocity is located based on the correspondence between the angular velocity range and the resolution;

Based on the correspondence between the linear velocity range and the resolution, determining the second candidate resolution corresponding to the first linear velocity range where the linear velocity is located;

Adopting the smaller of the first candidate resolution and the second candidate resolution as the resolution of the image to be rendered;

The first angular velocity range is one of at least two preset angular velocity ranges, and the first linear velocity range is one of at least two preset linear velocity ranges.

Optionally, the preset angular velocity range is two, and the preset linear velocity range is two;

The smaller angular velocity range in the preset angular velocity range and the smaller linear velocity range in the preset linear velocity range correspond to the same resolution;

The resolution corresponding to the larger angular velocity range in the preset angular velocity range and the larger linear velocity range in the preset linear velocity range is the same.

Optionally, the method further includes:

Use a variety of different resolutions for image rendering;

Respectively determine the frame rate range of the picture when the various resolutions among the multiple different resolutions are used for image rendering;

According to the frame rate ranges corresponding to the multiple different resolutions and the frame rate ranges corresponding to the different motion speed ranges, the corresponding relationship between the motion speed range and the resolution is obtained.

On the other hand, an embodiment of the present disclosure also provides an image processing device, which includes:

The obtaining module is configured to obtain the movement speed of the wearable device;

The first determining module is configured to determine the resolution of the image to be rendered according to the motion speed, where the resolution is negatively related to the motion speed;

A rendering module configured to perform image rendering using the resolution;

The output module is configured to output the rendered image to the wearable device.

Optionally, the first determining module includes:

A first determining sub-module configured to determine a first motion speed range in which the motion speed is located, the first motion speed range being one of at least two preset motion speed ranges;

The second determining submodule is configured to determine the resolution corresponding to the first motion speed range based on the corresponding relationship between the motion speed range and the resolution.

Wherein, the first angular velocity range is one of at least two preset angular velocity ranges, and the first linear velocity range is one of at least two preset linear velocity ranges.

Optionally, the device further includes:

The second determining module is configured to use a plurality of different resolutions to perform image rendering; respectively determine the frame rate range of the screen when each of the multiple different resolutions is used for image rendering; Frame rate ranges corresponding to multiple different resolutions, and frame rate ranges corresponding to different motion speed ranges, to obtain the corresponding relationship between the motion speed range and the resolution.

On the other hand, embodiments of the present disclosure also provide a terminal device, the terminal device includes: a processor; a memory configured to store executable instructions of the processor; wherein the processor is configured to execute The image processing method as described in any of the preceding items.

On the other hand, the embodiments of the present disclosure also provide a computer-readable storage medium. When the instructions in the computer-readable storage medium are executed by the processor of the terminal device, the terminal device can execute any of the preceding items. The image processing method described.

On the other hand, the embodiments of the present disclosure also provide a wearable system, including: the terminal device as described above; and the wearable device configured to display an image output by the terminal device.

Description of the drawings

Figure 1 is a schematic structural diagram of a wearable system;

2 is a flowchart of an image processing method provided by an embodiment of the present disclosure;

FIG. 3 is a flowchart of an image processing method provided by an embodiment of the present disclosure;

4 is a schematic structural diagram of an image processing device provided by an embodiment of the present disclosure;

Fig. 5 is a structural block diagram of a terminal device provided by an embodiment of the present disclosure.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the present disclosure clearer, the following further describes the embodiments of the present disclosure in detail with reference to the accompanying drawings.

However, due to the heavy workload of VR application image rendering, even the best graphics card at the moment has insufficient performance in the face of ultra-high resolution VR application images, resulting in insufficient frame rate of the final display of the VR device, and the image is stuck The pause phenomenon cannot meet the user's requirements for smoothness of the screen.

In order to facilitate the understanding of the solutions provided for this application. The following is a brief description of the wearable system with reference to Figure 1 taking the VR device as an example:

FIG. 1 is a schematic structural diagram of a wearable system. Referring to FIG. 1, the wearable system includes a terminal device 10 and a VR device 20, and the terminal device 10 and the VR device 20 are connected.

The terminal device 10 is the host of the VR device 20, and its role is to run a VR application, render an image generated by the VR application, and then output to the VR device 20 for display. The terminal device 10 may be a device such as a computer.

Among them, the terminal device 10 usually includes a processor, a memory, and a graphics card. A VR application is stored in the memory, and the processor outputs an image by running the VR application. In the process of running the VR application, the graphics card needs to be called to complete the image rendering work. Image rendering refers to the process of converting three-dimensional light energy transfer processing into a two-dimensional image, using the three-dimensional geometric model information, three-dimensional animation definition information and material information provided by the VR application, through geometric transformation, projection transformation, perspective transformation and window trimming And other steps to generate images.

The role of the VR device 20 is to display the image output by the terminal device 10. The VR device 20 includes an attitude sensor, such as a gyroscope. The attitude sensor is used to detect the attitude information of the VR device and transmit the attitude information to the terminal device 10; the VR application in the terminal device 10 can adjust the display of the VR device according to the attitude information The picture brings users an immersive viewing experience. The VR device 20 may be a head-mounted VR device, that is, a VR head display.

When the performance of the graphics card is constant, the image is rendered at a predetermined resolution, and the frame rate of the resulting picture will change with the image effect. The image effect is complex, the rendering takes a long time, the frame rate is low, and the image effect is simple. The time-consuming is short, the frame rate is high, and the frame rate changes within a range. But if you render at different resolutions, the higher the resolution, the lower the frame rate range, and the lower the resolution, the higher the frame rate range. In related technologies, generally, only the default resolution can be used, or the user can select a fixed resolution from the optional resolutions provided by the VR application for image rendering, for example, 2k or 4k resolution.

In other implementations, the VR device in the aforementioned wearable system may also be an AR device or other wearable devices.

Fig. 2 is a flowchart of an image processing method provided by an embodiment of the present disclosure. This method is executed by the terminal device in FIG. 1. Referring to FIG. 2, the image processing method includes:

Step 101: Obtain the movement speed of the wearable device.

Wearable devices are usually worn on the user's head, and the user can change the picture viewed through the wearable device by moving the head. In this step, the movement speed of the wearable device is the movement speed of the wearable device when the user uses the wearable device to drive the wearable device through head movement. The movement speed may include angular speed, linear speed and so on.

Step 102: Determine the resolution of the image to be rendered according to the motion speed, and the resolution is negatively related to the motion speed.

The resolution of the image to be rendered is also the resolution of the rendered image. The negative correlation between resolution and motion speed means that the faster the motion speed of the wearable device, the lower the resolution used for rendering, the slower the motion speed of the wearable device, and the higher the resolution used for rendering.

For example, the movement speed of the wearable device is 180 degrees per second (angular velocity), and the resolution used for rendering is 2K at this time; the movement speed of the wearable device is 90 degrees per second, and the resolution used for rendering is 4K at this time.

Step 103: Perform image rendering using the determined resolution.

In this step, the terminal device can call the graphics card to perform image rendering, and when using the graphics card to perform image rendering, the resolution determined in step 102 is used.

Step 104: Output the rendered image to the wearable device.

After the image is rendered, the image is output to the wearable device for display for the user to watch

In the embodiments of the present disclosure, when the wearable device is at different motion speeds, different rendering resolutions are used for image rendering, and then the rendered image is output to the wearable device for display. During rendering, the resolution is negatively related to the motion speed, that is, the faster the motion speed of the wearable device, the lower the resolution used for rendering, the slower the motion speed of the wearable device, and the higher the resolution used for rendering. When the performance of the graphics card is constant, the resolution used for rendering is negatively related to the frame rate of the final picture. Therefore, when the wearable device is moving fast, the picture displayed by the wearable device has a low resolution and a high frame rate. With the rapid movement of the wearable device, the human eye cannot focus accurately, and the perception of picture clarity decreases, and it does not notice the low image resolution; at the same time, because the frame rate of the picture is high at this time, the user can watch Smooth picture. When the wearable device moves slowly, the screen displayed by the wearable device has a high resolution and a low frame rate. At this time, the user's head moves slowly or stays still with the wearable device, because the wearable device moves slowly or stays still Status, the changes between adjacent frames are small, even if the frame rate of the picture is low, the user will not feel the jam phenomenon; at the same time, due to the high resolution, the user can watch the high-definition picture. In summary, by using different resolutions for image rendering in different situations, users can watch smooth and clear pictures while the performance of the graphics card remains unchanged, reducing the requirements for graphics performance and reducing wearable devices The threshold of popularization.

Fig. 3 is a flowchart of an image processing method provided by an embodiment of the present disclosure. This method is executed by the terminal device in FIG. 1. Referring to FIG. 3, the image processing method includes:

Step 201: Obtain posture data of the wearable device.

The posture sensor in the wearable device can detect the posture data of the wearable device, so this step is: the terminal device obtains the posture data generated by the posture sensor in the wearable device. The posture data can be a quaternion or other forms of posture data.

Generally, the function of the posture data generated by the posture sensor is to adjust the output picture, thereby changing the perspective of the scene seen by the user. For example, the terminal device can determine the direction of the user's rotation or the movement of the position according to the posture data, and output a corresponding screen to the user based on the rotation or movement. Therefore, the screen update speed is related to the acquisition frequency of the attitude data, and only high-frequency attitude data collection can support the update speed of the image output to the user. In order to ensure the update speed of the screen, usually the terminal device obtains the posture data at a frequency of more than 100 Hz, for example, 1000 Hz. Under such high-frequency posture data acquisition conditions, the terminal device can refresh the display screen at a high speed. Of course, usually the screen refresh frequency Lower than the acquisition frequency of attitude data.

Step 202: Determine the movement speed of the wearable device based on the posture data.

After the terminal device obtains the posture data, it uses the posture algorithm to calculate the movement speed of the wearable device.

In an embodiment of the present disclosure, the movement speed may include at least one of an angular speed and a linear speed. Exemplarily, the movement speed may include angular velocity and linear velocity. In this case, no matter whether the user rotates the angle of the wearable device or translates the wearable device, the scene that the user sees will move quickly, and in this case, Using the solution of this application can ensure the smoothness of the screen.

Step 203: Determine the first movement speed range in which the movement speed is located.

In the embodiment of the present disclosure, the movement speed is divided into at least two ranges in advance, and the first movement speed range is one of the preset at least two movement speed ranges.

Taking the movement speed including the angular velocity and the linear velocity as an example, both the angular velocity and the linear velocity are divided into at least two ranges in advance. At this time, step 203 is to determine the first angular velocity range in which the angular velocity is located, and the first linear velocity range in which the linear velocity is located. The first angular velocity range is one of at least two preset angular velocity ranges. The linear velocity range is one of at least two preset linear velocity ranges.

Exemplarily, the preset angular velocity range and linear velocity range may both be two. This division can meet the requirements of fluency and clarity of the final wearable device display on the one hand, and reduce the resources required for processing on the other hand. .

Step 204: Determine the resolution corresponding to the first movement speed range based on the corresponding relationship between the movement speed range and the resolution.

In the embodiment of the present disclosure, the corresponding relationship between the motion speed range and the resolution is stored in the terminal device.

Exemplarily, when the movement speed includes the angular velocity and the linear velocity, the corresponding relationship between the angular velocity range and the resolution, and the corresponding relationship between the linear velocity range and the resolution are stored in the terminal device.

When the preset angular velocity range and linear velocity range are both 2, the smaller angular velocity range in the preset angular velocity range and the smaller linear velocity range in the preset linear velocity range correspond to the same resolution; the preset The larger angular velocity range in the angular velocity range corresponds to the same resolution as the larger linear velocity range in the preset linear velocity range. That is, the terminal device uses two resolutions to control the image rendering, on the one hand, it can ensure the user's requirements for the smoothness and clarity of the wearable device display, on the other hand, the processing process is simpler.

Of course, in other implementations, the resolutions corresponding to the two angular velocity ranges and the resolutions corresponding to the two linear velocity ranges may also be different.

Step 204 may include: based on the corresponding relationship between the angular velocity range and the resolution, determining the first candidate resolution corresponding to the first angular velocity range where the angular velocity is located; based on the corresponding relationship between the linear velocity range and the resolution, determining the linear velocity The second candidate resolution corresponding to the first linear velocity range; the smaller of the first candidate resolution and the second candidate resolution is adopted as the resolution of the image to be rendered.

The reason for using a smaller resolution here is that as long as one of the angular velocity and linear velocity is larger, the user's head movement will be more intense. At this time, the user's eyes' perception of sharpness decreases, and the perception of fluency increases. Small resolution is used. Rate can increase the frame rate of the display and ensure the smoothness of users' viewing.

If the determined first candidate resolution and the second candidate resolution are equal, any one of them is selected as the resolution of the image to be rendered.

Below, the motion speed includes angular velocity and linear velocity, and both angular velocity and linear velocity are divided into 2 ranges. The larger angular velocity range and linear velocity range correspond to the first resolution, and the smaller angular velocity range and linear velocity range correspond to the second resolution. Resolution, the first resolution is smaller than the second resolution as an example:

When any one of the following two conditions is met, it means that the wearable device (that is, the user's head) moves faster, and the first resolution is used for image rendering; when the following two conditions are not met, it means that the wearable If the device moves slowly or is still, the second resolution is used for image rendering; two conditions include:

The angular velocity is greater than the angular velocity threshold, that is, the first angular velocity range in which the angular velocity is located is a larger angular velocity range; the linear velocity is greater than the linear velocity threshold, that is, the first linear velocity range in which the linear velocity is located is a larger linear velocity range.

In the embodiments of the present disclosure, the angular velocity threshold and the linear velocity threshold can be determined in advance through experiments. For example, multiple angular velocity values and multiple linear velocity values are selected at a fixed step interval, and each angular velocity value and linear velocity value are respectively used to execute the steps adopted in the embodiment of the present disclosure. Through the user's perception of viewing fluency and clarity, To select the most suitable angular velocity value and linear velocity value as the aforementioned angular velocity threshold and linear velocity threshold.

When the angular velocity and linear velocity are divided into more ranges, the above-mentioned method can also be used to determine the critical values of different ranges.

Optionally, the method further includes: determining the resolution corresponding to each motion speed range, that is, determining the correspondence between the motion speed range and the resolution. For the same or different terminal devices, the configured graphics cards can be different. Different graphics cards have different processing capabilities. For example, when a low-configuration graphics card and a high-configuration graphics card are rendered at the same resolution, the images rendered by the low-configuration graphics card will show severe freezes. Therefore, it is possible to determine the resolution corresponding to the motion speed range that meets its processing capabilities for different graphics cards, so that the performance of the graphics cards can be fully utilized.

Exemplarily, since the graphics card of the terminal device is usually pluggable and replaceable, the terminal device may store the corresponding relationship between the motion speed range and the resolution associated with the graphics card of different models. When performing step 204, the terminal device first obtains the graphics card information, determines the graphics card model based on the graphics card information, and determines the correspondence between the motion speed range and the resolution based on the graphics card model, so that the used correspondence matches the performance of the graphics card.

Exemplarily, for a graphics card of a model, determining the resolution corresponding to each motion speed range includes:

Use a variety of different resolutions for image rendering;

Respectively determine the frame rate range of the picture when various resolutions are used for image rendering;

According to the frame rate range of the picture and the frame rate range corresponding to different motion speed ranges, the resolution corresponding to each motion speed range is selected, and the corresponding relationship between the motion speed range and the resolution is obtained.

Among them, the frame rate range corresponding to different motion speed ranges can be divided into the set frame rate range in the way that the higher the motion speed, the larger the frame rate range, for example, the frame rate is divided into equal parts between 25-120 Multiple frame rate ranges, and the multiple frame rate ranges respectively correspond to multiple motion speed ranges one-to-one. Among them, the frame rate is below 25, even if the user is still in a static state, the screen will feel stuck, so it is not used, and the frame rate is above 120. The graphics card resource consumption is large, and the user's impression and frame rate are 75. There is almost no difference between -120, and it is also not used, so the frame rate range of 25-120 is used as the basis for determining the resolution. Among them, the frame rate of 25 means that the screen is refreshed 25 times per second (corresponding to 25 images), and the frame rate of 120 means that the screen is refreshed 120 times per second (corresponding to 120 images).

The following is an example of determining the first resolution and the second resolution to explain how to determine the resolution corresponding to each motion speed range. The determining of the first resolution and the second resolution may include:

A variety of different resolutions are used for image rendering respectively; the different resolutions here can be preset various resolutions for applications (for example, VR applications).

Respectively determine the frame rate range of the picture when the various resolutions are used for image rendering. For example, in a period of time, one resolution is used for image rendering, and the frame rate at different time points in the period is recorded, so as to obtain the frame rate range corresponding to the resolution.

According to the frame rate range of the screen, select the first resolution and the second resolution; when the first resolution is used for image rendering, the frame rate range of the screen is the first frame rate range, when the second resolution is used for image rendering When rendering, the frame rate range of the picture is the second frame rate range, and the first frame rate≤the second frame rate range<the second frame rate≤the first frame rate range. Here, the selected first frame rate range and the second frame rate range are not continuous, so that when the user watches the pictures of the first resolution and the second resolution, the fluency is significantly different, so that the lower resolution is displayed. When the picture is displayed, the smoothness of the picture is good, and the picture definition is high when the low frame rate picture is displayed.

The resolution is selected by the frame rate range of the screen displayed by the wearable device to ensure that the selected first resolution and second resolution can make the screen smooth when the wearable device is moving at a high speed; when the wearable device is moving at a low speed or When it is still, the picture is clear.

In the embodiment of the present disclosure, if multiple first resolutions (second resolutions) that meet the conditions are selected, the highest resolution is selected from the multiple first resolutions (second resolutions) that meet the conditions. The first resolution (second resolution), so as to make full use of the graphics card performance and improve the graphics card usage rate.

In an implementation manner of the embodiment of the present disclosure, the first frame rate is greater than 25, and the second frame rate is greater than 60. In this way, when the first resolution is adopted, the frame rate range of the picture displayed by the wearable device is higher than 60, which can ensure the smoothness of the picture when the wearable device is moving at high speed; when the second resolution is adopted, the wearable device The frame rate range of the displayed picture is higher than 25, and at the same time lower than the frame rate when the first resolution is adopted. This can ensure that the wearable device does not appear to be stuck when the wearable device is moving or stationary at low speed, and at the same time, by reducing the frame rate to achieve high resolution The image is rendered to ensure the clarity of the picture. At the same time, using the above frame rate to determine the resolution can not only ensure the utilization of high-performance graphics cards, but also ensure the normal operation of low-performance graphics cards.

Exemplarily, the first frame rate may be 30, and the second frame rate may be 75. Because if you keep your head still, when the frame rate of the picture is above 30, the human eye will not notice the stuttering phenomenon; if the head moves faster, the graphics card rendering frame rate must reach 75 or higher, so that the human eye can not detect it. To the Caton phenomenon.

Step 205: Perform image rendering using the determined resolution.

In the embodiment of the present disclosure, the terminal device may automatically adjust the resolution based on the motion speed, that is, the solution provided in the embodiment of the present disclosure is adopted to realize the resolution adjustment, and then the image rendering is performed according to the adjusted resolution.

In the embodiment of the present disclosure, taking the VR device as an example, the resolution corresponding to each motion speed range may be the resolution preset by the VR application, so as to ensure the normal output of the VR application. The maximum resolution of the resolutions corresponding to each motion speed range can be the same resolution as the screen of the wearable device among the multiple resolutions preset by the VR application, such as 4K resolution, so that the wearable device can display the maximum Resolution screen.

When the wearable device is moving at a high speed, the resolution used for image rendering is low, which reduces the pressure on the terminal device to render the image, and the resulting picture has a higher frame rate and smooth picture. Due to the physiological characteristic of "saccade suppression" in the human eye, when the human eye moves quickly with the head, the human eye cannot focus accurately, and the perception of picture clarity is reduced, and the lower image resolution will not be noticed.

Since the wearable device is moving at a low speed or even when it is still, the resolution used for image rendering is higher. At this time, although the frame rate of the obtained picture is lower, the image definition is high. Since there are few changes between adjacent frames, even if the frame rate is low, the user will not feel the stutter phenomenon. At this time, the user's focus is mainly on the clarity of the image. Due to the high image clarity, the user's viewing experience is improved.

Generally, in VR games or other VR applications, the user can manually set the output image resolution, for example, select the output image resolution to be 2K or 4K. Therefore, in the embodiments of the present disclosure, in addition to the automatic resolution mode, that is, the automatic setting of the terminal device, the VR application may also have a manual resolution mode, that is, the manner set by the user. An automatic/manual switch button can be set in VR games or other VR applications to switch between automatic setting and manual setting. The terminal device can determine the mode to be used according to the user's selection instruction, and perform the resolution determination operation according to the mode .

Step 206: Output the rendered image to the wearable device.

The screen of the wearable device can be of various types, such as organic light emitting diode (OLED), liquid crystal display (LCD), and so on. Optionally, when the screen of the wearable device is an LCD, the terminal device may also perform a dynamic dimming (Local Dimming) process after the image rendering is completed, and transmit the result of the dynamic dimming to the wearable device. Dynamic dimming processing refers to a scheme that modulates the screen backlight according to the picture to be displayed to enhance the picture contrast, that is, the terminal device determines the backlight source of the screen of the wearable device according to the grayscale of each pixel in the rendered image The brightness of each backlight unit. The result of the aforementioned dynamic dimming may be the brightness information of each backlight unit of the backlight source of the screen of the wearable device. The backlight of the screen of the wearable device is composed of multiple backlight units, and the brightness of each backlight unit can be individually controlled.

The result of the dynamic dimming can be transmitted to the wearable device through the image transmission channel together with the image obtained by the foregoing rendering.

Fig. 4 is a schematic structural diagram of an image processing device provided by an embodiment of the present disclosure. Referring to FIG. 4, the image processing apparatus includes: an acquisition module 301, a first determination module 302, a rendering module 303, and an output module 304.

The obtaining module 301 is configured to obtain the movement speed of the wearable device;

The first determining module 302 is configured to determine the resolution of the image to be rendered according to the motion speed, and the resolution is negatively related to the motion speed;

The rendering module 303 is configured to perform image rendering using resolution;

The output module 304 is configured to output the rendered image to the wearable device.

Exemplarily, the acquisition module 301 may include a sensor, such as a posture sensor. The posture sensor can detect the posture data of the wearable device, and the movement speed of the wearable device can be obtained based on the posture data.

In an implementation manner of the embodiment of the present disclosure, the first determining module 302 includes:

The first determining submodule 321 is configured to determine a first motion speed range in which the motion speed is located, and the first motion speed range is one of at least two preset motion speed ranges;

The second determining sub-module 322 is configured to determine the resolution corresponding to the first motion speed range based on the corresponding relationship between the motion speed range and the resolution.

In an implementation of the embodiment of the present disclosure, the movement speed includes at least one of an angular velocity and a linear velocity.

In an implementation of the embodiment of the present disclosure, when the movement speed includes the angular velocity and the linear velocity, the second determining sub-module 322 is configured to determine the first angular velocity at which the angular velocity is based on the corresponding relationship between the angular velocity range and the resolution. The first candidate resolution corresponding to the range; based on the correspondence between the linear velocity range and the resolution, determine the second candidate resolution corresponding to the first linear velocity range where the linear velocity is located; the first angular velocity range is at least the preset One of the two angular velocity ranges, the first linear velocity range is one of at least two preset linear velocity ranges; the smaller one of the first candidate resolution and the second candidate resolution is adopted as the waiting The resolution of the rendered image.

In an implementation of the embodiment of the present disclosure, the preset angular velocity range is two, and the preset linear velocity range is two;

The smaller angular velocity range in the preset angular velocity range corresponds to the same resolution as the smaller linear velocity range in the preset linear velocity range;

The larger angular velocity range in the preset angular velocity range and the larger linear velocity range in the preset linear velocity range correspond to the same resolution.

Optionally, the device may further include:

The second determining module 305 determines the resolution corresponding to each movement speed range.

In an implementation manner of an embodiment of the present disclosure, the second determining module 305 is configured to use a plurality of different resolutions to perform image rendering; respectively determine to use various resolutions of a plurality of different resolutions for image rendering When, the frame rate range of the picture; according to the frame rate range of the picture and the frame rate range corresponding to different motion speed ranges, select the resolution corresponding to each motion speed range to obtain the corresponding relationship between the motion speed range and the resolution.

Fig. 5 is a structural block diagram of a terminal device provided by an embodiment of the present disclosure. The terminal device 400 includes a central processing unit (CPU) 401, a system memory 404 including a random access memory (RAM) 402 and a read only memory (ROM) 403, and a system bus 405 connecting the system memory 404 and the central processing unit 401. The terminal device 400 also includes a basic input/output system (I/O system) 406 to help transfer information between various devices in the computer, and a mass storage device for storing the operating system 413, application programs 414, and other program modules 415 407.

The basic input/output system 406 includes a display 408 for displaying information and an input device 409 such as a mouse and a keyboard for the user to input information. The display 408 and the input device 409 are both connected to the central processing unit 401 through the input and output controller 410 connected to the system bus 405. The basic input/output system 406 may also include an input and output controller 410 for receiving and processing input from multiple other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input and output controller 410 also provides output to a display screen, a printer, or other types of output devices.

The mass storage device 407 is connected to the central processing unit 401 through a mass storage controller (not shown) connected to the system bus 405. The mass storage device 407 and its associated computer readable medium provide non-volatile storage for the terminal device 400. That is, the mass storage device 407 may include a computer-readable medium (not shown) such as a hard disk or a CD-ROM drive.

Without loss of generality, computer-readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storage technologies, CD-ROM, DVD or other optical storage, tape cartridges, magnetic tape, disk storage or other magnetic storage devices. Of course, those skilled in the art may know that the computer storage medium is not limited to the foregoing. The aforementioned system memory 404 and mass storage device 407 may be collectively referred to as memory.

According to various embodiments of the present disclosure, the terminal device 400 may also be connected to a remote computer on the network through a network such as the Internet to operate. That is, the terminal device 400 can be connected to the network 412 through the network interface unit 411 connected to the system bus 405, or in other words, can also use the network interface unit 411 to connect to other types of networks or remote computer systems (not shown).

The memory also includes one or more programs, one or more programs are stored in the memory, and the central processing unit 401 executes the one or more programs to implement the image processing method shown in FIG. 2 or FIG. 3.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as a memory including instructions, which can be executed by a processor of a terminal device to complete the enhancements shown in each embodiment of the present disclosure. Real device sharing method. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

The embodiment of the present disclosure also provides a wearable system, which includes:

Terminal equipment as shown in Figure 5;

The wearable device is configured to display the image output by the terminal device.

The above descriptions are only optional embodiments of the present disclosure and are not intended to limit the present disclosure. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the protection of the present disclosure. Within range.

Claims

An image processing method, the image processing method includes:

Obtain the movement speed of the wearable device;

Determining the resolution of the image to be rendered according to the movement speed, where the resolution is negatively related to the movement speed;

Image rendering using the resolution;

The rendered image is output to the wearable device.
The image processing method according to claim 1, wherein the determining the resolution of the image to be rendered according to the motion speed comprises:

Determine a first movement speed range in which the movement speed is located, where the first movement speed range is one of at least two preset movement speed ranges;

Based on the corresponding relationship between the motion speed range and the resolution, the resolution corresponding to the first motion speed range is determined.
The image processing method according to claim 2, wherein the movement speed includes at least one of an angular speed and a linear speed.
The image processing method according to claim 3, wherein when the movement speed includes angular velocity and linear velocity, the resolution corresponding to the first movement speed range is determined based on the corresponding relationship between the movement speed range and the resolution ,include:

Determine the first candidate resolution corresponding to the first angular velocity range in which the angular velocity is located based on the correspondence between the angular velocity range and the resolution;

Based on the correspondence between the linear velocity range and the resolution, determining the second candidate resolution corresponding to the first linear velocity range where the linear velocity is located;

Adopting the smaller of the first candidate resolution and the second candidate resolution as the resolution of the image to be rendered;

Wherein, the first angular velocity range is one of at least two preset angular velocity ranges, and the first linear velocity range is one of at least two preset linear velocity ranges.
The image processing method according to claim 4, wherein the preset angular velocity range is two, and the preset linear velocity range is two;

The smaller angular velocity range in the preset angular velocity range and the smaller linear velocity range in the preset linear velocity range correspond to the same resolution;

The resolution corresponding to the larger angular velocity range in the preset angular velocity range and the larger linear velocity range in the preset linear velocity range is the same.
The image processing method according to any one of claims 2 to 5, wherein the method further comprises:

Use a variety of different resolutions for image rendering;

Respectively determine the frame rate range of the picture when the various resolutions among the multiple different resolutions are used for image rendering;

According to the frame rate ranges corresponding to the multiple different resolutions and the frame rate ranges corresponding to the different motion speed ranges, the corresponding relationship between the motion speed range and the resolution is obtained.
An image processing device, the image processing device includes:

The obtaining module is configured to obtain the movement speed of the wearable device;

The first determining module is configured to determine the resolution of the image to be rendered according to the motion speed, where the resolution is negatively related to the motion speed;

A rendering module configured to perform image rendering using the resolution;

The output module is configured to output the rendered image to the wearable device.
8. The image processing device according to claim 7, wherein the first determining module comprises:

A first determining sub-module configured to determine a first motion speed range in which the motion speed is located, the first motion speed range being one of at least two preset motion speed ranges;

The second determining submodule is configured to determine the resolution corresponding to the first motion speed range based on the corresponding relationship between the motion speed range and the resolution.
The image processing device according to claim 8, wherein the movement speed includes at least one of an angular speed and a linear speed.
The image processing device according to claim 9, wherein, when the movement speed includes an angular velocity and a linear velocity, the resolution corresponding to the first movement speed range is determined based on the corresponding relationship between the movement speed range and the resolution ,include:

Determine the first candidate resolution corresponding to the first angular velocity range in which the angular velocity is located based on the correspondence between the angular velocity range and the resolution;

Based on the correspondence between the linear velocity range and the resolution, determining the second candidate resolution corresponding to the first linear velocity range where the linear velocity is located;

Adopting the smaller of the first candidate resolution and the second candidate resolution as the resolution of the image to be rendered;

Wherein, the first angular velocity range is one of at least two preset angular velocity ranges, and the first linear velocity range is one of at least two preset linear velocity ranges.
The image processing device according to claim 10, wherein the preset angular velocity range is two, and the preset linear velocity range is two;

The smaller angular velocity range in the preset angular velocity range and the smaller linear velocity range in the preset linear velocity range correspond to the same resolution;

The resolution corresponding to the larger angular velocity range in the preset angular velocity range and the larger linear velocity range in the preset linear velocity range is the same.
The image processing device according to any one of claims 8 to 11, wherein the device further comprises:

The second determining module is configured to use a plurality of different resolutions to perform image rendering; respectively determine the frame rate range of the screen when each of the multiple different resolutions is used for image rendering; Frame rate ranges corresponding to multiple different resolutions, and frame rate ranges corresponding to different motion speed ranges, to obtain the corresponding relationship between the motion speed range and the resolution.
A terminal device, the terminal device comprising: a processor; a memory configured to store instructions executable by the processor; wherein the processor is configured to be configured to execute any one of claims 1 to 6 Image processing method.
A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of a terminal device, the terminal device can execute the image processing method according to any one of claims 1 to 6.
A wearable system, the wearable system includes:

The terminal device according to claim 13;

The wearable device is configured to display the image output by the terminal device.