WO2018040180A1

WO2018040180A1 - Photographing method and apparatus

Info

Publication number: WO2018040180A1
Application number: PCT/CN2016/100793
Authority: WO
Inventors: 董德; 曾燕玲; 段勇
Original assignee: 宇龙计算机通信科技(深圳)有限公司
Priority date: 2016-08-31
Filing date: 2016-09-29
Publication date: 2018-03-08
Also published as: CN106131391B; CN106131391A

Abstract

A photographing method and apparatus. The method comprises: acquiring a display pixel array of a screen currently to be photographed (S101); calculating a coincidence degree of the display pixel array and a sampled pixel array of a photographing device (S102); when the coincidence degree is less than a first pre-set threshold value, calculating a direction of movement for the photographing device for increasing the coincidence degree (S103); and notifying the user of the direction of movement (S104). By measuring in real time the coincidence degree of a display pixel array of a screen and a sampled pixel array from a camera sensor, and guiding a user to increase the coincidence degree of the two pixel arrays step by step, the two arrays tend to overlap as much as possible, the interference when two arrays overlap is weakened, and a moiré pattern can be significantly reduced or even eliminated, thereby allowing a user to quickly and easily obtain high-definition screen shots.

Description

Shooting method and device

The present application claims priority to Chinese Patent Application No. 2016-10792759.7, the entire disclosure of which is incorporated herein in

Technical field

The present invention relates to the field of photographing technology, and in particular to a photographing method and apparatus.

Background technique

In life, people's interactions are more and more reflected in the network. Many people share their own dynamics through online social applications such as Weibo. Mobile terminals such as mobile phones with cameras or shooting functions often appear. Take a picture of the computer screen.

However, due to waveform interference between the sampling pixels in the camera CCD of the camera such as a mobile phone or a digital camera and the display pixels of the captured display screen, a dense curved color line appears, that is, an image as shown in FIG. The moiré phenomenon in the middle. Such a moiré spreads over the entire image, which is difficult to optimize by software, resulting in a very poor picture clarity and affecting the viewing of the picture.

In view of this, it is highly necessary to provide a photographing method and apparatus to attenuate the moiré phenomenon generated when a mobile terminal takes a screen shot.

Summary of the invention

It is an object of the present invention to provide a photographing method and apparatus for solving the problem that a moiré phenomenon occurs when an existing photographing apparatus photographs a screen, resulting in a low image quality and affecting a photographing effect.

In order to solve the above technical problem, the present invention provides a photographing method, comprising: acquiring a display pixel array of a current screen to be photographed; calculating a coincidence degree of the display pixel array and a sampling pixel array of the photographing device; when the coincidence degree is lower than When the first threshold is preset, the moving direction of the photographing device that increases the coincidence degree is calculated; the moving direction is presented to the user.

Optionally, before the acquiring the display pixel array of the current to-be-shot screen, the method further includes: receiving an instruction input by the user to enter a screen shooting mode; or detecting a moiré phenomenon when the shooting image is detected When you enter the screen shot mode.

Optionally, the acquiring the display pixel array of the current to-be-shot screen includes: determining the display pixel array corresponding to the model by identifying a model of the current to-be-shot screen; or receiving a user input to select the current An instruction to capture a size of the screen and a resolution, determine the display pixel array according to the size and the resolution; or generate a molar by interference on a screen of the current to-be-shot screen captured at different angles and different distances The array of display pixels is determined by a pattern and a known array of sampled pixels.

Optionally, the calculating the degree of coincidence of the display pixel array and the sampling pixel array of the photographing device comprises: calculating, as a first ratio of all pixel points in the sampled pixel array on the display pixel array The degree of coincidence; or a calculated second ratio of all pixel points in the display pixel array falling on the sampled pixel array as the coincidence degree; or the first ratio and the second ratio The weighted value is taken as the degree of coincidence.

Optionally, the calculating a moving direction of the photographing device that increases the coincidence degree comprises: calculating a coincidence degree after a predetermined plurality of directions is assumed to be moved, and selecting a direction in which the calculated coincidence degree is the highest as the The moving direction is calculated; or the rate of change of the coincidence degree is calculated during the movement of the photographing apparatus, and the moving direction of the point where the forward rate of change is the largest is selected as the moving direction.

Optionally, the prompting the user to move the direction comprises: prompting the user by means of an arrow, a direction, a screen tilt or a voice.

Optionally, after the prompting the moving direction to the user, the method further includes: capturing the current to-be-shot screen when the preset shooting condition is met.

Optionally, when the preset shooting condition is met, the photographing the current to-be-shot screen includes: receiving a shooting instruction input by a user, and photographing the current to-be-shot screen; or when the coincidence exceeds a preset When the second threshold is set, the user is prompted with the optimal shooting prompt information or automatically captures the current to-be-shot screen.

Optionally, the prompting the optimal shooting prompt information to the user comprises: prompting by means of text, sound, screen flicker, shooting button color switching, or shooting button color blinking.

The present invention further provides a photographing apparatus, comprising: a display pixel array acquiring module, configured to acquire a display pixel array of a current screen to be photographed; a coincidence degree calculating module configured to calculate a sampling pixel array of the display pixel array and the photographing device Coincidence degree; moving direction calculation module, set to be When the degree of coincidence is lower than the preset first threshold, the moving direction of the photographing device that increases the coincidence degree is calculated; and the prompting module is configured to prompt the user for the moving direction.

Optionally, the method further includes: a screen shot mode entry module, configured to receive an instruction input by the user to enter a screen shot mode before the display pixel array acquisition module acquires the display pixel array of the current screen to be shot; or when detecting When the moiré phenomenon appears on the shooting screen, enter the screen shooting mode.

Optionally, the display pixel array acquiring module is specifically: determining a module of the display pixel array corresponding to the model by identifying a model of the current screen to be photographed; or receiving a user input to select the current waiting An instruction to capture a size of the screen and a resolution, determine a module of the display pixel array according to the size and the resolution; or generate interference by interfering with a picture of the current to-be-shot screen captured at different angles and different distances A pattern of the display pixel array is determined by moiré and a known array of sampled pixels.

Optionally, the coincidence calculation module is specifically: calculating, by using the first ratio of all pixel points in the array of pixel arrays on the display pixel array, as a module of the coincidence degree; or calculating a second ratio of all pixel points in the display pixel array falling on the sampling pixel array as a module of the coincidence degree; or a weighting value of the first ratio and the second ratio as the coincidence Degree module.

Optionally, the moving direction calculation module is specifically configured to: calculate a coincidence degree after a predetermined plurality of directions is assumed to be moved, and select a direction in which the calculated coincidence degree is the highest as a module of the moving direction; or in the shooting The rate of change of the coincidence degree is calculated during the movement of the device, and the moving direction of the point with the largest forward rate of change is selected as the module of the moving direction.

Optionally, the prompting module is specifically: a module that prompts the user by means of an arrow, a direction, a screen tilt, or a voice.

Optionally, the method further includes: a shooting module, configured to: after the prompting module prompts the user of the moving direction, when the preset shooting condition is met, the current to-be-shot screen is photographed.

Optionally, the photographing module is specifically configured to: receive a photographing instruction input by a user, and perform a photographing on the current screen to be photographed; or when the coincidence exceeds a preset second threshold, prompt the user to the most Excellent shooting information or a module that automatically captures the current screen to be shot.

Optionally, the shooting module is specifically: by text, sound, screen flicker, shooting button A module that prompts for the color switching or shooting button color flashing.

The photographing method and device provided by the present invention acquires a display pixel array of a current screen to be photographed; calculates a coincidence degree of a display pixel array and a sampling pixel array of the photographing device; and when the coincidence degree is lower than a preset first threshold, the calculation is performed The moving direction of the photographing device that increases the degree of coincidence; prompts the user of the moving direction. The present application detects the coincidence degree of the display pixel array of the screen and the sampling pixel array of the camera sensor in real time, and guides the user to gradually increase the coincidence degree of the two pixel arrays, so that the two arrays tend to overlap as much as possible, and weaken the overlap of the two arrays. The interference can significantly reduce or even eliminate moiré, so that users can get high-definition screen shots quickly and easily.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are merely Some embodiments of the present invention may also be used to obtain other drawings based on these drawings without departing from the art.

Figure 1 is a schematic diagram of the moiré phenomenon in the image;

2 is a schematic diagram showing the principle of generation of moiré;

3 is a schematic diagram showing a specific arrangement when the display of the screen and the camera sensor and the sampling pixels maintain a certain angle and distance;

4 is a schematic diagram of interference between a display pixel array and a sampling pixel array of a screen and a camera sensor;

FIG. 5 is a flowchart of a specific implementation manner of a photographing method provided by the present invention; FIG.

6 is a flow chart of another specific embodiment of a photographing method provided by the present invention;

7 is a flow chart of still another embodiment of a photographing method provided by the present invention;

FIG. 8 is a structural block diagram of a photographing apparatus according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a photographing apparatus 1 according to an embodiment of the present invention;

FIG. 10 is a structural block diagram of a photographing apparatus 2 according to another embodiment of the present invention.

detailed description

Moiré is a phenomenon caused by the superposition of the peaks of two sine waves. In fact, it is the hand. Waveform interference occurs between the sampling pixels in the camera CCD of the camera such as a digital camera or a digital camera and the display pixels of the captured display. As shown in Figure 2, the schematic diagram of the generation of moiré is shown. Figure 3 is a schematic diagram showing a specific arrangement of the display and sampling pixels of the screen and camera sensors while maintaining a particular angle and distance. After the interference between the two, there will be a situation as shown in 4, and moiré appears in the overlapping portion. Since the film camera has no pixels, there is no irregular interference fringes.

Based on the above principle, it is known that the main cause of the moiré phenomenon is that the display pixel array of the screen and the sampling pixel array of the camera sensor cannot be in one-to-one correspondence, resulting in an interference phenomenon. Adjusting the spacing of the two pixel arrays can change the relative sizes of the two arrays. Adjusting the orientation of the camera can change the relative orientation of the two pixel arrays. Therefore, by adjusting the spacing and direction to make the two arrays overlap as much as possible, it can be significant. Reduce or even eliminate moiré.

The present invention will be further described in detail below in conjunction with the drawings and embodiments. It is apparent that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

A flowchart of a specific embodiment of the photographing method provided by the present invention is shown in FIG. 5, and the method includes:

Step S101: Acquire an array of display pixels of a current screen to be shot;

Step S102: Calculate a degree of coincidence of the display pixel array and the sampling pixel array of the photographing device;

The sampling pixel array of the photographing device may be an array of sampling pixels of the CCD of the photographing device, and specifically, the sampling pixel array of the CCD may be determined by the sensor data of the photographing device itself. In addition, the sampling pixel array can also be obtained by reading chip data or pre-storing configuration information.

The coincidence degree is used to indicate the degree of coincidence of the sampled pixel array and the display pixel array. The more overlap between the two arrays, the higher the degree of coincidence.

Step S103: When the degree of coincidence is lower than a preset first threshold, calculate a moving direction of the photographing device that increases the coincidence degree;

Step S104: Prompting the user to the moving direction.

Specifically, the user may be prompted by an arrow, a direction, a screen tilt, or a voice. The direction of movement can be forward, backward, leftward, rightward, or other direction relative to the current screen.

The photographing method provided by the present invention obtains the display pixel array of the current screen to be photographed; calculates the coincidence degree of the display pixel array and the sampling pixel array of the photographing device; when the coincidence degree is lower than the preset first threshold, the calculation is performed to make coincidence The moving direction of the photographing device is increased; the user is prompted to move the direction. The present application detects the coincidence degree of the display pixel array of the screen and the sampling pixel array of the camera sensor in real time, and guides the user to gradually increase the coincidence degree of the two pixel arrays, so that the two arrays tend to overlap as much as possible, and weaken the overlap of the two arrays. Interference, which can significantly reduce or even eliminate moiré, so that users can get high-definition screen shots quickly and easily.

On the photographing apparatus, the setting screen screen shooting mode can be added to implement the photographing method provided by the present invention. The startup mode of the screen shot mode may be an instruction to receive a screen input mode input by the user; or when a moiré phenomenon is detected on the photographing screen, that is, the photographing screen is taken by the photographing device, the screen shot mode is entered. After entering the screen shooting mode, the shooting method provided by the present invention can be used for shooting.

A flowchart of another specific embodiment of the photographing method provided by the present invention is shown in FIG. 6, and the method includes:

Step S201: Enter a screen shooting mode;

Specifically, entering the screen shot mode may be an instruction to input a screen input mode input by the user. The trigger mode of the command can be physical button, virtual button or voice. It is also possible to automatically enter the screen shooting mode when the moiré phenomenon of the shooting screen is detected in the normal shooting mode.

Step S202: Acquire an array of display pixels of a current screen to be shot;

Step S203: calculating a degree of coincidence between the display pixel array and the sampling pixel array of the photographing device;

Step S204: When the degree of coincidence is lower than a preset first threshold, calculate a moving direction of the photographing device that increases the coincidence degree;

A method for determining a moving direction may be: calculating a coincidence degree after a predetermined plurality of directions is assumed to be moved, and selecting a direction in which the calculated degree of coincidence is the highest as the moving direction.

Specifically, a three-dimensional coordinate system is established with the center point of the photographing device as an origin, and a spherical surface is formed with R as a radius. The area of the spherical surface is N-divided, and the center point of each aliquot is taken as a preset assumed direction, that is, has N preset assumed directions. N is greater than or equal to 6, and its specific value can be set according to the actual accuracy and the amount of calculation. Calculate the coincidence degree after moving the N preset assumed directions respectively, and Compare the size and determine the direction with the highest degree of coincidence as the direction of movement.

Taking N=6 as an example is equivalent to dividing the space into six directions: up, down, left, and right. Calculate the degree of coincidence after moving a preset displacement unit to the six directions, and select the direction with the highest degree of coincidence as the moving direction. If the coincidence degree is calculated to be the highest when moving to the right, it will be the right as the prompting device. The direction of movement of the move. Of course, when N is chosen to be 6, the calculation is the smallest and the accuracy is the worst.

Alternatively, another method for determining the moving direction may be: calculating a rate of change of the coincidence degree during the moving of the photographing device, and selecting a moving direction of a point having the largest forward rate of change as the moving direction.

There is a moving trajectory during the movement of the photographing device, and the coincidence degree of each point in the trajectory changes, and the rate of change of the coincidence degree of each point with respect to the upper point is different. Therefore, the rate of change of the coincidence degree is calculated during the movement, and the moving direction of the point with the largest forward rate of change is selected as the direction with the highest probability of increasing the degree of coincidence, that is, the moving direction for prompting the moving of the photographing device.

Step S205: prompting the user of the moving direction.

Further, after prompting the user for the moving direction, the method may further include:

When the preset shooting condition is satisfied, the current to-be-shot screen is photographed.

The preset shooting condition may be: receiving a shooting instruction input by the user, and capturing the current to-be-shot screen; or prompting the user to the optimal shooting prompt information or when the coincidence degree exceeds a preset second threshold The current to-be-shot screen is automatically captured.

The user can move the photographing device in the direction of the prompt, and when the coincidence degree is greater than the preset second threshold, the user may prompt the user to perform the optimal photographing prompt information for shooting, or the photographing device can automatically perform photographing, and further automatically save the photographed image. In addition, it is also possible to receive an instruction from the user to take a picture during the movement of the shooting device and directly shoot.

In the screen shooting mode in this embodiment, after the screen shot is taken according to the shooting button or the screen screen is automatically photographed, the shooting interface may be displayed without further exiting the shooting interface, and the direction prompt for further increasing the coincidence degree is displayed on the screen until the user input is received. Exit the screen shot mode or exit the shooting screen.

For example, the following is a description of a specific embodiment of the photographing method provided by the present invention. The flowchart of the method is as shown in FIG. 7 , and specifically includes:

Step S301: When it is detected that the moiré phenomenon occurs on the shooting screen, enter the screen shooting mode;

Step S302: determining, by the captured screen image, a display pixel array of the current screen;

Specifically, the determining method of the display pixel array may be: determining the display pixel array corresponding to the model by identifying a model of the current to-be-shot screen. After identifying the model of the current screen to be shot, by searching the data, the display pixel array of the screen corresponding to the model can be determined.

The determining method of the display pixel array may further be: receiving an instruction input by the user for selecting a size and a resolution of the current to-be-shot screen, and determining the display pixel array according to the size and the resolution. The process is to select the selection box containing the size and resolution of the current screen by the user on the premise that the user knows the size and resolution of the current screen, and then according to the size and the resolution, the resolution is required. Pixels are uniformly distributed in a regular array of pixels formed on a screen of corresponding size.

Another method of determining a display pixel array is to determine the display pixel array by a moiré generated by interference on a picture of the current to-be-shot screen captured at different angles and a known sampled pixel array. Since the camera sampling pixel array is fixed, the display pixel array is also fixed, and the moiré generated by the interference on the screen images taken at different angles and different distances is also different. The array of display pixels can be solved by moiré on a screen image taken at different angles and at different distances, and a known array of sampled pixels.

Step S303: determining a sampling pixel array of the sensor;

It should be noted that the positions of step S302 and step S303 described above may be interchanged, which does not affect the implementation of the present invention.

Step S304: calculating a coincidence degree between the display pixel array of the current screen and the current sensor sampling pixel array;

Specifically, the calculation method of the coincidence degree may be: calculating a first ratio of all pixel points in the sampled pixel array on the display pixel array as the coincidence degree.

The calculation method of the coincidence degree may be: calculating a second ratio of all pixel points in the display pixel array on the sampling pixel array as the coincidence degree;

In addition, a weighting value of the first ratio and the second ratio may also be used as the coincidence degree. Or after performing other calculations on the weighting values of the first ratio and the second ratio, the corresponding numerical value obtained is taken as the weight Cohesion.

Step S305: When the calculated coincidence degree is lower than the preset first threshold, calculate a moving direction that increases the coincidence degree;

Step S306: prompting the user to the moving direction;

Step S307: In the process of the user moving the photographing device, continuously detecting and calculating, repeating steps S304 to S307, until the calculated coincidence degree is greater than the preset second threshold, the screen prompts the user to perform shooting, or the mobile terminal automatically performs Take a picture and save the picture.

The specific prompts for the user to shoot can be text prompts, voice prompts, screen flashing prompts, shooting button color prompts, or shooting button color blinking prompts.

The shooting method provided by the present invention is further elaborated below in a specific scenario. In this scenario, the user turns on the camera to enter the shooting screen, and the mobile terminal detects that the screen has moiré and enters the screen shooting mode. Determining the display pixel array of the screen and the sampling pixel array, calculating the coincidence degree of the two arrays, when the coincidence degree is less than the first threshold value, for example, the first threshold value may be taken as 70%, and the calculated coincidence degree is increased on the screen shooting interface. In the large moving direction, the user moves the camera backwards or forwards according to the moving direction of the prompt. The calculated coincidence degree is greater than the second threshold, and the second threshold can be taken as 85%. The mobile terminal automatically captures the current picture and saves it. Continue to display the moving direction that increases the coincidence degree. When the coincidence degree is increased to 94%, the user presses the shooting button to save the shooting screen and exits the shooting interface.

The photographing apparatus provided by the embodiment of the present invention will be described below, and the photographing apparatus described below and the photographing method described above can be referred to each other.

FIG. 8 is a structural block diagram of a photographing apparatus according to an embodiment of the present invention. The photographing apparatus may include:

The display pixel array obtaining module 100 is configured to acquire a display pixel array of the current screen to be captured;

The coincidence degree calculation module 200 is configured to calculate a degree of coincidence of the display pixel array and the sampling pixel array of the photographing device;

The movement direction calculation module 300 is configured to calculate a moving direction of the photographing device that increases the coincidence degree when the coincidence degree is lower than a preset first threshold value;

The prompting module 400 is configured to prompt the user of the moving direction.

On the basis of the above embodiments, the photographing apparatus provided by the present invention may further include:

The screen shot mode entry module is configured to receive an instruction input by the user to enter a screen shot mode before the display pixel array acquisition module acquires the display pixel array of the current screen to be photographed; or when detecting a moiré phenomenon on the photographed screen When you enter the screen shot mode.

As a specific implementation manner, the display pixel array acquiring module is specifically:

Determining, by the model of the current screen to be shot, a module of the display pixel array corresponding to the model;

Or receiving an instruction input by the user for selecting a size and a resolution of the current to-be-shot screen, and determining a module of the display pixel array according to the size and the resolution;

Or determining a module of the display pixel array by using a moiré generated by interference on a picture of the current to-be-shot screen captured at different angles and a known sampling pixel array.

As a specific implementation manner, the coincidence calculation module is specifically:

Calculating a first ratio of all pixel points in the sampled pixel array falling on the display pixel array as the module of the coincidence degree;

Or calculating a second ratio of all pixel points in the display pixel array falling on the sampling pixel array as the module of the coincidence degree;

Or using the weighting value of the first ratio and the second ratio as a module of the coincidence degree.

As a specific implementation manner, the moving direction calculation module is specifically:

Calculating the coincidence degree after the predetermined plurality of directions is assumed to be moved, and selecting the calculated direction with the highest degree of coincidence as the module of the moving direction;

Or calculating a rate of change of the coincidence degree during the movement of the photographing apparatus, and selecting a moving direction of a point having the largest forward rate of change as a module of the moving direction.

As a specific implementation manner, the prompting module is specifically:

A module that prompts the user by means of arrows, directions, screen tilts, or voices.

The photographing apparatus provided by the present invention may further include:

The photographing module is configured to: after the prompting module prompts the user of the moving direction, when the preset shooting condition is met, the current to-be-shot screen is photographed.

The shooting module may be specifically:

Receiving a shooting instruction input by a user, and performing a module for capturing the current screen to be shot;

Or prompting the user to the optimal shooting prompt information when the degree of coincidence exceeds a preset second threshold Or automatically capture the module of the current screen to be shot.

The shooting module is specifically:

A module that prompts by text, sound, screen flicker, shooting button color switching, or shooting button color blinking.

The photographing device provided by the present invention detects the coincidence degree of the display pixel array of the screen and the sampling pixel array of the camera sensor in real time, and guides the user to gradually increase the coincidence degree of the two pixel arrays, so that the two arrays tend to overlap as much as possible, weakening Interference between the two arrays can significantly reduce or even eliminate moiré, allowing users to quickly and easily obtain high-definition screen shots.

Referring to FIG. 9 , FIG. 9 is a schematic diagram of a photographing apparatus 1 according to an embodiment of the present invention. The photographing apparatus 1 may include a processor 11 , a memory 12 , and a display 13 . The processor 11 , the memory 12 , and the display 13 communicate through the communication bus 14 .

The memory 12 is configured to store program code.

After the processor 11 is configured to read the program code stored in the memory 12, the following is performed: acquiring a display pixel array of the current screen to be captured; calculating a coincidence degree of the display pixel array and the sampling pixel array of the photographing device. And when the degree of coincidence is lower than a preset first threshold, calculating a moving direction of the photographing device that increases the coincidence degree; prompting the user of the moving direction.

The display 13 is configured to receive a display instruction of the processor 11 to display the moving direction.

In some embodiments of the present invention, the processor 11 calls the code stored in the memory 12 via the bus 14 to further receive: an instruction input by the user to enter the screen shooting mode; or when detecting a moiré phenomenon on the shooting picture , enter the screen shooting mode.

In some embodiments of the present invention, in the above aspect of acquiring the display pixel array of the current screen to be shot, the processor 11 calls the code stored in the memory 12 via the bus 14 to specifically: by identifying the current screen to be shot. a model, determining the display pixel array corresponding to the model; or receiving a user input instruction for selecting a size and a resolution of the current to-be-shot screen, determining the display pixel array according to the size and the resolution Or determining the display pixel array by using a moiré generated by interference on a picture of the current to-be-shot screen taken at different angles and a known sampling pixel array.

In some embodiments of the present invention, the sampling of the display pixel array and the photographing device is calculated in the above manner. In terms of the degree of coincidence of the pixel array, the processor 11 calls the code stored in the memory 12 via the bus 14 to specifically: calculate the calculated total pixel points of the sampled pixel array on the display pixel array. a ratio as the degree of coincidence; or a calculated second ratio of all pixel points in the display pixel array falling on the sampled pixel array as the coincidence degree; or the first ratio and the first ratio The weighting value of the second ratio is taken as the degree of coincidence.

In some embodiments of the present invention, the processor 11 calls the code stored in the memory 12 via the bus 14 to specifically: for the preset, in terms of calculating the moving direction of the photographing device in which the degree of coincidence is increased. The plurality of directions are assumed to calculate the coincidence degree after the movement, and the direction with the highest degree of coincidence is selected as the moving direction; or the rate of change of the coincidence degree is calculated during the movement of the photographing device, and the direction with the highest positive change rate is selected. The moving direction of the point serves as the moving direction.

In some embodiments of the present invention, in the above-described manner of prompting the user to include the direction of movement, the processor 11 sends a display instruction to the display 13 via the bus 14 for specifically: by arrow, direction, screen tilt or voice. Prompt to the user.

In some embodiments of the present invention, the processor 11 calls the code stored in the memory 12 via the bus 14 to further: after the user is prompted by the moving direction, when the preset shooting condition is met, The current screen to be shot is taken.

In some embodiments of the present invention, the processor 11 calls the code stored in the memory 12 via the bus 14 to specifically receive: in the aspect of capturing the current to-be-shot screen when the preset shooting condition is met. a photographing instruction input by the user, photographing the current screen to be photographed; or when the degree of coincidence exceeds a preset second threshold, prompting the user to the optimal photographing prompt information or automatically photographing the current screen to be photographed.

In some embodiments of the present invention, in the aspect of photographing the current to-be-shot screen when the preset shooting condition is satisfied, the processor 11 sends a display instruction to the display 13 via the bus 14 to specifically: through the text. Prompt for sound, screen flicker, shooting button color switching, or flashing of the shooting button color.

It is to be understood that the functions of the functional modules of the photographic device 1 of the present embodiment may be specifically implemented according to the method in the foregoing method embodiments. For the specific implementation process, reference may be made to the related description of the foregoing method embodiments, and details are not described herein again.

The photographing device provided by the present application detects the display pixel array of the screen and the camera through real time The coincidence of the sampling pixel array of the sensor, and guide the user to gradually increase the coincidence degree of the two pixel arrays, so that the two arrays tend to overlap as much as possible, weakening the interference when the two arrays overlap, and the moiré can be significantly reduced or even eliminated. This makes it easy and quick for users to get high-definition screen shots.

Referring to FIG. 10, FIG. 10 is a structural block diagram of a photographing apparatus 2 according to another embodiment of the present invention. The photographing device 2 may include at least one processor 21, at least one network interface 22 or other user interface 23, a memory 24, a display 25, a camera 26, at least one communication bus 27, and an image sensor 28. Communication bus 27 is used to implement connection communication between these components.

The memory 24 can include read only memory and random access memory and provides instructions and data to the processor 21. A portion of memory 24 may also include non-volatile random access memory (NVRAM).

In some embodiments, memory 24 stores the following elements, executable modules or data structures, or a subset thereof, or their extended set:

The operating system 241 includes various system programs for implementing various basic services and processing hardware-based tasks.

The application module 242, which includes various applications, is configured to implement various application services.

The application module 242 includes, but is not limited to, a display pixel array acquisition module 100, a coincidence degree calculation module 200, a movement direction calculation module 300, and/or a prompt module 400, and the like.

In some embodiments of the present invention, the processor 21 is further configured to: receive an instruction input by the user to enter a screen shooting mode by calling a program or an instruction stored in the memory 24; or when detecting a moiré phenomenon in the shooting image, Enter the screen shot mode.

In some embodiments of the present invention, in the above-mentioned aspect of acquiring the display pixel array of the current screen to be shot, by calling a program or instruction stored in the memory 24, the processor 21 is specifically configured to: identify the model of the current screen to be shot by Determining the display pixel array corresponding to the model; or receiving an instruction input by the user to select a size and a resolution of the current to-be-shot screen, and determining the display pixel array according to the size and the resolution; The display pixel array is determined by a moiré generated by interference on a picture of the current to-be-shot screen captured at different angles and a known sampled pixel array.

In some embodiments of the present invention, calculating the display pixel array and the photographing device in the above manner In the aspect of the degree of coincidence of the pixel array, the processor 21 is specifically configured to: calculate the first pixel point of the calculated pixel array on the display pixel array by calling the program or instruction stored in the memory 24 a ratio as the degree of coincidence; or a calculated second ratio of all pixels in the display pixel array falling on the sampled pixel array as the coincidence degree; or the first ratio and the first The weighting value of the two ratios is taken as the degree of coincidence.

In some embodiments of the present invention, the processor 21 is specifically configured to: preset a plurality of presets by calling a program or instruction stored in the memory 24 in terms of calculating the moving direction of the photographing device in which the degree of coincidence is increased. The direction is calculated by calculating the coincidence degree after the movement, and the direction with the highest degree of coincidence is selected as the moving direction; or the rate of change of the coincidence degree is calculated during the movement of the photographing device, and the point with the largest forward rate of change is selected. The moving direction is taken as the moving direction.

In some embodiments of the present invention, in the above-described aspect of prompting the user to include the direction of movement, the processor 21 transmits a display instruction to the display 25 via the bus 27 for specifically: by arrow, direction, screen tilt or voice. Prompt to the user.

In some embodiments of the present invention, by calling a program or instruction stored in the memory 24, the processor 21 is further configured to: after the prompting the moving direction to the user, when the preset shooting condition is met, the current waiting Shoot the screen to shoot.

In some embodiments of the present invention, the processor 21 is specifically configured to: receive user input by calling a program or instruction stored in the memory 24 in the aspect of capturing the current to-be-shot screen when the preset shooting condition is satisfied. a shooting instruction to capture the current to-be-shot screen; or when the degree of coincidence exceeds a preset second threshold, prompting the user to the optimal shooting prompt information or automatically capturing the current to-be-shot screen.

In some embodiments of the present invention, in the above aspect of capturing the current to-be-shot screen when the preset shooting condition is satisfied, the processor 21 sends a display instruction to the display 25 via the bus 27 to specifically use: Prompt for sound, screen flicker, shooting button color switching, or flashing of the shooting button color.

It is to be understood that the functions of the functional modules of the photographic device 2 of the present embodiment may be specifically implemented according to the method in the foregoing method embodiments. For the specific implementation process, refer to the related description of the foregoing method embodiments, and details are not described herein again.

Specifically, the photographing device may be a terminal device such as a mobile phone or a tablet or a camera.

The photographing device provided by the present application detects the coincidence degree of the display pixel array of the screen and the sampling pixel array of the camera sensor in real time, and guides the user to gradually increase the coincidence degree of the two pixel arrays, so that the two arrays tend to overlap as much as possible, weakening two Interference with array overlap can significantly reduce or even eliminate moiré, allowing users to quickly and easily obtain high-definition screen shots.

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts of the respective embodiments may be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

A person skilled in the art will further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate the hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented directly in hardware, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

The photographing method, apparatus, and apparatus provided by the present invention have been described in detail above. The principles and embodiments of the present invention have been described herein with reference to specific examples, and the description of the above embodiments is only to assist in understanding the method of the present invention and its core idea. It should be noted that those skilled in the art can make various modifications and changes to the present invention without departing from the spirit and scope of the invention.

Claims

A photographing method, comprising:

Obtaining a display pixel array of a current screen to be photographed;

Calculating a degree of coincidence of the display pixel array and the sampling pixel array of the photographing device;

When the degree of coincidence is lower than a preset first threshold, calculating a moving direction of the photographing device that increases the coincidence degree;

The user is prompted for the direction of movement.
The photographing method according to claim 1, further comprising: before the acquiring the display pixel array of the current screen to be photographed:

Receiving an instruction input by the user to enter a screen shooting mode;

Or when the moiré phenomenon is detected on the shooting screen, enter the screen shooting mode.
The photographing method of claim 2, wherein the obtaining a display pixel array of the current screen to be photographed comprises:

Determining, by identifying a model of the current screen to be shot, the display pixel array corresponding to the model;

Or receiving an instruction input by the user to select a size and a resolution of the current to-be-shot screen, and determining the display pixel array according to the size and the resolution;

The display pixel array is determined by a moiré generated by interference on a picture of the current to-be-shot screen captured at different angles and a known sampled pixel array.
The photographing method according to any one of claims 1 to 3, wherein the calculating the degree of coincidence of the display pixel array and the sampling pixel array of the photographing device comprises:

Calculating a first ratio of all pixel points in the sampled pixel array on the display pixel array as the coincidence degree;

Or calculating a second ratio of all pixel points in the display pixel array falling on the sampling pixel array as the coincidence degree;

Or using the weighting value of the first ratio and the second ratio as the coincidence degree.
The photographing method according to claim 1, wherein the moving direction of the photographing device calculated to increase the coincidence degree comprises:

Calculate the coincidence degree after assuming multiple movements in a preset direction, and select the calculated coincidence degree to be the highest. The direction of the movement as the direction of movement;

Or calculating a rate of change of the coincidence degree during the movement of the photographing apparatus, and selecting a moving direction of a point having the largest forward change rate as the moving direction.
The photographing method according to claim 5, wherein the prompting the user of the moving direction comprises:

The user is prompted by an arrow, a direction, a screen tilt, or a voice.
The photographing method according to claim 5, further comprising: after the prompting the moving direction to the user:

When the preset shooting condition is satisfied, the current to-be-shot screen is photographed.
The photographing method according to claim 7, wherein the photographing the current to-be-shot screen when the preset photographing condition is satisfied comprises:

Receiving a shooting instruction input by the user, and taking a picture of the current to-be-shot screen;

Or when the degree of coincidence exceeds a preset second threshold, prompting the user to the optimal shooting prompt information or automatically capturing the current to-be-shot screen.
The photographing method according to claim 8, wherein the prompting the optimal photographing prompt information to the user comprises:

Prompt by text, sound, screen flicker, shooting button color switching, or shooting button color flashing.
A photographing device, comprising:

a display pixel array acquisition module configured to acquire a display pixel array of a current screen to be captured;

a coincidence calculation module, configured to calculate a coincidence degree between the display pixel array and a sampling pixel array of the photographing device;

a moving direction calculation module, configured to calculate a moving direction of the photographing device that increases the coincidence degree when the coincidence degree is lower than a preset first threshold value;

The prompting module is configured to prompt the user of the moving direction.
The photographing apparatus according to claim 10, further comprising:

The screen shot mode entry module is configured to receive an instruction input by the user to enter a screen shot mode before the display pixel array acquisition module acquires the display pixel array of the current screen to be photographed; or when detecting a moiré phenomenon on the photographed screen When you enter the screen shot mode.
The photographing device of claim 11, wherein the display pixel array acquisition module is specifically:

Determining, by the model of the current screen to be shot, a module of the display pixel array corresponding to the model;

Or receiving an instruction input by the user for selecting a size and a resolution of the current to-be-shot screen, and determining a module of the display pixel array according to the size and the resolution;

Or determining a module of the display pixel array by using a moiré generated by interference on a picture of the current to-be-shot screen captured at different angles and a known sampling pixel array.
The photographing apparatus according to any one of claims 10 to 12, wherein the coincidence degree calculation module is specifically:

Calculating a first ratio of all pixel points in the sampled pixel array falling on the display pixel array as the module of the coincidence degree;

Or calculating a second ratio of all pixel points in the display pixel array falling on the sampling pixel array as the module of the coincidence degree;

Or using the weighting value of the first ratio and the second ratio as a module of the coincidence degree.
The photographing apparatus according to claim 10, wherein the moving direction calculation module is specifically:

Calculating the coincidence degree after the predetermined plurality of directions is assumed to be moved, and selecting the calculated direction with the highest degree of coincidence as the module of the moving direction;

Or calculating a rate of change of the coincidence degree during the movement of the photographing apparatus, and selecting a moving direction of a point having the largest forward rate of change as a module of the moving direction.
The photographing apparatus according to claim 14, wherein the prompting module is specifically:

A module that prompts the user by means of arrows, directions, screen tilts, or voices.
The photographing apparatus according to claim 14, further comprising:

The photographing module is configured to: after the prompting module prompts the user of the moving direction, when the preset shooting condition is met, the current to-be-shot screen is photographed.
The photographing apparatus according to claim 16, wherein the photographing module is specifically:

Receiving a shooting instruction input by a user, and performing a module for capturing the current screen to be shot;

Or prompting the user to the optimal shooting prompt information when the degree of coincidence exceeds a preset second threshold Or automatically capture the module of the current screen to be shot.
The photographing apparatus according to claim 17, wherein the photographing module is specifically:

A module that prompts by text, sound, screen flicker, shooting button color switching, or shooting button color blinking.