TWI739052B - Electronic device and operating method thereof - Google Patents

Abstract

An electronic device includes a display interface, a memory and a processor. The display interface includes a first display area and a second display area. The memory has instructions stored therein. The processor is configured to load the instructions to perform the following operations: accessing an image record, in which the image record contain a plurality of raw images; concurrently displaying raw images, according to an original scale, in the first and second display area; detecting a first object in the image record; in response to the first object being detected in the image record, displaying a zoom-in image focused on the first object according to a magnification scale in the second display area and displaying the raw image corresponding to the zoom-in image in the first display area, in which the magnification scale is larger than the original scale.

Description

Electronic device and its operation method

This case involves an electronic device and its operation method.

Some commercially available webcams have a motion detection function. If the webcam detects movement in the target area, it can be set to trigger certain actions, such as sending push notifications or recording videos. However, the video recording of commercially available webcams does not have additional processing or marking functions. Therefore, when viewing the video files, users must observe the changes of the images with the naked eye. What's more, if the user uses a mobile device, it is relatively A small screen will result in a poor user experience.

An embodiment of this case relates to an electronic device, which includes a display interface, a memory, and a processor. The display interface includes a first display area and a second display area. The memory stores at least one command. The processor is coupled to the memory, and after loading the at least one program instruction, the processor executes the following steps: accessing an image log file, the image log file having a plurality of original frames; and simultaneously in accordance with an original display magnification The first display area and the second The display area displays the original images; detects whether there is a first object in the image log file; when the first object is detected in the image log file, in the second display area according to a first magnification Displaying an enlarged picture containing the first object, and displaying an original picture corresponding to the enlarged picture in the first display area according to the original display magnification, wherein the first magnification is greater than the original display magnification.

Another embodiment of this case relates to an operation method. Applied to an electronic device, the electronic device has a first display area and a second display area. The operation method includes: accessing an image log file, the image log file having a plurality of original frames; simultaneously displaying the original frames in the first display area and the second display area according to an original display magnification; detecting the image record Whether there is a first object in the file; when the first object is detected in the image log file, an enlarged screen containing the first object is displayed in the second display area according to a first magnification, and according to The original display magnification displays the original picture corresponding to the enlarged picture in the first display area, wherein the first magnification is greater than the original display magnification.

According to the foregoing embodiment, the electronic device and the electronic device operating method of this application can simultaneously display the image of the target area in the first and second display areas, and automatically track the moving objects in the image log file, and then use the appropriate magnification on the second display area. Displaying images of moving objects in the display area is an effective and intuitive technique.

100: electronic device

120: display interface

121: The first display area

122: second display area

140: memory

160: processor

200: How to operate electronic devices

S201~S206, S2041~S2042: steps

CA1: first range

CA2: second range

CA3: Third range

LP1~LP3: upper left corner point

RP1~RP3: bottom right corner point

CP1~CP3: center point

TF1: The first tracking frame

TF2: The second tracking frame

TF3: The third tracking frame

TDF: Tracking display frame

A1~A7: Endpoint

B1~B6: End point

DIST1, DIST3: horizontal distance

DIST2, DIST4: vertical distance

VF: Virtual box

Figure 1 is a schematic diagram of an electronic device drawn according to some embodiments of this case; Figure 2 is a flowchart of an electronic device operation method drawn according to some embodiments of this case; Figure 3 is drawn based on some embodiments of this case Figure 4 is a schematic diagram of the object detection scenario drawn according to some embodiments of this project; Figure 5 is a schematic diagram of the display interface drawn according to some embodiments of this project; Figure 6A is based on A schematic diagram of the smoothing calculation procedure drawn in some embodiments of this case; Figure 6B is a schematic diagram of the smoothing calculation procedure drawn according to some embodiments of this case; Figure 7 is a schematic diagram of the electronic device operation method drawn according to some embodiments of this case Figure 8 is a schematic diagram of the judgment calculation procedure drawn according to some embodiments of this case; Figure 9 is a schematic diagram of the judgment calculation procedure drawn according to some embodiments of this case; The schematic diagram of the display interface shown in the embodiment.

Regarding the "first", "second", etc. used in this article, they do not specifically refer to the order or sequence, nor are they used to limit the case. They are only used to distinguish elements or operations described in the same technical terms. .

Regarding the "coupling" or "connection" used in this text, it can mean that two or more components or devices are in direct physical contact with each other, or indirectly in physical contact with each other, or two or more components or devices are in mutual physical contact with each other. Operation or action.

Please refer to Figure 1. FIG. 1 is a schematic diagram of an electronic device according to some embodiments of the present application. In an embodiment of the present case, the electronic device 100 includes a display interface 120, a memory 140, and a processor 160. In some embodiments, the electronic device 100 can be a smart phone, a tablet computer, or a notebook computer, but it is not limited thereto. In some embodiments, the processor 160 may include, but is not limited to, a single processing unit or the integration of a plurality of microprocessors. The single processing unit or the integration of the microprocessors may be electrically coupled to the memory 140, wherein the memory 140 may be It is internal or external memory, including volatile or non-volatile memory. In this embodiment, the processor 160 can access at least one instruction from the memory 140 and execute the at least one instruction, so as to further implement the application program defined by the at least one instruction. To facilitate understanding, the procedure defined by the at least one instruction will be described in detail in the following paragraphs. In some embodiments, the processor 160 may be implemented by an application-specific integrated circuit. The foregoing implementation of the processor 160 is used as an example, and various hardware elements such as circuits or modules that can implement the processor 160 are all within the scope of the present application.

In some embodiments, in addition to storing the at least one instruction, the memory 140 can also store (or temporarily store) the processor 160 to execute the application program. Data and data generated after the processor 160 executes the application program are stored (or temporarily stored).

In some embodiments, the display interface 120 may be a hardware component of the electronic device 100. For example, the display interface 120 may be a liquid crystal display (Liquid Crystal Display) or an organic light-emitting diode display (Organic Light-Emitting Diode) of the electronic device 100. Diode Display). In some embodiments, the display interface 120 may include software components in the electronic device 100. For example, the display interface 120 may include an application program interface displayed through the display of the electronic device 100 to provide users with images or provide interaction with the electronic device 100. The function.

In the foregoing embodiment, the electronic device 100 may be a smart phone, a tablet computer, or a notebook computer, but it is only for illustration and not for limiting the present case. It should be understood that the electronic device 100 of the present application can be implemented by other feasible system architectures. For example, in one embodiment, the memory 140 and the processor 160 in the electronic device 100 are disposed in a remote server (not shown in the figure), and the remote server is communicatively coupled to a mobile device (in the figure) (Not shown), the display interface 120 can be a hardware component or a software component in the mobile device. With this system architecture, the processor 160 in the remote server can load the at least one program instruction to execute the operation method of the present case, and transmit the execution result to the display interface 120 for display. In this way, the electronic device 100 of the present application can still fully implement its functions.

The various implementations of the electronic device 100 described above are used as examples, and various other hardware and software components that can perform the same functions or operations are also covered by the present application.

Please refer to Figure 2. In an embodiment of this case, the operation method 200 It can be executed by the electronic device 100 as shown in FIG. 1, so the embodiment in FIG. 1 can also be referred to. In detail, the electronic device 100 loads the aforementioned program instructions to execute the operation method 200. The program instructions are stored in a non-volatile computer-readable medium (for example, the memory 140). In this embodiment, the steps included in the operation method 200 will be described in detail in the following paragraphs.

Step S201: Access an image log file, the image log file having a plurality of original frames.

Please refer to FIG. 1 and FIG. 2 together. In some embodiments, the processor 160 in the electronic device 100 can access at least one image record in a target area from one or more storage devices (such as the memory 140) File, this image record file has a time length and a plurality of original frames (Original Frames). The target area can be an indoor area or an outdoor area. In one embodiment, the image record file of the target area is captured by a web camera installed in a hotel lobby, and the time length of the image record file is five hours. In detail, during the five hours, the directional network camera installed in the lobby of the hotel continued to capture optical signals from the lobby of the hotel, and the captured optical signals passed through the Digital Signal Processor (DSP) ) After encoding in a specific format, the image log file is generated.

Step S202: Simultaneously display the original picture in the first display area and the second display area of the display interface according to the original display magnification.

Please refer to FIG. 1 and FIG. 2 together. In some embodiments, the processor 160 in the electronic device 100 can display the original image of the image log file on the display interface 120.

For a better understanding, please refer to Figure 3 of this case together, in In some embodiments, the display interface 120 includes a first display area 121 and a second display area 122 having substantially the same size, and the first display area 121 and the second display area 122 are substantially side by side on the display interface 120.

In one embodiment, the processor 160 of the electronic device 100 can execute a decoding application corresponding to the aforementioned specific format to read the image log file, and display the original image of the image log file on the display interface 120.

As shown in FIG. 3, in the first display area 121 and the second display area 122 of the display interface 120, the same original picture is presented at the original display magnification. It should be understood that the original display magnification referred to in this embodiment is the panoramic magnification, and the panoramic magnification is the magnification of the aforementioned directional webcam for image capture with the shortest focal length, which is the smallest that can be adjusted by the aforementioned directional webcam Magnification (for example, the magnification can be expressed as 1x). With this shortest focal length, the aforementioned directional webcam can capture a wide range of original images in a target area (for example, a hotel lobby).

In other embodiments of this case, the original display magnification can be adjusted as required. In some embodiments, the original display magnification can also be a value between the longest focal length and the shortest focal length among the adjustable focal lengths of the directional webcam.

Step S203: Detect whether there is a first object in the image log file.

Please refer to FIG. 1 and FIG. 2 together. In some embodiments, the processor 160 of the electronic device 100 has an Object Detection application. After the processor 160 accesses the image log file, the processor 160 At least one image record can be read by this object tracking application Record the original screen in the file for object detection. In some embodiments, after the processor 160 accesses the image log file, it continuously monitors the pixel values of the original frames in the image log file, and based on the pixel values between adjacent original frames in the image log file. Value changes to detect objects. In one embodiment, the “adjacent” referred to herein may refer to the adjacent relationship of the original pictures based on time shift. In some embodiments, the object that the processor 160 mainly tracks is a person's face. In other embodiments, the processor 160 can also be used to track non-personal objects.

It should be understood that since this image record file is captured by a directional webcam, the background environment of the hotel lobby should not change too much or frequently during the entire length of the image record file. There are large amplitude (or range) and continuous pixel changes between adjacent original images of the file, and it can be judged that this pixel change may correspond to the movement of an object.

For a better understanding, please also refer to Figure 4 of this case, which is a schematic diagram of an object detection scenario drawn according to some embodiments of this case. In one embodiment, the processor 160 detects a large pixel change in a plurality of adjacent original frames in the image record file, and applies the large pixel change area to a face. Recognition to define a first range CA1 (as shown in FIG. 4) containing a human face, and the processor 160 determines that this first range CA1 corresponds to a first object. In this embodiment, the first object is The face of the first person. In detail, if all the pixel points corresponding to each original frame (ie, each frame) in the at least one image record file are understood as a plane coordinate system, in the above-mentioned embodiment, the processor 160 can be positioned on this plane The pixel change of the first range CA1 is detected on the right side of the coordinate system. As shown in FIG. 4, the processor 160 can mark an upper left point LP1 at a punctuation in the upper left corner of the first range CA1, and set it to the right of the first range CA1. A punctuation in the lower corner marks a point RP1 in the lower right corner. The upper left corner point LP1 and the lower right corner point RP1 can plan a rectangular first tracking frame TF1, and the first tracking frame TF1 is used to track the pixel change in the first range CA1. In addition, according to the upper left corner point LP1 and the lower right corner point RP1, the center point CP1 of the first tracking frame TF1 can be marked.

Step S204: When the first object is detected in the image record file, display an enlarged screen containing the first object in the second display area according to the first magnification, and display the magnification in the first display area according to the original display magnification The original picture corresponding to the picture.

Please refer to FIG. 1 and FIG. 2 together. In some embodiments, when the processor 160 in the electronic device 100 determines that there is a movement of an object in the image record file, the processor 160 can display an enlarged screen corresponding to the object In the second display area 122 of the display interface 120.

For a better understanding, please also refer to Figure 5 of this case, which is a schematic diagram of the display interface drawn according to some embodiments of this case. As shown in Figure 5, in some embodiments, when the processor 160 detects a pixel change in the first range CA1 as shown in Figure 4 in the continuous original frame, the processor 160 may follow the first The magnification ratio displays the magnified screen including the first object in the second display area 122. In detail, in one embodiment, the processor 160 may be centered on the first tracking frame TF1 shown in FIG. 4, and extend a certain distance outwards according to the first magnification to select the frame with the first object in the frame. The area is used as the tracking display frame TDF, and the image in the tracking display frame TDF is enlarged to an enlarged screen and displayed in the second display area 122, as shown in FIG. 5.

In some embodiments, when the processor 160 is based on the first zoom When the magnified image of the first object is displayed in the second display area 122 at a certain time, the processor 160 still displays the original image of the same time in the first display area 121 according to the original display magnification. In some embodiments, the processor 160 further marks the position of the tracking display frame TDF in the image of the hotel lobby displayed in the first display area 121. For example, the processor 160 may display the tracking display in the first display area 121 with a red rectangle. Box TDF. In this way, the electronic device 100 can use the first display area 121 and the second display area 122 of the display interface 120 to achieve a comparison effect of panoramic view and partial magnification, so as to facilitate the user to view the image of the hotel lobby.

As mentioned above, in some embodiments, the original display magnification refers to the magnification at which the directional webcam performs image capture at the shortest focal length, that is, the minimum magnification (for example, the magnification corresponding to the original display magnification can be expressed as 1 times). Therefore, in this embodiment, the first magnification should be greater than the original display magnification, for example, the first magnification can be expressed as 2.2 times. It should be understood that, in the foregoing embodiments, the values of the original display magnification and the first magnification are only for explanation and not for limiting the case. According to the needs of the user or the system, the original display magnification and the first magnification can be Other values are implemented. For example, in some embodiments, after the processor 160 confirms the size of the first tracking frame TF1, the processor 160 may determine the tracking display frame according to the ratio of the size of the first tracking frame TF1 to the size of the overall target area (ie, the hotel lobby) With the size of TDF, the image in the first tracking frame TF1 is displayed on the second display area 122.

In some embodiments, when the processor 160 detects a pixel change in the first range CA1 at a certain point in time in the at least one image log file, and determines that the first range CA1 corresponds to the first object, the processor 160 processes 160 will be earlier than that The time point in the second display area 122 is gradually switched from the original display magnification to the first magnification to display the image around the first object. For example, if the processor 160 detects a pixel change in the first range CA1 at the 10th minute and 10th second in the at least one image log file, in the second display area 122, the processor 160 can perform the pixel change at the 10th minute and 9th minute. Switching linearly from 1x magnification to 2.2x magnification between the second to the 10th minute and the 10th second. Through this progressive magnification process, a zoom effect similar to that of a camera lens can be produced, avoiding too abrupt images beat. It should be understood that the above-mentioned values are not used to limit this case. According to the needs of users or the system, this progressive amplification procedure can also be implemented based on other feasible values.

Step S205: Track the movement trajectory of the first object in the image record file, and smooth the movement trajectory to adjust the zoomed-in image.

As mentioned above, in some embodiments, after the processor 160 accesses the at least one image log file, it can continuously monitor the pixel values of the at least one image log file for the entire time length to detect the object. As shown in the embodiment in FIG. 4, when the processor 160 detects the pixel change in the first area CA1 at the edge of the hotel lobby, the processor 160 can determine that the first area CA1 corresponds to the first object. In some embodiments, the processor 160 will continuously monitor the pixel change in the first range CA1 according to a specific time interval (for example, 10 milliseconds) until the pixel change in the first range CA1 leaves the target area (ie, the hotel lobby) Among them, by this, the processor 160 can track the movement trajectory of the first object in the target area. It should be understood that this time interval can be implemented based on other feasible values according to the needs of the user or the system.

For example, in some embodiments, among the at least one image log file, the processor 160 starts to detect the corresponding image in the original frame at the first time point. The pixel change in the first range CA1 is changed, and the processor 160 no longer detects the pixel change corresponding to the first range CA1 in the original frame at the second time point. That is, the first object moves in the target area in the interval between the first time point and the second time point. In this embodiment, the processor may progressively enlarge the partial image of the region that is about to appear in the first range CA1 in the second display area 122 before the first time point. From the first time point, the processor 160 displays the enlarged image of the first area CA1 and its surrounding area in the second display area 122 according to the first magnification. Between the first time point and the second time point, the processor 160 calculates the center point CP1 of the first tracking frame TF1 corresponding to the coordinate position of the original frame according to a specific time interval (for example, every 10 milliseconds), and continuously records this center The movement of point CP1 between two time points. In this way, the processor 160 can track the movement trajectory of the first object in the target area, and display the movement trajectory in the second display area 122.

However, during the movement of the first object corresponding to the first range CA1, its relative position in the original picture may be accompanied by varying degrees of height changes (for example, the ups and downs relative to the ground when a person is walking). Directly presenting the trajectory of the first object in the second display area 122 in the zoomed-in image may produce a sudden sense of image bounce. Therefore, in some embodiments, the processor 160 in the electronic device 100 has a trajectory smoothing application, which can be used to smooth the movement trajectory of the object. For example, in some embodiments, the processor 160 may calculate and record the center point CP1 of the first tracking frame TF1 corresponding to the multiple coordinate position of the original frame according to a specific time interval. The processor 160 may further process the coordinate position corresponding to the center point CP1 using a polyline smoothing algorithm.

For a better understanding, please refer to Section 6A and Section 6 of this case together Fig. 6B is a schematic diagram of the smoothing calculation procedure drawn according to some embodiments of this case. As shown in Figure 6A, in some embodiments, the endpoints A1 to A7 indicate that the center point CP1 of the first tracking frame TF1 corresponds to the coordinate position of the original frame at seven consecutive time points. This continuous endpoint The trajectory formed by the connection of A1~A7 will have a certain degree of ups and downs. As shown in Fig. 6B, in some embodiments, the processor 160 may select consecutive end points among the end points A1 to A7 as shown in Fig. 6A, and calculate the midpoint of each end point (as shown in Fig. 6A). The end points B1~B6 shown in ), and then further connect the midpoints of each end point to form a new track. In this way, the processor 160 can smooth the movement track of the first object. In this embodiment, between the first time point and the second time point, the processor 160 may display the smoothed movement track of the first object in the second display area 122 according to the zoomed-in image at the first magnification. , Which can optimize the lens movement effect, thereby enhancing the user experience.

It should be understood that the foregoing embodiments are not intended to limit the present case, and the smoothing calculation procedure executed by the processor 160 may be implemented according to other smoothing techniques. In addition, the processor 160 can also execute the smoothing algorithm multiple times to obtain a better smooth movement trajectory. For example, in some embodiments, the processor 160 may re-implement the polyline smoothing algorithm on the endpoints B1 to B6 as shown in FIG. 6B, so that a new movement trajectory composed of five endpoints can be generated.

Step S206: When the first object is no longer detected in the image record file, gradually reduce the enlarged screen displayed according to the first magnification in the second display area to the original screen displayed according to the original display magnification.

As mentioned above, in some embodiments, the processor 160 can continuously monitor the pixel values of the at least one image record file in the entire time length. To track objects. As shown in the embodiments in FIGS. 4 and 5, the first object moves in the target area during the interval from the first time point to the second time point, and the processor 160 is no longer in the original frame at the second time point The pixel change corresponding to the first range CA1 is detected. In this embodiment, at the second time point, the processor 160 still displays the image of the first area CA1 and its surroundings (ie the image within the tracking display frame TDF) in the second display area 122 according to the first magnification. . From the next time point of the second time point, the processor 160 can gradually switch from the first magnification to the original display magnification in the second display area 122 to display the original image of the entire target area, thereby avoiding unexpected The screen jumps. It should be understood that, in some embodiments, from the first range CA1 corresponding to the first object appearing to disappearing in the target area, the processor 160 may follow the movement track of the center point CP1 of the first tracking frame TF1 to perform the The original frame of a display area 121 correspondingly displays the movement of the tracking display frame TDF.

Please refer to FIG. 7. In some embodiments, the operation method 200 may further include step 2041 and step 2042 after step 204.

Step S2041: When the second object is detected in the image log file, it is determined whether the distance between the second object and the first object is greater than a predetermined threshold.

It should be understood that, in some embodiments, the original picture in the target area (for example, a hotel lobby) may have more than one range of pixel changes, and this situation may indicate that there are more than two moving objects in the target area. In this situation, the processor 160 can execute a judgment algorithm to judge whether the aforementioned pixel change does represent more than two moving objects in the target area. For example, in one embodiment, if the processor 160 detects that there are more than two pixel changes in the original frame at the same time point, the processor 160 may calculate the aforementioned The relative distance of the pixel change in the original picture, and determine whether the distance exceeds a preset threshold (Threshold), and then determine whether it represents more than two moving objects in the target area.

For a better understanding, please also refer to Figure 8 of this case, which is a schematic diagram of the judgment calculation procedure drawn according to some embodiments of this case. It should be understood that Figure 8 of this case is related to Figure 4, so please refer to Figure 4 together. Based on the foregoing, as described in the embodiment in Figure 4, at the first time point in this time length, the processor 160 judges that there is a large pixel change at the edge of the hotel lobby based on the original picture, and the processor 160 judges this The first range CA1 corresponds to the first object. Therefore, the processor 160 obtains the upper left corner point LP1 and the lower right corner point RP1, thereby generating the first tracking frame TF1 to track the pixel change of the first range CA1. As shown in FIG. 8, at the third time point (later than the first time point) in this time length, the processor 160 detects another pixel change in the original frame adjacent to the first range CA1. One pixel change corresponds to the second range CA2. In this embodiment, the second range CA2 corresponds to the hand of the first person. Similar to the embodiment in FIG. 4, corresponding to the second range CA2, the processor 160 will obtain the upper left corner point LP2 and the lower right corner point RP2, thereby generating a second tracking frame TF2 to track the pixel change of the second range CA2. Similarly, according to the upper left corner point LP2 and the lower right corner point RP2, the processor 160 can obtain the center point CP2 of the second tracking frame TF2.

In this embodiment, the processor 160 can execute a judgment algorithm to calculate the horizontal distance DIST1 and the vertical distance DIST2 between the center point CP1 of the first tracking frame TF1 and the center point CP2 of the second tracking frame TF2 in the original picture.

In some embodiments, the processor 160 may determine the horizontal distance Whether at least one of DIST1 and vertical distance DIST2 is greater than a preset threshold. In some embodiments, the eight corner points of the first tracking frame TF1 and the second tracking frame TF2 can form a larger virtual frame VF, and the preset threshold corresponding to the horizontal distance can be set to half the width of the virtual frame VF. , Or the preset threshold corresponding to the vertical distance can be set to half the height of the virtual frame VF, but it is not limited to this.

In some embodiments, the processor 160 may determine whether another distance (for example, the root mean square of the two distances) determined by both the horizontal distance DIST1 and the vertical distance DIST2 is greater than a preset threshold. For example, in some embodiments, the eight corner points of the first tracking frame TF1 and the second tracking frame TF2 can form a larger virtual frame VF, and the preset threshold can be set to half the width of the diagonal of the virtual frame VF Value, but not limited to this.

Step S2042: When the distance is not greater than the preset threshold, determine that the first object and the second object belong to the same target, and display at least one of the first object and the second object in the second display area according to a second magnification When the distance is greater than the preset threshold, the second display area displays the enlarged image including the first object and the second object in the second display area according to the third magnification.

In some embodiments (as shown in Figure 8), since neither the horizontal distance DIST1 and the vertical distance DIST2 are greater than the preset threshold, the processor 160 can determine that the first range CA1 and the second range CA2 belong to the same target ( That is, the two parts of the first person), the processor 160 may display in the second display area 122 the first tracking frame TF1 (corresponding to the first area CA1) or the second tracking frame TF2 (corresponding to the second area CA2) ) An enlarged image of at least one of them.

As mentioned above, in some embodiments, the processor 160 is mainly used to track the face of a person, because the processor 160 can be displayed in the second display area 122 Shows an enlarged image containing at least one of the first range CA1 or the second range CA2, the processor 160 may select the first tracking frame TF1 with a relatively high vertical coordinate value as the main tracking frame of the first person, so as to display in the second In the area 122, the movement of the first area CA1 corresponding to the face of the first person is tracked, that is, as shown in FIG. The image of the Lord. It should be understood that under different user or system requirements, the processor 160 can also be changed to display the magnified image around the first person in the second display area 122 at a second magnification that is less than or equal to the first magnification, so as to cover The face, hands, or whole body of the first person.

In some embodiments, the distance between the first object and the second object in the image log file may also be greater than a preset threshold. Please refer to Figure 4 and Figure 9 together. As described in the embodiment in Fig. 4, at the first time point in this time length, the processor 160 detects the pixel change in the first range CA1 according to the original picture at the edge of the hotel lobby, and the processor 160 follows the A tracking frame TF1 tracks the first object corresponding to the first range CA1. As shown in Figure 9, at the third time point (later than the first time point) in this time length, the processor 160 detects another pixel change on the other edge of the hotel lobby according to the original image. One pixel change corresponds to the third range CA3 in the original picture. In this embodiment, the third range CA3 corresponds to the second person. Similar to the embodiment in FIG. 4, corresponding to the third range CA3, the processor 160 will obtain the upper left corner point LP3 and the lower right corner point RP3, thereby generating a third tracking frame TF3 to track the pixel change of the third range CA3. Similarly, the processor 160 may obtain the center point CP3 of the third tracking frame TF3.

In this embodiment, the processor 160 can execute a judgment algorithm to calculate the center point CP1 of the first tracking frame TF1 and the center of the third tracking frame TF3 The horizontal distance DIST3 and the vertical distance DIST4 between the points CP3, and determine whether the horizontal distance DIST3 and the vertical distance DIST4 are greater than a preset threshold. For example, in this embodiment, the preset threshold corresponding to the horizontal distance is 45% of the width of the target area, and the preset threshold corresponding to the vertical distance is 80% of the height of the target area. This is limited.

In this embodiment, when the horizontal distance DIST3 is greater than the preset threshold of the horizontal distance, or the vertical distance DIST4 is greater than the preset threshold of the vertical distance, the processor 160 may determine that the first range CA1 and the third range CA3 do not belong to the same target Things. In this embodiment, since the horizontal distance DIST3 is greater than the preset threshold of the horizontal distance, the processor 160 determines that the first range CA1 and the third range CA3 do not belong to the same target object, but respectively correspond to the first person and the second person. In this way, the processor 160 can indeed recognize the movement of different objects in the original frame of the image log file. It should be understood that the foregoing embodiments are not intended to limit the present case. Under different user or system requirements, the preset thresholds for the processor 160 to execute the judgment algorithm may be different.

In some embodiments, when the processor 160 recognizes the movement of the first character and the second character in the target area, the processor 160 may display the movement of the two characters on the display interface 120. For a better understanding, please also refer to Figure 10 of this case, which is a schematic diagram of a display interface drawn according to some embodiments of this case. As shown in FIG. 10, in some embodiments, the processor 160 may display the original image of the entire target area at the original display magnification in the first display area 121 of the display interface 120, and display the original image in the second display area 122 of the display interface 120. The zoomed-in image in the target area is displayed according to the third magnification, thereby simultaneously displaying the movement of the two characters on the display interface 120. As shown in Figure 10, in this implementation In an example, this third magnification may be equal to the original display magnification. In some embodiments, the third magnification may be a magnification greater than or equal to the original display magnification and less than the first magnification. For example, if the original display magnification is 1 times and the first magnification is 2.2 times, the third magnification may be slightly greater than the original display magnification and less than 1.1 times the first magnification. The above values of the first magnification to the third magnification are for example only, and the remaining values are also within the scope of this case.

It should be understood that, in some embodiments, the processor 160 may display the original image of the entire target area at the original display magnification in the first display area 121 of the display interface 120, and mark the first image in the original image displayed in the first display area 121. The positions of the tracking frame TF1 and the third tracking frame TF3. In this way, when the third magnification applied to the second display area 122 is close to or equal to the original display magnification, the user can more intuitively recognize the movement of the first person and the second person in the first display area 121.

Similarly, in this embodiment, the processor 160 can continuously track the movement of the first character and the second character in the target area (restaurant lobby), and smooth the first character in a manner similar to the embodiment in Figs. 6A and 6B. The moving track of a tracking frame TF1 and a third tracking frame TF3 until the first person or the second person leaves the target area (that is, no longer detect the pixel corresponding to the first person or the second person in the target area Variety). For example, as described above, the processor 160 detects that the first person has left the target area at the second time point, if the second person is still in the target area at this time. The processor 160 will continue to track the movement of the second person in the target area, and display the movement of the second person in the second display area 122 with a zoomed-in image of the fourth magnification, and the original image in the first display area 121 Mark the position of the third tracking frame TF3.

In one embodiment, the memory 140 may be a non-volatile computer readable medium (Non-transitory computer readable medium), the memory 140 stores the at least one instruction, and the processor 160 can access the at least one instruction. The instructions are used to execute steps S201 to S206 in the operation method 200 of the aforementioned electronic device.

According to the above-mentioned embodiment, this case discloses an electronic device, an operation method of the electronic device, and a computer readable medium. With the technology of this case, it can be appropriately zoomed to display the image around the moving object, with an effect similar to the movement of a camera lens Track moving objects in the image log. In addition, this project is supplemented by the panoramic image of the target area as the control screen, which can enhance the user experience when viewing the image record file, and is an effective and intuitive electronic device and operation method.

Although this case is disclosed as above with examples, it is not intended to limit the case. Anyone who is familiar with this technique can make various changes and modifications without departing from the spirit and scope of this case. Therefore, the scope of protection of this case should be attached hereafter. The scope of the patent application shall prevail.

100‧‧‧Electronic device

120‧‧‧Display interface

140‧‧‧Memory

160‧‧‧Processor

Claims (17)

An electronic device includes: a display interface including a first display area and a second display area; a memory body storing at least one command; and a processor coupled to the memory body, and the processor loads the After at least one program command, perform the following steps: access an image log file, the image log file having a plurality of original frames; simultaneously display the original frames in the first display area and the second display area according to an original display magnification ; Detect whether there is a first object in the image log file; when the first object is detected in the image log file, display the first object in the second display area according to a first magnification An enlarged picture, and the original picture corresponding to the enlarged picture is displayed in the first display area according to the original display magnification, wherein the first magnification is greater than the original display magnification; when it is detected that the image record file has a first When the two objects move, it is determined whether a distance between the second object and the first object is greater than a preset threshold; and when the distance is not greater than the preset threshold, it is determined that the first object and the second object belong to the same The target object displays an enlarged screen including at least one of the first object or the second object in the second display area according to a second magnification, wherein the second magnification is greater than the original display magnification. The electronic device according to claim 1, wherein the processor is further configured to perform the following steps: when the enlarged image is displayed in the second display area, the original image corresponding to the enlarged image displayed in the first display area is The mark in the image corresponds to the area of the enlarged screen. The electronic device according to claim 1, wherein the processor is further configured to perform the following steps: when the first object is detected in the image log file, the second display area is displayed according to the original display magnification The original picture of is gradually enlarged to the enlarged picture displayed according to the first magnification. The electronic device according to claim 3, wherein the processor is further configured to perform the following steps: when the first object is no longer detected in the image log file, the second display area is based on the first The enlarged picture displayed by the magnification is gradually reduced to the original picture displayed according to the original display magnification. The electronic device according to claim 1, wherein the processor is further configured to perform the following steps: tracking a movement track of the first object in the image log; and smoothing the movement track to adjust the zoomed-in screen. The electronic device according to claim 1, wherein the processor is further configured to perform the following steps: when the distance is greater than the preset threshold, display the first object in the second display area according to a third magnification And an enlarged image of the second object, wherein the third magnification is smaller than the first magnification. The electronic device according to claim 6, wherein the third magnification is greater than or equal to the original display magnification. The electronic device according to claim 1, wherein the processor is further configured to perform the following steps: when the second object is detected in the image log file but the first object is no longer detected, according to a first object A four-magnification ratio displays an enlarged picture including the second object in the second display area, wherein the fourth magnification ratio is greater than the original display ratio. The electronic device according to claim 1, wherein the first display area and the second display area have the same size and are juxtaposed in the display interface. An operation method applied to an electronic device having a first display area and a second display area. The operation method includes: accessing an image log file, the image log file having a plurality of original frames; The original display magnification simultaneously displays the original pictures in the first display area and the second display area; Detect whether there is a first object in the image log file; when the first object is detected in the image log file, display the magnification containing the first object in the second display area according to a first magnification ratio And display the original image corresponding to the enlarged image in the first display area according to the original display magnification, wherein the first magnification is greater than the original display magnification; when a second object is detected in the image record file When moving, determine whether a distance between the second object and the first object is greater than a preset threshold; and when the distance is not greater than the preset threshold, determine that the first object and the second object belong to the same target The object is displayed in the second display area in accordance with a second magnification ratio of a magnified screen including at least one of the first object or the second object, wherein the second magnification ratio is greater than the original display magnification. The operation method according to claim 10, wherein the operation method further comprises the following steps: when the enlarged image is displayed in the second display area, the original image corresponding to the enlarged image displayed in the first display area The mark in the image corresponds to the area of the enlarged screen. The operation method according to claim 10, wherein the step of displaying the enlarged screen including the first object in the second display area according to the first magnification further includes: the second display area is displayed according to the original display The original picture displayed by the magnification is gradually enlarged to the enlarged picture displayed according to the first magnification. The operation method according to claim 12, wherein the operation method further comprises the following steps: when the first object is not continuously detected in the image log file, the second display area is adjusted according to the first magnification The displayed enlarged picture is gradually reduced to the original picture displayed according to the original display magnification. The operation method according to claim 10, wherein the operation method further includes the following steps: tracking a movement track of the first object in the image log; and smoothing the movement track to adjust the zoomed-in screen. The operation method according to claim 10, wherein the operation method further includes the following steps: when the distance is greater than the preset threshold, display in the second display area including the first object and the first object according to a third magnification The magnified image of the second object, wherein the third magnification is smaller than the first magnification. The operation method according to claim 15, wherein the third magnification is greater than or equal to the original display magnification. The operation method according to claim 10, wherein the operation method further comprises the following steps: when the second object is detected in the image log file but the first object is no longer detected, according to a fourth zoom The magnification is displayed in the second display area The magnified image containing the second object, wherein the fourth magnification is greater than the original display magnification.

Images