JP2021184547A - Data recording device and method - Google Patents

Abstract

To achieve both of image data recording operation and a code reading operation without increasing a processing load by using an output of an on-vehicle camera.SOLUTION: A data recording device records image data based on a photographing result of a camera arranged in a vehicle in a predetermined recording medium. The device performs: executing a code reading operation to read a code included in a photographed image by the camera; operating in an image recording mode when a vehicle is traveling, and operating in a code reading mode when the vehicle is stopped; stopping a code reading operation in an image recording mode but executing/permitting a recording operation of the image data in the recording medium; and executing a code reading operation in a code reading mode but stopping a recording operation of the image data in the recording medium.SELECTED DRAWING: Figure 9

Description

The present invention relates to a data recording device and a method.

There is a drive recorder as a data recording device that records image data based on the shooting result of a camera (vehicle-mounted camera) installed in a vehicle.

On the other hand, a method of using an in-vehicle camera for reading a code such as a QR code (registered trademark) has been proposed (see Patent Documents 1 and 2 below), and the destination of the navigation device is set using the reading result. A method has also been proposed (see [0059] in Patent Document 1 below).

Japanese Unexamined Patent Publication No. 2006-151266 Japanese Unexamined Patent Publication No. 2019-31172

The operation that the drive recorder should originally perform is a recording operation that records image data based on the shooting result of the vehicle-mounted camera on a predetermined recording medium. In the drive recorder, when it is considered to perform an operation for reading a code (code reading operation) by using an in-vehicle camera separately from the recording operation, an increase in processing load may become a problem. The processing to be executed in the drive recorder to realize the recording operation and the processing to be executed in the drive recorder to realize the code reading operation are separate processing, and parallel execution of both of them is a processing load. This is because it increases. Needless to say, it is important to suppress the increase in processing load.

An object of the present invention is to provide a data recording apparatus and method capable of achieving both an image data recording operation and a code reading operation without increasing the processing load.

The data recording device according to the present invention is a data recording device that records image data based on the shooting results of a camera installed in the vehicle on a predetermined recording medium, and is based on information depending on whether or not the vehicle is running. A processing unit that operates in the first mode while the vehicle is running and operates in the second mode while the vehicle is stopped, based on the discrimination result of the running discrimination unit that determines running or stopping. The processing unit can execute a code reading operation for reading a code included in a captured image of the camera, and in the first mode, the code reading operation is stopped while the image is read. It is a configuration (first configuration) in which the recording operation of data on the recording medium is executed or permitted, and in the second mode, the code reading operation is executed while the recording operation is stopped (first configuration).

Another data recording device according to the present invention is a data recording device that records image data based on the shooting results of a camera installed in a vehicle on a predetermined recording medium when a predetermined event occurs. It is a configuration (second configuration) in which a code reading operation for reading a code included in a captured image can be executed, and the code reading operation is stopped until a predetermined time elapses after the occurrence of the event is detected. ..

In the data recording device according to the second configuration, an event detection unit that detects the presence or absence of the occurrence of the event and an event recording period including the detection timing of the occurrence of the event when the occurrence of the event is detected are set. A processing unit that performs an event recording operation for recording the image data during the event recording period on the recording medium is provided, the code reading operation is executed by the processing unit, and the processing unit performs the event recording operation. When the occurrence is detected, the code reading operation may be stopped (third configuration) at least until the end of the event recording period.

In the data recording device according to any one of the first to third configurations, the result of the code reading operation is output to the external device in the code reading operation, and the captured image of the camera includes a code indicating the position information. In this case, when the code reading operation is executed by the processing unit, the navigation operation in which the destination is set based on the position information is executed by the external device in response to the result of the code reading operation (fourth). Configuration) may be used.

In the data recording device according to any one of the first to third configurations, the result of the code reading operation is output to the external device in the code reading operation, and the code is shown on the external installation object of the vehicle. When the code reading operation is executed by the processing unit in the case where the code including the code and the code shown in the installation object outside the vehicle is included in the captured image of the camera, the result of the code reading operation is received. The configuration may be such that the notification based on the code is performed by the external device (fifth configuration).

The data recording method according to the present invention is a data recording method for recording image data based on a shooting result of a camera installed in a vehicle on a predetermined recording medium, based on information depending on whether or not the vehicle is running. A processing step that operates in the first mode while the vehicle is running and operates in the second mode while the vehicle is stopped, based on the running discrimination step for discriminating running or stopping and the discrimination result of the running discrimination step. In the processing step, a code reading operation for reading a code included in a captured image of the camera can be executed, and in the first mode, the code reading operation is stopped while the image is read. It is a configuration (fifth configuration) in which the recording operation of data on the recording medium is executed or permitted, and in the second mode, the code reading operation is executed while the recording operation is stopped (fifth configuration).

Another data recording method according to the present invention is a data recording method for recording image data based on a shooting result of a camera installed in a vehicle on a predetermined recording medium when a predetermined event occurs. It is a configuration (seventh configuration) in which a code reading operation for reading a code included in a captured image can be executed, and the code reading operation is stopped until a predetermined time elapses after the occurrence of the event is detected. ..

According to the present invention, it is possible to provide a data recording device and a method capable of achieving both an image data recording operation and a code reading operation without increasing the processing load.

It is an overall block diagram of the in-vehicle system which concerns on embodiment of this invention. FIG. 3 is a schematic top view of a vehicle equipped with an in-vehicle system according to an embodiment of the present invention. FIG. 3 is a schematic block diagram of a navigation device constituting an in-vehicle system according to an embodiment of the present invention. It is explanatory drawing of the event recording period set based on the occurrence of the event which concerns on embodiment of this invention. It is a figure which shows the example of the two-dimensional code which is the object of photography of the camera which concerns on embodiment of this invention. It is a figure which shows the example of the two-dimensional code which is the object of photography of the camera which concerns on embodiment of this invention. It is a flowchart of the extraction operation of the information embedded in the two-dimensional code according to the embodiment of this invention. It is an operation flowchart of an in-vehicle system according to 1st Embodiment belonging to the Embodiment of this invention. It is a figure which shows the relationship between the state (driving presence / absence) of a vehicle, the operation mode, the code reading operation, and the recording operation, according to the 1st Embodiment belonging to the Embodiment of this invention. FIG. 3 is a diagram showing a relationship between an event recording period and an execution or stop period of a code reading operation according to a second embodiment belonging to the embodiment of the present invention. FIG. 3 is a diagram showing a relationship between an event recording period and an execution or stop period of a code reading operation according to a second embodiment belonging to the embodiment of the present invention.

Hereinafter, examples of embodiments of the present invention will be specifically described with reference to the drawings. In each of the referenced figures, the same parts are designated by the same reference numerals, and duplicate explanations regarding the same parts will be omitted in principle. In this specification, for the sake of simplification of description, by describing a symbol or a code that refers to an information, a signal, a physical quantity, a member, etc., the name of the information, a signal, a physical quantity, a member, etc. corresponding to the symbol or the code is given. May be omitted or abbreviated.

FIG. 1 is an overall configuration diagram of an in-vehicle system SYS according to an embodiment of the present invention. The in-vehicle system SYS includes a drive recorder 1, a camera 2, a microphone unit 3, an operation unit 4, a GPS processing unit 5, a vehicle sensor unit 6, a recording medium 7, and a navigation device 8. The drive recorder 1 includes a main control unit 10, a recording medium mounting unit 20, a time measuring unit 30, and an internal memory 40. FIG. 2 is a schematic top view of a vehicle CR equipped with the in-vehicle system SYS. Although not shown in FIG. 2, the components of the in-vehicle system SYS are installed in place on the vehicle CR.

The connected device is connected to the drive recorder 1. The drive recorder 1 and an arbitrary connected device are connected to each other by wire or wirelessly in a manner capable of bidirectional communication (provided that one-way communication is also possible if not necessary). The connected devices include a camera 2, a microphone unit 3, an operation unit 4, a GPS processing unit 5, a vehicle sensor unit 6, and a navigation device 8, and each connected device is installed at an appropriate position in the vehicle CR. However, any one or more elements of the camera 2, the microphone unit 3, the operation unit 4, and the GPS processing unit 5 may be built in the drive recorder 1.

Here, a vehicle (automobile or the like) capable of traveling on the road surface is mainly assumed as the vehicle CR, but the vehicle CR may be any kind of vehicle. The direction from the driver's seat of the vehicle CR toward the steering wheel is defined as "forward", and the direction from the steering wheel of the vehicle CR toward the driver's seat is defined as "rear". The direction orthogonal to the front-rear direction and parallel to the road surface is defined as the left-right direction. It is assumed that the left and right in the left-right direction are the left and right as seen from the driver of the vehicle CR, who are sitting in the driver's seat of the vehicle CR and facing forward.

The camera 2 is an in-vehicle camera installed in the vehicle CR, and is installed at a predetermined position inside or outside the vehicle interior of the vehicle CR. The camera 2 is equipped with an image sensor and an optical system such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor and a CCD (Charge-Coupled Device) image sensor, and takes a picture within its own shooting area (in other words, a field of view). Image data showing an image obtained by shooting (that is, an image in a shooting area) is generated and output. The image data obtained by the camera 2 is output to the drive recorder 1. The camera 2 periodically repeats shooting in its own shooting area at a predetermined shooting frame rate. The shooting frame rate corresponds to the number of shots per second. The shooting frame rate is arbitrary, but is, for example, 120 [frames / second]. The image data of the frame image is periodically generated in the camera 2 at the interval of the reciprocal of the shooting frame rate and sent to the drive recorder 1. The frame image refers to a still image obtained by taking one shot of the camera 2. A moving image is formed by a plurality of frame images arranged in a time series.

The camera 2 may be a camera for outside-vehicle photography that photographs the outside of the vehicle interior of the vehicle CR. The shooting direction of the camera for shooting outside the vehicle is arbitrary. That is, the camera for shooting outside the vehicle may be a front camera, a rear camera, a right camera, or a left camera that mainly shoots the front side region, the rear side region, the right side region, and the left side region outside the vehicle CR. Alternatively, the camera 2 may be a camera for in-vehicle photography that photographs the interior of the vehicle CR. The camera 2 may be composed of a plurality of cameras. In this case, the camera 2 may include a camera for shooting outside the vehicle and a camera for shooting inside the vehicle. In the present embodiment, it is assumed that the front camera is provided as the camera 2 as an example below.

The microphone unit 3 is composed of one or more microphones installed in the vehicle CR. One microphone in the microphone unit 3 collects sounds around the microphone and converts the collected sounds into audio data (that is, generates audio data representing the collected sounds). The voice data generated by the microphone is output to the drive recorder 1. The number of microphones constituting the microphone unit 3 and the arrangement position of the microphones may be appropriately set. For example, the microphone unit 3 may be provided with an external microphone that mainly collects the sound generated outside the vehicle CR and an internal microphone that mainly collects the sound generated inside the vehicle interior of the vehicle CR. ..

The operation unit 4 is an operation unit that can be operated by the user, and receives input of various operations from the user (hence, from the outside of the drive recorder 1). A signal indicating the operation content for the operation unit 4 is output to the drive recorder 1. In the present embodiment, the user refers to a user of the in-vehicle system SYS, and is usually a driver of the vehicle CR, but a passenger other than the driver of the vehicle CR can also be a user. The operation unit 4 is arranged at an appropriate position on the vehicle CR, such as in the vicinity of a steering wheel (not shown) so that the driver or the like can easily operate the operation unit 4. The user can make various settings of the drive recorder 1 by operating the operation unit 4.

The GPS processing unit 5 detects the position of the vehicle CR by receiving signals from a plurality of GPS satellites forming a GPS (Global Positioning System), and generates vehicle position information indicating the detected position. The detected position is the current location of the vehicle CR. In the vehicle position information, the position (current location) of the vehicle CR is represented by the longitude and latitude on the earth. The vehicle position information is sequentially generated at a predetermined cycle, and the generated vehicle position information is sequentially sent to the drive recorder 1.

The vehicle sensor unit 6 is composed of a plurality of vehicle-mounted sensors installed in the vehicle CR, and detects and acquires vehicle sensor information using each vehicle-mounted sensor. The vehicle sensor information is sequentially acquired at a predetermined cycle, and the acquired vehicle sensor information is sequentially sent to the drive recorder 1. The vehicle sensor information includes vehicle speed information (vehicle speed pulse) indicating the speed of the vehicle CR, accelerator information indicating the amount of depression of the accelerator pedal provided on the vehicle CR, and brake information indicating the amount of depression of the brake pedal provided on the vehicle CR. It also includes steering angle information indicating the steering angle of the steering wheel provided on the vehicle CR. The plurality of vehicle-mounted sensors include an acceleration sensor, and acceleration information output from the acceleration sensor is also included in the vehicle sensor information. The accelerometer detects the acceleration of the vehicle CR in each of the three or two axes orthogonal to each other, and outputs acceleration information indicating the detection result.

The recording medium 7 is a memory card composed of a semiconductor memory. However, the recording medium 7 may be any recording medium such as a magnetic disk, an optical disk, or a magneto-optical disk.

The navigation device 8 performs a navigation operation to support the traveling of the vehicle CR to the destination of the vehicle CR. FIG. 3 shows a schematic block diagram of the navigation device 8. The navigation device 8 includes a control unit 8a, a display unit 8b, a speaker 8c, and a communication unit 8d. In the navigation operation, the control unit 8a sets a planned travel route from the current location of the vehicle CR to the destination, and displays an image in which the planned travel route is superimposed on the map image on the display unit 8b configured by a liquid crystal display panel or the like. indicate. The planned travel route represents the route on which the vehicle CR is scheduled to travel to the destination, and the driver of the vehicle CR is expected to perform a driving operation so that the vehicle CR travels along the planned travel route. NS. The speaker 8c outputs arbitrary voice to the user under the control of the control unit 8a. The communication unit 8d has a communication function for transmitting / receiving information to / from an arbitrary other party device (for example, a server device connected to an Internet network) different from the drive recorder 1 and the navigation device 8, and the transmission / reception of the information is arbitrary. It is done via a wireless communication line.

In the navigation device 8, the display unit 8b is composed of a touch panel, and the destination of the vehicle CR may be set based on the user's operation on the touch panel. However, the destination of the vehicle CR may be set by using the function of the drive recorder 1 (details will be described later).

The main control unit 10 has a CPU (Central Processing Unit) that realizes various control functions by performing arithmetic processing, a RAM (Random Access Memory) that is used as a work area for arithmetic processing, a program, setting parameters, and the like. It is equipped with a ROM (Read Only Memory) that stores non-volatilely. By performing arithmetic processing according to the program stored in the ROM, all or part of the functions of the main control unit 10 may be realized.

The recording medium mounting unit 20 is configured so that the recording medium 7 can be mounted. When the recording medium 7 is a memory card, the recording medium mounting unit 20 is configured as a card slot. However, as described above, the recording medium 7 may be any recording medium. In the following, it is assumed that the recording medium 7 is mounted on the recording medium mounting unit 20 and that the main control unit 10 can freely write and read data to and from the recording medium 7. The recording medium 7 may be a recording medium built into the drive recorder 1 so as not to be detachable.

The timekeeping unit 30 acquires time data indicating the current date and time. The acquired time data is given to the main control unit 10.

The internal memory 40 is a memory built in the drive recorder 1 separately from the recording medium 7. The internal memory 40 is, for example, a semiconductor memory having a predetermined recording capacity. However, the type of the internal memory 40 is arbitrary.

The main control unit 10 has a plurality of functional blocks that realize various functions, and includes a data processing unit 11, an event detection unit 12, and a travel determination unit 13 as characteristic functional blocks.

Various data are input to the data processing unit 11. The data processing unit 11 performs predetermined data processing on the input data. The main input data to the data processing unit 11 is image data from the camera 2. The data processing unit 11 also controls recording with respect to the recording medium 7. It may be considered that the data processing unit 11 is provided with a recording control unit for performing the recording control. The data processing unit 11 can record image data based on the shooting result of the camera 2 on the recording medium 7 (in other words, record the image data), and at this time, the image data after the data processing by the data processing unit 11 is recorded on the recording medium. It can be recorded in 7 (in other words, recorded).

The event detection unit 12 detects whether or not a predetermined event has occurred based on various indexes. The event detection unit 12 continuously monitors the success or failure of a predetermined event condition, and determines that an event has occurred when the event condition is satisfied. Satisfaction of event conditions and occurrence of events are synonymous.

The event detection unit 12 may determine whether or not an event has occurred based on the vehicle sensor information. For example, the event detection unit 12 calculates the absolute value of the acceleration generated in the vehicle CR as the G value based on the acceleration information, and when a G value equal to or higher than a predetermined threshold value is observed, the G event, which is one of the events, occurs. It is determined that the event has occurred (that is, the G event condition, which is a kind of event condition, is satisfied). Further, for example, the event detection unit 12 calculates the absolute value of the amount of change in the increasing direction of the speed of the vehicle CR based on the vehicle speed information, and it is observed that the absolute value of the amount of change is equal to or more than the predetermined acceleration upper limit value. At that time, it is determined that a sudden acceleration event, which is one of the events, has occurred (that is, a sudden acceleration event condition, which is a kind of event condition, is satisfied). Further, for example, the event detection unit 12 calculates the absolute value of the amount of change in the decreasing direction of the vehicle CR based on the vehicle speed information, and it is observed that the absolute value of the amount of change is equal to or more than the predetermined deceleration upper limit value. At that time, it is determined that a sudden deceleration event, which is one of the events, has occurred (that is, a sudden deceleration event condition, which is a kind of event condition, is satisfied). In addition, various events that occur in the vehicle CR, such as a sudden steering event in which the steering angle of the steering wheel suddenly changes and a sudden braking event in which sudden braking is applied, may be detected as events based on vehicle sensor information.

Further, for example, an operation event may occur when a user inputs a predetermined operation to the operation unit 4 (that is, an operation event condition, which is a kind of event condition, may be satisfied). Further, for example, the event detection unit 12 may determine the success or failure of the event condition based on the image data generated by the camera 2. For example, based on the image data generated by the camera 2, it may be determined whether or not a staggering event occurs in which the vehicle CR travels from side to side, or whether or not a signal ignoring event occurs in which the vehicle CR enters an intersection at a red light. good. In addition, the presence or absence of various events may be detected (various event conditions may be set).

The travel determination unit 13 determines whether the vehicle CR is traveling or stopped based on predetermined travel determination information, that is, determines whether the vehicle CR is in a traveling state or a stopped state. The running state refers to the state in which the vehicle CR is running (the state in which the vehicle CR is moving), and the stopped state refers to the state in which the vehicle CR is stopped without moving.

The travel determination information is arbitrary as long as it is information that depends on the presence or absence of travel of the vehicle CR. For example, vehicle speed information (vehicle speed pulse) obtained from the vehicle sensor unit 6 may be used as travel discrimination information. Alternatively, for example, the vehicle position information obtained from the GPS processing unit 5 may be used as the travel determination information, and the travel or stop of the vehicle CR may be determined based on the time-series change of the vehicle position information. Further, for example, the image data generated by the camera 2 (here, the front camera is assumed as described above) is used as the travel discrimination information, and the vehicle CR travels or is based on the optical flow derived from the image data. The stop may be determined.

The data processing unit 11 includes a recording function for recording image data based on the shooting result of the camera 2 on the recording medium 7, and a code reading function for reading a code from the shot image of the camera 2.

[Recording function (constant recording operation and event recording operation)]
First, the recording function, which is a basic function of the drive recorder 1, will be described. The recording function is realized by a constant recording operation or an event recording operation.

The constant recording operation is always executed during the period in which the drive recorder 1 is operating, regardless of the detection result of the event detection unit 12, that is, regardless of whether or not an event has occurred (however, there are exceptions: exceptions will be described later). ). The in-vehicle system SYS is activated in conjunction with, for example, an activation switch (accessory switch, etc.) of the vehicle CR. In the continuous recording operation, the data processing unit 11 records the image data based on the shooting results of the cameras 2 generated one after another on the recording medium 7 as unprotected data. The recording medium 7 has a recording area capable of storing up to a predetermined capacity of unprotected data. When new unprotected data is generated while a predetermined amount of unprotected data is recorded on the recording medium 7 in the continuous recording operation, the latest unprotected data is overwritten on the past unprotected data on the recording medium 7. Record. Overwriting and recording the first data on the second data means erasing the second data from the recording medium 7 and recording the first data on the recording medium 7 instead. The past unprotected data to be overwritten is the unprotected data acquired and recorded at the oldest time among all the unprotected data recorded on the recording medium 7. As described above, in the continuous recording operation, the image data based on the shooting result of the camera 2 is set as unprotected data, and the unprotected data is constantly recorded on the recording medium 7 in such a manner that overwriting is permitted.

On the other hand, the event recording operation is a recording operation executed when an event occurs. An event recording period (protection recording period) set when an event occurs will be described with reference to FIG. 4. The event recording period is set by the data processing unit 11 based on the detection result of the event detection unit 12. In FIG. 4, the timing t _EVENT represents the timing when the occurrence of the event is detected, and corresponds to the time when the event condition is satisfied. The time when the event condition is satisfied refers to the timing of switching from the state in which the event condition is not satisfied to the state in which the event condition is satisfied. Start timing of the event recording period is the time from the timing _{t EVENT T PRE} (e.g. 12 seconds) and only before the timing _{t S,} after only the end timing time _{T POST} from the timing _{t EVENT} event recording period (e.g. 8 seconds) Timing t _E. The time T _PRE and T _POST are each a predetermined time, and it does not matter whether they match or disagree. Although different from the situation shown in FIG. 4 _{, any one of the time T PRE} and T _POST may be zero, but in this embodiment, “T _PRE > 0” and “T _POST > 0”. Suppose that When the satisfied event condition is an operation event condition based on the user operation, _{the length of the time TPOST} may be variable according to the operation to the operation unit 4 (that is, the user can specify the length of the event recording period). Also good). In the operation period of the drive recorder 1, a period other than the event recording period is referred to as a non-event period.

When the event occurrence is detected (that is, when the event condition is satisfied), the data processing unit 11 sets the event recording period including the event _{occurrence detection timing t EVENT.} Then, the data processing unit 11 sets the image data based on the shooting result of the camera 2 during the event recording period as the protection data, and records the protection data on the recording medium 7 in a manner in which overwriting is prohibited. The protected data once recorded on the recording medium 7 is not erased from the recording medium 7 and is not overwritten by other data unless a predetermined release operation is performed. Hereinafter, recording certain data as protected data on the recording medium 7 may be referred to as protected recording or protected recording.

As can be understood from the above description, unprotected data means data that can be overwritten, and protected data means data that cannot be overwritten. Therefore, recording certain data as unprotected data is synonymous with recording the data in a manner that allows overwriting, and recording certain data as protected data and overwriting the data are synonymous. Recording in a prohibited manner is synonymous. The recording area where the unprotected data should be recorded and the recording area where the protected data should be recorded may be set separately on the recording medium 7, and the unprotected data and the protected data may be classified by managing flags and the like. May be done.

The data processing unit 11 appropriately uses the internal memory 40 when performing an operation of recording image data based on the shooting result of the camera 2 on the recording medium 7. In the internal memory 40, a ring buffer for temporarily recording image data for a predetermined fixed time is formed. When the image data to be newly recorded is input to the drive coder 1 with the image data for a certain period of time recorded in the ring buffer, the latest image data is overwritten on the oldest recorded image data. And be recorded. Therefore, the latest image data for a certain period of time is always held in the ring buffer. If this ring buffer is used, the image data generated by the camera 2 between _{the timing t S} and t _EVENT is read from the ring buffer after the event occurrence is detected by _{the timing t EVENT, and necessary data processing is performed.} It is also possible to perform appropriate processing and then record on the recording medium 7.

Further, in the constant recording operation or the event recording operation, the data processing unit 11 performs predetermined image processing (for example, image compression processing according to a predetermined recording format) as data processing on the image data generated by the camera 2. The image data after the image processing can be recorded on the recording medium 7.

In the drive recorder 1, both the constant recording operation and the event recording operation are executed. Alternatively, the data processing unit 11 may execute only the event recording operation by disabling the constant recording operation and enabling the event recording operation among the constant recording operation and the event recording operation.

When the data processing unit 11 records the image data based on the shooting result of the camera 2 on the recording medium 7 by the constant recording operation or the event recording operation, the data processing unit 11 adds predetermined additional data to the image data, and the image data and the image data The additional data may be associated with each other and recorded on the recording medium 7. The additional data may include vehicle position information and vehicle sensor information, as well as voice data generated by the microphone unit 3 and time data generated by the time measuring unit 30.

[Code reading function (code reading operation)]
Next, the code reading function will be described. A subject including a code may exist in the shooting area of the camera 2. In this case, the code is shot by the camera 2, and the code (image of the code) is included in the shot image of the camera 2. The code may be any one-dimensional code that is a one-dimensional pattern code, or may be any two-dimensional code that is a two-dimensional pattern code. A QR code (registered trademark) can be used as a two-dimensional code. In the present embodiment, unless otherwise specified, the code is assumed to be a two-dimensional code composed of a binarized shade pattern such as a QR code (registered trademark).

As shown in FIG. 5A, the two-dimensional code included in the captured image of the camera 2 may be the two-dimensional code CD1 displayed on the display screen of the terminal device (smartphone or the like) possessed by the user. , As shown in FIG. 5B, the two-dimensional code CD2 on the printed matter placed in front of the camera 2 by the user may be used. Alternatively, the two-dimensional code included in the captured image of the camera 2 may be the two-dimensional code CD3 shown on an installation object outside the vehicle CR (for example, a sign or a signboard on the road surface) as shown in FIG. .. The two-dimensional code CD3 may be printed on an installation object outside the vehicle CR, or may be displayed on the display screen if the installation object has a display screen.

When the captured image of the camera 2 contains a two-dimensional code, the data processing unit 11 realizes a two-dimensional code reading function by performing a code reading operation. The code reading operation is an operation for reading the two-dimensional code included in the captured image of the camera 2, and the result of the code reading operation is different from that of the drive recorder 1 provided outside the drive recorder 1 (that is, the drive recorder 1). It is output to the device). Here, the external device is the navigation device 8. However, the external device may be any device installed in the vehicle CR.

When the captured image of the camera 2 contains a two-dimensional code, for example, as shown in FIG. 7, in order to extract and recognize the information embedded in the two-dimensional code (that is, the information indicated by the two-dimensional code). Predetermined image processing (binarization of pixel values) suitable for reading a two-dimensional code for the first element operation for acquiring the image data generated by the camera 2 and the image data acquired by the first element operation. The image area representing the image of the two-dimensional code is specified from the image captured by the camera 2 represented by the image data after the image processing by the second element operation and the image processing by the second element operation. According to the third element operation that extracts the image in the image area as a code partial image and the standard of the two-dimensional code, the information embedded in the code partial image (for example, the character information representing the coordinates on the earth, the uniform resource locator) is represented. The fourth element operation of extracting and recognizing (character information) from the shading pattern of the code partial image is executed.

In the code reading operation by the data processing unit 11, all of the first to fourth element operations may be executed. In this case, the information recognized by the fourth element operation, that is, the information embedded in the code partial image, is output from the drive recorder 1 to the external device (here, the navigation device 8) as a result of the code reading operation.

Of the first to fourth element operations, only a part of the element operations is executed by the code reading operation of the data processing unit 11, and the remaining element operations are executed by the external device (here, the navigation device 8). Is also good. That is, for example, some of the element operations executed by the code reading operation of the data processing unit 11 may be the first and second element operations. In this case, the image data after the image processing by the second element operation (in other words, the captured image of the camera 2 represented by the image data after the image processing by the second element operation) is driven as a result of the code reading operation. The data is output from the recorder 1 to the external device (here, the navigation device 8), and the third and fourth element operations are executed by the external device in response to the result of the code reading operation. Alternatively, for example, some of the element operations executed by the code reading operation of the data processing unit 11 may be the first to third element operations. In this case, the image data of the code partial image extracted by the third element operation is output from the drive recorder 1 to the external device (here, the navigation device 8) as a result of the code reading operation, and receives the result of the code reading operation. The fourth element operation is executed by the external device.

In order to realize the code reading function, processing different from the processing required for the recording function is required, and from the viewpoint of reducing the processing load, it is better to suppress the simultaneous execution of these functions.

Some operation examples, applied techniques, or modification techniques in consideration of this will be described in the following plurality of examples. The above-mentioned matters in the present embodiment are applied to the following examples as long as there is no particular description and there is no contradiction. If there is a matter inconsistent with the above-mentioned matters in each embodiment, the description in each embodiment may take precedence. Further, as long as there is no contradiction, the matters described in any of the plurality of examples shown below may be applied to any other example (that is, any two or more of the plurality of examples). It is also possible to combine the examples of).

<< First Example >>
The first embodiment of the present invention will be described. In the first embodiment, the code reading operation linked to the destination setting in the navigation device 8 will be described.

FIG. 8 is an operation flowchart of the in-vehicle system SYS according to the first embodiment. FIG. 8 shows a flow in which a camera 2 captures a two-dimensional code in which position information is embedded and sets a destination for a navigation operation. In the first embodiment, it is mainly assumed that the two-dimensional code CD1 or CD2 of FIG. 5A or FIG. 5B is photographed by the camera 2. In step S10, when the engine of the vehicle CR is started, or when a predetermined code reading button (not shown) provided in the navigation device 8 is pressed by the user, the process proceeds to step S11. The code reading button may be provided on the drive recorder 1.

In step S11, the operation mode of the drive recorder 1 is set to the code reading mode. Since the operation of the data processing unit 11 changes depending on the operation mode of the drive recorder 1, it may be understood that the operation mode of the drive recorder 1 is the operation mode of the data processing unit 11. Hereinafter, the operation mode of the drive recorder 1 and the data processing unit 11 may be simply referred to as an operation mode. The operation mode is set to either a code reading mode or a recording mode by the main control unit 10. The code reading mode is a mode for reading a two-dimensional code included in the captured image of the camera 2 by using the code reading operation. The recording mode is a mode for recording image data based on the shooting result of the camera 2 on the recording medium 7 by the continuous recording operation or the event recording operation. It may be considered that the main control unit 10 is provided with a mode setting unit (not shown) for setting the operation mode of the data processing unit 11 to either the code reading mode or the recording mode.

When the operation mode of the drive recorder 1 (data processing unit 11) is set to the code reading mode in step S11, the process proceeds to step S12. In step S12, the traveling determination unit 13 determines whether the vehicle CR is currently in the stopped state. When the vehicle CR is currently in the stopped state, the transition from step S12 to step S13 occurs, and when the vehicle CR is currently in the traveling state, the transition from step S12 to step S18 occurs.

In step S13, the data processing unit 11 executes a code reading operation in the drive recorder 1 to acquire a read image, and in the following step S14, the read image is transmitted from the drive recorder 1 to the navigation device 8. In the operation example of FIG. 8, it is assumed that only the first and second element operations among the above-mentioned first to fourth element operations are executed in the code reading operation of the data processing unit 11 (FIG. 7). reference). Therefore, the scanned image acquired in step S13 refers to the captured image of the camera 2 represented by the image data after the image processing by the second element operation.

After the transmission in step S14, the process proceeds to step S15. In step S15, the control unit 8a of the navigation device 8 refers to the received read image and determines whether the read image includes the image of the two-dimensional code. If it is determined in step S15 that the scanned image contains the image of the two-dimensional code, the process proceeds to step S16, and if not, the process returns to step S12. More specifically, in step S15, the control unit 8a executes the above-mentioned third and fourth element operations (see FIG. 7). In step S15, the process proceeds to step S16 only when the code partial image is extracted from the read image by the third element operation and the information embedded in the code partial image is extracted and recognized by the fourth element operation.

In step S16, the control unit 8a of the navigation device 8 determines whether or not the information extracted and recognized from the two-dimensional code in the read image is the position information. If the extracted and recognized information is location information, the process proceeds from step S16 to step S17, but if not, a predetermined warning notification (for example, read by the camera 2) is given to the user in step S19. The user is notified that the information is not the location information for setting the destination), and then the process returns to step S12. The warning notification in step S19 is a visual notification using the display unit 8b, an auditory notification using the speaker 8c, or a combination thereof.

In step S17, the control unit 8a determines the destination of the vehicle CR based on the position information extracted and recognized from the scanned image (more specifically, based on the position information extracted and recognized from the code partial image in the scanned image). Set and start the navigation operation. That is, the navigation operation is started after setting the point designated by the position information as the destination of the vehicle CR. After the start of the navigation operation, the process proceeds to step S18. Here, the position information is coordinate information representing longitude and latitude, or coordinate information representing longitude, latitude and altitude, or address information representing an address. The two-dimensional code included in the captured image of the camera may be a map code linked with a map service (for example, Google map) provided by a server device on the network. In this case, the position information becomes information for specifying the position on the map service, and the control unit 8a sets the destination by using the map service based on the map code through the communication unit 8d.

In step S18, the operation mode of the drive recorder 1 (data processing unit 11) is set to the recording mode by the main control unit 10. Therefore, the continuous recording operation in the recording mode is started immediately after the transition to step S18, and the event recording operation is executed when an event occurs. In FIG. 8, the illustration of the flow of processing after step S18 is omitted.

In the operation example of FIG. 8, it is assumed that only the first and second element operations are executed in the code reading operation of the data processing unit 11 (see FIG. 7), but the code reading of the data processing unit 11 is performed. In the operation, in addition to the first and second element operations, the third element operation may be executed. In this case, the code partial image extracted by the third element operation is read from the drive recorder 1 as a read image. It is transmitted to the navigation device 8. Alternatively, in the operation example of FIG. 8, the code reading operation of the data processing unit 11 may execute all the first to fourth element operations. In this case, when the step S13 is reached, the transmission of the step S14 is not executed and the determination process of the step S15 is performed by the data processing unit 11, and the extraction result of the information embedded in the scanned image is obtained. Is transmitted from the drive recorder 1 to the navigation device 8. Then, if the information embedded in the scanned image is position information, the transition to step S17 occurs, and if not, the process returns to step S12 with the warning notification of step S19.

FIG. 8 is an example of an operation in which the operation mode is automatically switched between the code reading mode and the recording mode depending on whether the state of the vehicle CR is a running state or a stopped state. In the first embodiment, the operation mode of the drive recorder 1 (data processing unit 11) may be switched as shown in FIG. That is, based on the determination result of the travel determination unit 13, the operation mode is set to the recording mode while the vehicle CR is traveling, the data processing unit 11 is operated in the recording mode, and the operation mode is coded while the vehicle CR is stopped. The data processing unit 11 may be operated in the code reading mode by setting the reading mode.

In the recording mode, the execution of the code reading operation by the data processing unit 11 is prohibited, while the constant recording operation by the data processing unit 11 is executed and the event recording operation is permitted (this is also the operation example of FIG. 8). Similarly). The event recording operation is permitted means that the event recording operation is executed on condition that an event occurs. That is, the data processing unit 11 stops the code reading operation in the recording mode, while executing or permitting the recording operation of the image data on the recording medium 7 based on the shooting result of the camera 2. Here, the execution of the recording operation means the execution of the continuous recording operation, and the permission of the recording operation means that the event recording operation is executed on condition that an event occurs. In the recording mode, it is also possible to perform only the event recording operation as the recording operation without performing the continuous recording operation at all. In this case, the event recording operation is permitted although the continuous recording operation is not executed in the recording mode.

On the other hand, in the code reading mode, the data processing unit 11 executes the code reading operation, while the data processing unit 11 prohibits the execution of the constant recording operation and the event recording operation (this is also the operation example of FIG. 8). Similarly). That is, the data processing unit 11 executes the code reading operation in the code reading mode, while stopping the recording operation (constant recording operation and event recording operation) of the image data on the recording medium 7 based on the shooting result of the camera 2. ..

By making the code reading operation executable in the drive recorder 1 that has a recording function, it is not necessary to separately provide a camera dedicated to reading the code, which is advantageous in terms of cost and space saving. However, if parallel execution of the code reading operation and the recording operation is requested, the processing load of the data processing unit 11 (for example, the processing load of the CPU in the data processing unit 11) becomes large. In consideration of this, as described above, while the vehicle CR is running, the code reading operation is stopped (in other words, execution is prohibited) in the recording mode, while the recording operation is executed or permitted, and while the vehicle CR is stopped. While executing the code reading operation in the code reading mode, the recording operation is stopped (in other words, execution is prohibited). As a result, since the code reading operation and the recording operation are not executed in parallel, it is possible to achieve both the code reading operation and the recording operation without increasing the processing load. Since the recording operation is basically an operation for recording the state of an accident or the like while the vehicle CR is running, it is considered that there is no substantial adverse effect even if the recording operation is stopped while the vehicle CR is stopped. On the contrary, since the destination should be set while the vehicle CR is stopped from the viewpoint of safety, even if the code reading operation is stopped while the vehicle CR is running, there is no substantial adverse effect. Conceivable. Although it is possible to manually switch the operation mode by the user, the manual switching is troublesome for the user and may cause a switching error.

Further, by using the camera 2 for the drive recorder 1 and enabling the destination setting by the two-dimensional code, the convenience of the user is enhanced.

<< Second Example >>
A second embodiment of the present invention will be described. In the second embodiment, the execution / stop of the code reading operation is controlled in relation to the event recording operation.

10 or 11 shows the relationship between the event recording period and the execution or stop period of the code reading operation. When the in-vehicle system SYS including the drive recorder 1 is started, the code reading operation by the data processing unit 11 is started, and thereafter, the code reading operation is continuously executed unless an event occurs (unless the event condition is satisfied). NS.

When the occurrence of an event is detected in the timing t _EVENT , the data processing unit 11 sets the code reading stop period with reference to the _{timing t EVENT.} The data processing unit 11 stops the code reading operation during the code reading stop period (in other words, prohibits the execution of the code reading operation). Code reading stop period starts at the time _{t EVENT,} ends when the predetermined time _{T F} from the timing _{t EVENT} has elapsed. The predetermined time _{TF coincides with the time T POST} as shown in FIG. 10 or is longer than the _{time T POST} as shown in FIG. That is, when the occurrence of an event is detected, the data processing unit 11 stops the code reading operation (in other words, prohibits the execution of the code reading operation) at least until the end of the event recording period.

The data processing unit 11 can perform an event recording operation during the code reading stop period. That is, for example, when _{the occurrence of an event is detected at the timing t EVENT} , the data processing unit 11 uses the image data generated by the camera 2 during the event recording period while appropriately referring to the holding data of the ring buffer. On the other hand, predetermined image processing (for example, image compression processing according to a predetermined recording format) is performed as data processing, and the image data after the image processing is recorded on the recording medium 7 as protection data. The event recording operation including the above image processing and the operation of recording the image data after the image processing on the recording medium 7 may be performed during the code reading stop period. Then, it is not necessary to perform the event recording operation and the code reading operation at the same time.

If the parallel execution of the code reading operation and the event recording operation is requested, the processing load of the data processing unit 11 (for example, the processing load of the CPU in the data processing unit 11) becomes large, but the execution control of each operation is performed as in the second embodiment. By performing the above, it is possible to achieve both the code reading operation and the event recording operation without increasing the processing load.

Also in the second embodiment, it can be said that the operation mode of the data processing unit 11 is automatically switched between the code reading mode and the recording mode (see FIG. 9). In the second embodiment, the operation mode is set to the recording mode during the code reading stop period, and the operation mode is set to the code reading mode during the other period, regardless of whether or not the vehicle CR is running. I can say.

During the period in which the code reading operation is continuously executed (in other words, in the code reading mode), the code reading operation is repeatedly executed at a predetermined cycle. Therefore, for example, during the period in which the code reading operation is continuously executed, the camera 2 captures a two-dimensional code in which position information such as the two-dimensional code CD1 or CD2 of FIG. 5 (a) or FIG. 5 (b) is embedded. If the camera 2 is placed in the shooting area of the above, the two-dimensional code included in the shot image of the camera 2 is read by the code reading operation, and the navigation device 8 receives the result of the code reading operation. The navigation operation is started by setting the destination of the vehicle CR based on the position information embedded in the dimension code. The flow of the operation until the start of the navigation operation may be the same as that shown in the first embodiment. The read image (see FIG. 8) described in the first embodiment may be provided from the drive recorder 1 to the navigation device 8 as a result of the code reading operation. Alternatively, the code reading operation of the data processing unit 11 may execute all the first to fourth element operations (see FIG. 7). In this case, the extraction result of the position information embedded in the two-dimensional code (fourth). The result of the element operation) is provided from the drive recorder 1 to the navigation device 8 as a result of the code reading operation.

By using the camera 2 for the drive recorder 1 and enabling the destination setting by the two-dimensional code, the convenience of the user is enhanced.

In the second embodiment, the constant recording operation may be valid or invalid. That is, in the second embodiment, after the drive recorder 1 is started, the constant recording operation may be continuously executed regardless of whether or not the code reading operation is executed. Alternatively, in the second embodiment, the constant recording operation may be set to invalid and not executed at all.

<< Third Example >>
A third embodiment of the present invention will be described. In the first embodiment or the second embodiment, the two-dimensional code to be read is shown on an external installation object (for example, a sign or a signboard on the road surface) of the vehicle CR, such as the two-dimensional code CD3 of FIG. It may be a two-dimensional code that has been created. A case in which the two-dimensional code CD3 is photographed by the camera 2 and the photographed image of the camera 2 includes the two-dimensional code CD3 is referred to as a case α1 for convenience.

A combination of the case α1 and the mode switching of FIG. 9 shown in the first embodiment (hereinafter referred to as the first combination) will be described. Since the code reading operation is stopped when the data processing unit 11 is operating in the recording mode due to the vehicle CR traveling, the two-dimensional code CD3 is included in the shooting area of the camera 2. The CD3 has no effect on the operation of the in-vehicle system SYS. On the other hand, in the case α1 according to the first combination, when the data processing unit 11 is operating in the code reading mode due to the stop of the vehicle CR, the code reading operation is executed, and the navigation device 8 receives the result of the code reading operation. A notification based on the information embedded in the dimension code CD3 (hereinafter referred to as notification α2) is given to the user. At this time, the data processing unit 11 alone executes the first to fourth element operations, or the data processing unit 11 and the navigation device 8 cooperate to execute the first to fourth element operations. , The information embedded in the two-dimensional code CD3 is extracted and recognized.

A combination of the case α1 and the second embodiment (hereinafter referred to as a second combination) will be described. Since the code reading operation is stopped during the code reading stop period shown in FIG. 10 or FIG. 11, even if the two-dimensional code CD3 is included in the shooting area of the camera 2, the two-dimensional code CD3 operates the in-vehicle system SYS. Has no effect on. On the other hand, in the case α1 related to the second combination, the code reading operation is executed in a period other than the code reading stop period, and the navigation device 8 receives the result of the code reading operation and notifies based on the information embedded in the two-dimensional code CD3. α2 is performed on the user. At this time, the data processing unit 11 alone executes the first to fourth element operations, or the data processing unit 11 and the navigation device 8 cooperate to execute the first to fourth element operations. , The information embedded in the two-dimensional code CD3 is extracted and recognized.

Regarding the first and second combinations, the result of the code reading operation provided from the drive recorder 1 to the navigation device 8 is the result of the first and second element operations (after the image processing by the second element operation) as described above. It can be the result of the first to third element operations (image data of the code partial image), or the result of the first to fourth element operations (information embedded in the two-dimensional code CD3). Extraction and recognition results).

The notification α2 is a visual notification using the display unit 8b, an auditory notification using the speaker 8c, or a combination thereof. The content of the notification α2 varies depending on the information embedded in the two-dimensional code CD3. For example, in the notification α2, the character information embedded in the two-dimensional code CD3 is displayed on the display unit 8b or is output as voice from the speaker 8c. As the text information, advertising information of a product or a shop (for example, advertising information such as "there is an ABC burger shop 1 km away"), road information, and the like can be considered. When the information embedded in the two-dimensional code CD3 includes character information indicating a URL (Uniform Resource Locator), the control unit 8a accesses the resource specified by the URL through the communication unit 8d. The information (image information and audio information) provided from the resource is acquired, and the acquired information is displayed on the display unit 8b or the audio is output from the speaker 8c. The information provided by the resource is arbitrary, but may be, for example, advertising information as described above.

In this way, by using the camera 2 for the drive recorder 1 to read and notify the two-dimensional code outside the vehicle, it is possible to provide various advertising information and the like to the user. This can bring various merits such as improvement of user convenience and promotion of use of commercial services.

<< Fourth Example >>
A fourth embodiment of the present invention will be described.

Although a two-dimensional code is mainly assumed as the code to be read, the code in the present invention may be a one-dimensional code, a two-dimensional code, or any pattern that is not classified into a one-dimensional code and a two-dimensional code. It may be a code.

The drive recorder 1 includes a data recording device according to the present invention. The data recording device according to the present invention may be configured in another device not classified in the drive recorder 1. It may be considered that the camera 2 is included in the components of the data recording device according to the present invention.

The embodiments of the present invention can be appropriately modified in various ways within the scope of the technical idea shown in the claims. The above embodiments are merely examples of the embodiments of the present invention, and the meanings of the terms of the present invention or each constituent requirement are not limited to those described in the above embodiments. The specific numerical values shown in the above description are merely examples, and as a matter of course, they can be changed to various numerical values.

SYS in-vehicle system 1 drive recorder 2 camera 3 microphone unit 4 operation unit 5 GPS processing unit 6 vehicle sensor unit 7 recording medium 8 navigation device 10 main control unit 11 data processing unit 12 event detection unit 13 driving discrimination unit

Claims (7)

In a data recording device that records image data based on the shooting results of a camera installed in a vehicle on a predetermined recording medium.
A running determination unit that determines whether the vehicle is running or stopped based on information that depends on whether the vehicle is running or not.
Based on the discrimination result of the traveling discriminating unit, a processing unit that operates in the first mode while the vehicle is traveling and operates in the second mode while the vehicle is stopped is provided.
The processing unit can execute a code reading operation for reading a code included in a captured image of the camera, and in the first mode, the code reading operation is stopped while the recording medium of the image data. A data recording device characterized in that the recording operation is executed or permitted, and in the second mode, the code reading operation is executed while the recording operation is stopped. In a data recording device that records image data based on the shooting results of a camera installed in a vehicle on a predetermined recording medium when a predetermined event occurs.
Data characterized in that a code reading operation for reading a code included in a captured image of the camera can be executed, and the code reading operation is stopped until a predetermined time elapses after the occurrence of the event is detected. Recording device. An event detection unit that detects the presence or absence of the event, and an event detection unit.
When the occurrence of the event is detected, a processing unit that sets an event recording period including the detection timing of the occurrence of the event and performs an event recording operation of recording the image data during the event recording period on the recording medium. , Equipped with
The code reading operation is executed by the processing unit, and the code reading operation is executed.
The data recording device according to claim 2, wherein the processing unit stops the code reading operation when the occurrence of the event is detected, at least until the end of the event recording period. In the code reading operation, the result of the code reading operation is output to an external device.
When the code reading operation is executed by the processing unit when the image captured by the camera contains a code indicating the position information, the destination based on the position information is received by the external device in response to the result of the code reading operation. The data recording device according to any one of claims 1 to 3, wherein the navigation operation set in is executed. In the code reading operation, the result of the code reading operation is output to an external device.
The code includes the code shown on the external installation of the vehicle.
When the code shown in the installation object outside the vehicle is included in the captured image of the camera and the code reading operation is executed by the processing unit, the external device receives the result of the code reading operation. The data recording device according to any one of claims 1 to 3, wherein the notification based on the code is performed. In a data recording method for recording image data based on the shooting results of a camera installed in a vehicle on a predetermined recording medium.
A running determination step for determining whether the vehicle is running or stopped based on information depending on whether the vehicle is running or not.
Based on the determination result of the travel determination step, a processing step that operates in the first mode while the vehicle is traveling and operates in the second mode while the vehicle is stopped is provided.
In the processing step, a code reading operation for reading a code included in a captured image of the camera can be executed, and in the first mode, the code reading operation is stopped while the recording medium of the image data is executed. A data recording method comprising executing or permitting a recording operation on a camera, and stopping the recording operation while executing the code reading operation in the second mode. In a data recording method in which image data based on the shooting results of a camera installed in a vehicle is recorded on a predetermined recording medium when a predetermined event occurs.
Data characterized in that a code reading operation for reading a code included in a captured image of the camera can be executed, and the code reading operation is stopped until a predetermined time elapses after the occurrence of the event is detected. Recording method.

Images