JP2012008802A - Monitoring system and person specification method - Google Patents

Abstract

An improvement of a personal authentication method and a mechanism for managing specific actions of a person to be authenticated are realized.
According to an embodiment, a monitoring system includes an authentication controller and an image recognition server. The authentication controller executes an authentication process based on the authentication information received from the authentication terminal by electric field communication. The image recognition server acquires an image of a shooting area shot by the camera and recognizes a person included in the shooting area. The image recognition server executes a person specifying process for collating an image recognized person and a person authenticated by the authentication controller based on the position information of the authentication terminal and the coordinate information of the photographing area of the camera.
[Selection] Figure 1

Description

  Embodiments described herein relate generally to a monitoring technique using captured images and electric field communication.

  In recent years, high security levels are required in data centers, various factories such as food processing and pharmaceuticals. For this reason, various systems called monitoring systems and security management systems have been proposed in order to ensure and manage a high level of security.

  Conventionally, an entrance / exit management system for managing entrance / exit for each building or room is well known. The entrance / exit management system manages a combination of a personal authentication device and a security gate so that only authorized persons can enter and exit designated areas (buildings, rooms, etc.). In other words, the entry / exit management system can exclude entry of unauthorized persons.

  Conventionally, there is a well-known video surveillance system in which a surveillance camera for photographing a person passing through a security gate is arranged and a person entering and leaving the room is monitored by an image photographed by the surveillance camera.

JP 2007-303239 A

  In the above-described entrance / exit management system, for example, it is impossible to grasp what action or activity a person who enters an area with a high security level performs. On the other hand, as a personal authentication device, a system using an IC card, an authentication function using a fingerprint / vein / iris, an RFID tag, or a face authentication function is generally used. Both methods require an act of accessing the authentication terminal by the user and are bothersome. In addition, when there are a plurality of persons to be authenticated, it is extremely difficult to specify an individual due to a problem of position specifying accuracy in a method using wireless communication such as an RFID tag. In addition, in the method using the face authentication function, there is a problem that a personal identification mechanism is not established if a mask that is essential in a clean room or the like is worn.

  Therefore, improvement of the personal authentication method and realization of a mechanism for managing the specific behavior of the person to be authenticated are required.

  According to the embodiment, the monitoring system includes an authentication unit, an image recognition unit, and a person specifying unit. The authentication unit executes an authentication process based on the authentication information received from the authentication terminal by electric field communication. The image recognizing means acquires an image of the shooting area shot by the camera and recognizes a person included in the shooting area. The person specifying means collates the person recognized by the image recognition means and the person authenticated by the authentication means based on the position information of the authentication device and the coordinate information of the photographing area.

The figure for demonstrating the structure of the monitoring system regarding embodiment. The figure for demonstrating the specific example of the calibration regarding embodiment. The figure for demonstrating the specific example of the calibration regarding embodiment. The figure for demonstrating the specific example of the calibration regarding embodiment. The timing chart for demonstrating operation | movement of the monitoring system regarding embodiment. The flowchart for demonstrating operation | movement of the monitoring system regarding embodiment. The figure for demonstrating the application example of the monitoring system regarding embodiment.

  Embodiments will be described below with reference to the drawings.

[System configuration]
FIG. 1 is a diagram for explaining the configuration of the monitoring system of the present embodiment.

  As shown in FIG. 1, the monitoring system of the present embodiment is a system that monitors a designated area (area such as a room or a passage) in a building, and includes a network (LAN) 10, an image recognition server 11, and a monitoring system. It has a camera 12 and an authentication controller 13.

  The image recognition server 11 acquires an image captured by the monitoring camera 12 via the network 10 and executes an image recognition process for detecting a person existing in the imaging area of the monitoring camera 12. As will be described later, the image recognition server 11 cooperates with the authentication controller 13 and executes image processing for specifying an authenticated person.

  The authentication controller 13 executes an authentication process for the person 100 based on authentication information transmitted from the portable authentication terminal (or authentication tag or authentication card) 14 via the network 10. The authentication terminal 14 transmits the authentication information stored in the internal memory by so-called electric field communication.

  In the present embodiment, as shown in FIG. 1, for example, a door knob 21 attached to a door 20 of a room, a mat carpet or a specific area 22 of a floor, or a seat surface 23 of a chair is set as a place for performing personal authentication. Antennas (receivers) 15 to 17 for receiving electric field communication are arranged or embedded. These antennas 15 to 17 are connected to the network 10, and transmit authentication information transmitted from the authentication terminal 14 to the authentication controller 13.

  Here, the electric field communication is a communication technique for performing data communication using an electric field generated on the surface of a human body or an object. The human body has a weak electric field when an AC signal source is in close proximity. In electric field communication, data communication is performed in response to the slight change in electric field.

  In the present embodiment, the person 100 carries the authentication terminal 14 in advance, so that a weak electric field change corresponding to transmission data (authentication information) from the authentication terminal 14 occurs in the human body of the person 100. When the person 100 comes into contact with the door knob 21, stands on the carpet 22, or sits on the seat surface 23 of the chair, the antennas 15 to 17 close to the person 100 detect a weak electric field.

[System Operation]
Hereinafter, the operation of the system of the present embodiment will be described with reference to FIGS.

  First, as shown in FIG. 1, it is assumed that, for example, an entrance area of a room in which a high security level is set is captured by the monitoring camera 12 as a designated monitoring area in the building. At this time, when the person 100 approaches the entrance area and enters the shooting area by the monitoring camera 12, the image recognition server 11 acquires the video shot by the monitoring camera 12. The image recognition server 11 executes high-accuracy image analysis processing, and executes image recognition processing for detecting a person existing in the imaging region (S1 in FIG. 5).

  The image recognition server 11 stores the detected person image in a storage device and displays and outputs the person image on a display screen of a video monitoring device (not shown). By this monitoring operation, the operator can confirm the person 100 approaching the entrance area on the display screen.

  On the other hand, as shown in FIG. 6, when the person 100 contacts the door knob 21 of the room to be monitored or stands on the carpet 22 in the entrance area, the authentication terminal 14 and the authentication controller 13 carried by the person 100 are shown. Electric field communication is performed between the two (step S11).

  That is, as shown in FIG. 5, the authentication information 140 is received from the authentication terminal 14 by an antenna (here, 16) by electric field communication and transmitted to the authentication controller 13. The authentication controller 13 acquires identification information (ID information) 141 for identifying an individual included in the authentication information 140 and position information 142 indicating the position of the antenna 16. The position information 142 is coordinate information and area information as will be described later.

  The authentication controller 13 executes an authentication process (personal identification process) of the person 100 based on the ID information 141 (S2). The authentication controller 13 transmits the attribute information 143 of the person 100 to the image recognition server 11 according to the authentication processing result. The attribute information 143 includes personal identification information and information indicating an authentication result corresponding to the security level. Further, the authentication controller 13 transmits position information 142 indicating the position of the antenna 16 (corresponding to the position of the authentication terminal 14) to the image recognition server 11.

  In the present embodiment, the image recognition server 11 cooperates with the authentication controller 13 to execute processing for specifying the person photographed by the monitoring camera 12 as the authenticated person 100 (step S13). This will be specifically described below.

  Based on the position information 142 from the authentication controller 13, the image recognition server 11 calibrates the coordinates of the image (video) taken by the monitoring camera 12 and the position of the antenna 16 (the position of the authentication terminal 14) ( Alignment processing) is executed (S3 in FIG. 5 and step S12 in FIG. 6).

  As a specific example of calibration, as shown in FIG. 2A, the position of the antenna 16 is recognized in world coordinates (X, Y). The image recognition server 11 performs alignment processing between the world coordinates (X1, Y1) indicating the position of the antenna 16 (position of the authentication terminal 14) and the image coordinates (u1, v1) of the person 100. Here, as shown in FIG. 2B, the image coordinates (u, v) are coordinates of an image (video) taken by the monitoring camera 12. The image recognition server 11 obtains the image coordinates (u1, v1) of the person 100 detected from the shooting area in the image coordinates (u, v).

  As a specific example of calibration, the position of the antenna 16 is recognized in local coordinates (x, y) as shown in FIG. The image recognition server 11 aligns the local coordinates (x1, y1) indicating the position of the antenna 16 (the position of the authentication terminal 14) with the image coordinates (u1, v1) of the person 100 shown in FIG. Execute the process.

  Furthermore, as a specific example of calibration, as shown in FIG. 4A, the position of the antenna 16 is recognized in the area position information (A to F). The image recognition server 11 aligns the area position information (B) indicating the position of the antenna 16 (the position of the authentication terminal 14) with the image coordinates (u1, v1) of the person 100 shown in FIG. Execute.

  Next, the image recognition server 11 generates meta information in which an image (video) related to the person 100 aligned by calibration and the attribute information 143 of the person 100 authenticated by the authentication controller 13 are associated with each other, and the storage device (S4 in FIG. 5). The meta information includes, for example, the frame number of the image photographed by the monitoring camera 12, the photographing time, the image coordinates of the detected person 100, and the attribute information 143 of the person 100.

  Further, the image recognition server 11 superimposes and displays the attribute information 143 of the person 100 included in the meta information when the captured image of the person 10 is displayed and output on the display screen of the video monitoring apparatus ( S5 in FIG. However, the image recognition server 11 selects whether to superimpose and display the attribute information 143 according to an input from the operator.

  As described above, according to the present embodiment, automatic personal authentication is performed by linking the authentication processing using electric field communication and the image recognition processing using the monitoring camera 12, and within the monitoring area. A monitoring system that can confirm the position and action of an authenticated person can be realized.

  Specifically, in an authentication method using electric field communication, automatic authentication processing can be performed without requiring a user's particularly conscious operation among natural actions such as stepping, sitting, and touching. . In the conventional authentication method, a conscious action for authentication is required for the user at a fixed position. In addition, when a glove, a mask, goggles, or the like is attached, conventional personal authentication methods such as biometric authentication and face authentication, which have been difficult to authenticate, can be improved.

  Furthermore, the conventional authentication method using wireless communication cannot grasp the exact position of the person to be authenticated. For example, even in an area whose access is controlled by a security gate, the position of an authenticated person cannot be specified in the area. On the other hand, if it is the authentication method using the electric field communication of this embodiment, it becomes possible to pinpoint the position of the person of authentication object correctly.

  Furthermore, the system of the present embodiment identifies an authenticated person within the imaging region by aligning the position of the person authenticated by the authentication process using electric field communication and the image coordinates in cooperation with the image recognition process. It is possible to track. For this reason, the position and action of the authenticated person can be visually confirmed on the screen.

  Further, according to the cooperation method of this embodiment, it is possible to superimpose the attribute information of the person detected in the shooting area on the image shot by the monitoring camera and display it on the screen. This makes it possible not only to determine whether or not the person is a familiar person from the captured image, but also to enable various monitoring operations such as discovery of individual behavior and deviant behavior based on attribute information assigned according to the security level and area. Become. This facilitates detection of the presence of an unauthenticated person and identification of a belonging person who should not be on the security level. As a result, the burden on the supervisor can be reduced.

  Furthermore, an unauthenticated person who does not have the authentication tag 14 can be monitored by a captured image of the monitoring camera 12. In particular, it is possible to track a person who intentionally avoids authentication as a suspicious person based on a captured image of the monitoring camera 12. In addition, even when electric field communication fails, it is possible to use the result of person tracking based on a captured image and hold information on the previous state where authentication was successful.

  In the case of such a monitoring system according to the present embodiment, for example, in the case of a manufacturer who is authenticated by detecting a person approaching the production line in a production line that requires a high level of security, such as food or medicine. The manufacturer can be managed based on the attribute information.

  In addition, by including time information in the authentication information, it is possible to control the security level in a timely manner. For example, it is possible to distinguish between a person who can approach the production line and a person who cannot be permitted according to the production time of the food or medicine to be handled. Alternatively, management is simply performed in a time zone. For example, if a VIP person enters the conference room, the security level of the entrance area of the conference room in the time zone can be increased.

  As a modification of the present embodiment, the arrangement area of the antennas 15 to 17 is limited, and the image recognition server is used for authentication acquired from the antennas 15 to 17 in the image recognition result of the shooting area where the antenna is not arranged. The superimposition on the screen may be maintained by inheriting the attribute information based on the information. Thereby, the arrangement area of the antennas 15 to 17 can be saved.

[Application example]
FIG. 7 is a diagram illustrating an application example in which the monitoring system of the present embodiment is applied to the security system 300.

  The security system 300 includes an image analysis unit 301, an electric field communication unit 302, and an abnormality detection unit 303, and manages the security of a designated management area 200. Specifically, the image analysis unit 301 executes processing corresponding to the image recognition server 11 and executes image analysis processing of videos captured by the plurality of monitoring cameras 12. The electric field communication unit 302 executes authentication processing corresponding to the authentication controller 13 and receives authentication information with the authentication tags 14A to 14C by electric field communication. Based on the image recognition result of the image analysis unit 301 and the authentication result of the electric field communication unit 302, the abnormality detection unit 303 detects the position of an unauthorized person other than the authorized person or a suspicious person in the management area 200. Do.

  The security system 300 records video and abnormality information captured by the monitoring camera 12 in the image recording device 310. The security system 300 controls the warning device 311 and outputs abnormality information by voice or the like based on the processing result of the abnormality detection unit 303. The security system 300 is connected to a communication device 312 that contacts a guard, and transmits information indicating the position of a person and the behavior of a suspicious person. The security system 300 is connected to the entry / exit system 400, the security system 401, and the operation system 402, and provides abnormality information to each.

  In this application example, the security system 300 uses the electric field communication unit 302 to authenticate as an authorized person in the management area 200 through electric field communication (antenna 16) with the authentication tag 14A carried by the person 100A, for example. . Whether the security system 300 is a person permitted in the management area 200 by electric field communication with the authentication tag 14C carried by the electric field communication unit 302 when the person 100C approaches the antenna 16, for example. Authenticate whether or not.

On the other hand, the security system 300 uses the electric field communication unit 302 to recognize the person who is not permitted in the management area 200 by electric field communication with the authentication tag 14B carried by the person 100B, for example. Therefore, the security system 300 uses the abnormality detection unit 303 to
The photographed image of the person 100B is recorded in the image recording device 310, the security device is notified by the communication device 312, and the warning device 311 is used to warn the person. In this case, the security system 300 can also prohibit the person 100 </ b> B from leaving the management area 200 by providing abnormality information to the entry / exit system 400.

  In addition, the security system 300 monitors an unauthenticated person 110 that cannot be authenticated by the electric field communication unit 302 as a suspicious person in the management area 200. Specifically, the security system 300 detects the person 110 in the imaging area by analyzing the images captured by the plurality of monitoring cameras 12, and tracks the behavior of the person 110. The abnormality detection unit 303 notifies the security staff of behavior information of the suspicious person via the communication device 312, and provides the abnormality information to the entry / exit system 400 to prohibit the suspicious person 110 from leaving the management area 200. In addition, the abnormality detection unit 303 provides monitoring information such as a captured image of the suspicious person 110 as abnormality information to the security system 401.

  Further, in the cooperation between the security system 300 and the operation system 402, a work plan is received from the operation system 402, authority is set for each person, and the setting contents are compared with the person photographed by the monitoring camera. The abnormality is detected, and the position and time are provided to the operation system 402 as abnormality information. It is possible to manage not only the abnormal information but also all access to the operation system, and manage it as an access history including normal work by providing the information and storing and searching the access history in the database. It becomes possible. The information provision level (only when an abnormality occurs or all events) can be set or determined by the user based on, for example, the quality of goods handled by the operation system.

  As described above, by applying the monitoring system of the present embodiment to the actual security system 300, the authority for the management target is individually set, and the strict management and abnormal behavior of the person in the management area are automatically performed. It becomes possible to detect. Specifically, the abnormal state can be automatically detected by checking the position and authority (permission) of the person. In this case, it is possible to track abnormal persons such as unauthorized persons and suspicious persons with captured images, and to inform the guards of the position and behavior information of these persons.

  In addition, the movement of a suspicious person can be restricted by linking with an entrance / exit system or a security system. In the conventional system, even if an abnormal person is found, for example, it is difficult for a monitor to monitor a large number of security camera images over a long period of time. In contrast, the security system 300 to which the monitoring system of the present embodiment is applied can automatically track abnormal behavior.

  A part of attribute information (security level) is set in advance in the antenna 16, and the electric field communication unit 302 includes a part of attribute information set in the antenna 16 and a part of authentication information (security). Level), and determination of permission or non-permission may be performed based on the result of matching. In the case where this determination is not permitted, the abnormality detection unit 303 can warn the person by the warning device 311 and stop the work in the management area 200 or the like.

  In addition, when the authentication information authenticated by the electric field communication unit 302 includes information for designating an area where the person can move and a movement route in advance, the abnormality detection unit 303 displays the processing result in the image analysis unit 301. Based on the above, it is determined whether or not it is possible to enter the designated area in the management area 200. The anomaly detection unit 303 can execute a warning for prohibiting the work in a case where a person has entered an unauthorized area and can notify the monitoring staff.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 10 ... Network (LAN), 11 ... Image recognition server, 12 ... Surveillance camera,
13 ... Authentication controller, 14 ... Authentication terminal (or authentication tag, authentication card),
15, 16, 17 ... antenna, 300 ... security system,
301: Image analysis unit 302: Electric field communication unit 303: Abnormality detection unit

Claims (10)

Authentication means for executing authentication processing based on authentication information received from an authentication terminal by electric field communication;
Image recognition means for acquiring an image of a shooting area shot by a camera and recognizing a person included in the shooting area;
And a person identifying unit that collates the person recognized by the image recognition unit and the person authenticated by the authentication unit based on the position information of the authentication terminal and the coordinate information of the imaging region. Monitoring system. A receiving unit arranged in a designated area and receiving the authentication information by electric field communication with the authentication terminal;
The authentication means includes
Based on the authentication information received by the receiving means, it is configured to execute an authentication process of a person carrying the authentication terminal and output position information of the authentication terminal. The monitoring system according to claim 1. The person specifying means is:
Performing alignment processing of the person recognized by the image recognition means and the person authenticated by the authentication means based on the position information of the authentication terminal and the coordinate information of the imaging region;
Based on the alignment processing result, the person in the photographing area is identified as the authenticated person, or the person in the photographing area is identified as an unauthenticated person. The monitoring system according to any one of claims 1 and 2. The authentication means includes
4. The apparatus according to claim 1, wherein attribute information for identifying an authenticated person is generated based on an authentication result of the authentication process and provided to the person specifying unit. The monitoring system according to any one of the above. Means for outputting an image of the photographing area including the person recognized by the image recognition means on a display screen;
The person specifying means is:
The apparatus includes: means for displaying the attribute information superimposed on an image of the shooting area on the display screen when a person in the shooting area is identified as the authenticated person. 4. The monitoring system according to 4. The authentication terminal is:
6. The device according to claim 1, further comprising an electric field communication tag or an electric field communication card that includes a memory that stores the authentication information and transmits the authentication information through electric field communication. The monitoring system described in. The person specifying means is:
Means for superimposing and displaying the attribute information on the image of the shooting area on the display screen when the person in the shooting area is identified as a person authenticated outside the shooting area. The monitoring system according to claim 5, wherein The receiving means is pre-set with attribute information necessary for authentication processing,
The authentication means includes
3. The apparatus according to claim 2, further comprising means for collating the attribute information set in the receiving unit with the authentication information received by the receiving unit and determining an authentication result based on the collation result. Monitoring system.   Means for executing predetermined abnormality processing when the person recognized by the image recognition means is a person who does not conform to the authentication result by the authentication means or an unauthenticated person based on the collation result of the person specifying means; The monitoring system according to any one of claims 1 to 8, wherein A person identification method applied to a monitoring system having authentication means using electric field communication and image recognition means using a camera,
Processing for executing authentication processing based on the authentication information received from the authentication terminal by the authentication means;
Processing for recognizing a person from the imaging region of the camera by the image recognition means;
And a process of collating the person recognized by the image recognition unit with the person authenticated by the authentication unit based on the position information of the authentication terminal and the coordinate information of the photographing area. Person identification method.

Images