How Smart Algorithms are a Game Changer in Video Surveillance and Access Control


To many, AI-powered Surveillance may sound like the plot of a futuristic Hollywood movie. The technology, however, is no longer science fiction. Video-based Artificial Intelligence systems can recognize objects, humans, and biological characteristics like faces, the iris or even emotions and behaviour. They can be customized to specific recognition requirements like a-normal behaviour in crowds, unaccompanied children or emergencies and can be embedded into any surveillance landscape. They can even recognize specific characteristics of objects and detect  manipulations. AI technology allows law enforcement and first responders to quickly act on information during an emergency. In the near future AI powered surveillance will play an important role in crime prevention as well as emergency responding.

But how exactly are AI surveillance systems so dramatically different from existing video or surveillance approaches?

Well, essentially it is the speed and the accuracy at which they operate. While traditional surveillance systems require humans looking out for suspicious behaviour on CCTV screens or crawling through hours of recorded footage for a single perpetrator or a specific moment, AI can bypass these limitations. The technology searches for specific traits, patterns or anomalies in real-time and at a rate that humans could never meet. In a time where many advocate better monitoring and more surveillance cameras, more and more video footage is being produced. Human capacity limitations and abilities can be restrictive while smart algorithms will never get tired or bored, they can work 24/7 and they will never miss a detail. This makes artificial intelligence ideal for identifying threats or emergencies at a moment´s notice.

Protecting Large Scale Events, Publicly Accessible Space, Infrastructure

With growing and changing threats to normal life and activities as witnessed across European cities and indeed around the globe, the demand for more effective surveillance gets louder and more essential.

Ensuring the safety of individuals attending large scale events gets more challenging and complex. Organizers of such events have to take a much wider range and unprecedented scope of terrorist methodologies into account. These include hostile actors using firearms and vehicles as weapons but also abandoned objects like suitcases placed in an airport lobby which might hide a bomb. Even alterations to objects may result in substantial damage to individuals: As an example, Cash trapping, which, like it sounds, blocks an ATM’s cash dispenser shutter so that bills cannot be presented, is a constant threat. Smart algorithms can improve ATM hardware security by instantly detecting manipulations on the ATM via a standard surveillance camera mounted in the ATM location.

Generally speaking, security controllers should understand risks holistically to both look at understanding crowds, locations and infrastructure, as well as possible perpetrators. With AI systems they can easily recognize patterns, deviations and outliers. They can foresee activities and, most importantly identify a-normal behaviour.

An example: AI-powered cameras at events can radically improve security: Unusual activity (pickpockets, riots, assaults, etc.) or trespassing can be automatically detected using behaviour patterns, allowing a quicker response time when things escalate to a crime or an emergency. Even better: AI systems can play an important role in the prevention of crimes ahead of an event.  With the pre-surveillance of a location, smart technology can recognize persons with suspicious or unusual behaviour, potentially checking out the location in order to prepare or plan their crimes. They can easily differentiate a simple stroller by from a potential perpetrator. As gait, like the iris or a finger print, is a unique biometrical identifier for each human being, leading AI solutions can even highlight suspicious persons by the way they walk.

Access Control

Also for any kind of access control AI can provide effective and smart solutions. For buildings, facial recognition is becoming the most common and critical form of recognition. Think of how today you walk through automated gates at passport control or entry in to you apartment block. Usually a photo in a database is matched against the video recording of the person requesting access. Once the AI systems recognize specific persons, doors or turnstiles/entrances open. In case an unauthorized person wants to enter, a specific signal or alarm notifies the surveillance person. Hence, the same principle: Notifications are autonomous and in real-time. Humans only come into play when a security breach happens.  An enormous gain in effectiveness and safety!

More sophisticated systems have additional advantages. As often privacy is a concern, the encryption of personal data (photos, videos) is essential. Also, there are huge quality differences when it comes to recognition capabilities. Whilst the less expensive systems can only operate in good light conditions and request the person to show his/her face full front into the camera, the more advanced systems can work reliably under adverse conditions and with the face even partially obscured by, say, sunglasses or a hat.

Whenever access systems have to meet highest standards, face recognition can also be combined with complementary recognition systems like motion analysis. Thanks to open APIs modern access control systems can be embedded into any IT environment. These intelligent solutions will soon be found in airports, in vehicles of any kind or in locations where highest security requirements must be met. Also, they might soon be a standard method in companies, simply when clocking in or out. They will make access easier and more convenient and they will play an important role in reducing location specific risks.

More Use Cases: Counterterrorism, Border Security, Activity Monitoring

Whilst a comprehensive strategy to counter crime and terrorism must incorporate many elements including diplomatic, economic, financial, law enforcement, and police instruments, AI powered recognition will certainly play a critical supportive role both in crime prevention as well as in after-event analysis. It can dramatically speed up identifying perpetrators and make crime solving easier.

  • Detect faces in real-time by running them against a police/government watch list. Already known suspects will automatically be identified
  • Existing or historic video material can be leveraged for more accurate and in-depth analysis
  • Identify unknown repeat offenders by matching video footage with faces and motions.
  • Automate the detection of unauthorised border crossings by monitoring activities (motion recognition) also with ultra-red cameras.
  • Analyse mental or physical ability to operate a machine or drive a vehicle: Detect drowsiness and intoxication. Detect unwanted behaviour, e.g. answering the phone while driving a vehicle carrying hazardous cargoes

No doubt, AI-powered video recognition will revolutionize the way in which we make locations and events more secureThere are numerous use cases for which this smart new technology can make a tremendous difference in terms of efficiency and safety. It will play an increasingly important role in every-day life, and it will become standard technology – much sooner than most of us imagine.

By | 2019-02-07T10:10:41+01:00 June 22nd, 2018|Crowd Recognition, DeepEyes Blog, Footfall, Privacy, Security, Technology|0 Comments