III Taller de Astroingeniería Santiago, Noviembre 2015

Roberto Muñoz Pontificia Universidad Católica de Chile

MetricArts

III Taller de Astroingeniería Santiago, Noviembre 2015

From Astronomy to the video analytics industry

@robertopmunoz

Como astrónomo en paila marina

@robertopmunoz

A window to the Universe

Roberto Muñoz@robertopmunoz

Northern ChileClear and dark skies

70% astronomical infrastructure

@robertopmunoz

ScienceGalaxy clusters are massive structures that contain several hundreds of galaxies. The nearest clusters are Virgo and Fornax. They are located at just a distance of 20 Mpc (65 million light years)

Ferrarese et al. 2012

Millennium simulation. Springel et al. (2005)

@robertopmunoz

TechnologyOptical and NIR astronomical observations are done using CCDs. We have been using the Dark Energy Camera (DECam) in the 4m Blanco telescope at Tololo to observe the Fornax cluster.

1

2

3

45

6

7

10

13

4m Blanco @ Tololo

DECam

Observational strategy

@robertopmunoz

Methods and algorithmsRaw images are collected at the telescope (Raw data) Images are processed in the server at PUC (Calibrated data) Analysis is done by several members of the team (Data analysis)

Raw Calibrated

NGC 1427a NGC 1427aNGC 1427a

@robertopmunoz

Data-driven science

Muñoz et al. 2015

@robertopmunoz

What scientists are doing nowadays?

@robertopmunoz

Challenges and OpportunitiesComputers are getting faster and cheaper. We have access to GPUs and multicore CPUs at an affordable price. Image processing is computationally intensive, requiring immense resources in CPU and memory throughput (See the talk by Francisco Förster). Nowadays, the challenge is improving the methods and algorithms. How to combine the CPU + GPU + FPGA.

@robertopmunoz

Video analyticsThe image quality and fidelity of surveillance cameras have drastically improved during the last years. In the past, analog cameras were the only option for business surveillance. Nowadays, IP cameras with resolutions of 5 MP are affordable. Business wants to add value to their video surveillance system: Number of customers, Average time spent in the store, Hourly distribution of customers, etc.

Video Analytics is the capability of automatically analyzing video streams to detect and determine temporal and spatial events.

@robertopmunoz

Surveillance data marketMore than 100 million of surveillance cameras disrtibuted around the world. A standard camera is generating about 5 GB per day, so there about 500 PB of video data.

@robertopmunoz

More than securityMost of the time, people and companies think that video cameras are just for recording video and then playing the video if something bad happens (robbery, accident, misconduct). Once you are able to record, store and automatically analyze video, new and interesting things start to happen. Ultimately, it’s adding value to the data.

@robertopmunoz

Local IndustryMetric Arts is a Chilean company that provides analytics and decision making consultancy services. It has offices in Chile, Perú and Panamá. They have partnership and certification with Oracle, Microsoft, Informatica and MongoDB. Their clients are mostly banks, retail, insurance and telecomunication companies. Developing the first Video Analytics service in Chile.

@robertopmunoz

CORFO I+DMetric Arts and the Institute of Astrophysics at PUC recently got awarded a CORFO project (Contrato Tecnológico para la Innovación) for developing a video analytics solution for retail stores. I’m the Scientific Director of the project. The ultimate goal of this CORFO project is to establish a partnership between PUC and MetricArts for developing ideas and exchanging knowledge. Generate economic, social, environmental and cultural impact.

@robertopmunoz

Multicamera systemThe project will have hardware and software requirements. The most important hardware components are the video cameras (Resolution and FOV) and a computer appliance (local CPU). The software will be developed by a team of researchers and developers at PUC and Metric Arts (Astronomy, Statistics and Computer Science).

@robertopmunoz

Face recognitionThe two main goals are detecting customers entering the store and following them. For privacy reasons, the only faces stored in the database are from employees. Face recognition has physical barriers (low light, angle, blocking objects) and technological challenges (CPU intensive). We are using multiple cameras with complementary line of sights and people features (sex, age, clothing)

@robertopmunoz

SummaryChile has become the capital of Astronomy and by 2020 will concentrate 70% of the world's telescope infrastructure. Current telescopes in Chile are generating hundreds of GB of data per night. Several chilean astronomers, statisticians and computer scientists are managing, processing and analyzing datasets of TB. Data Science + Big Data MetricArts and the Institute of Astrophysics at PUC got a CORFO project for developing the first Video Analytics solution in Chile. Team of researchers and developers. The Chilean Universities, Research Centers and Industries should exchange knowledge and generate stronger collaborations. Interdisciplinary, creative thinking and innovation should happen at all these places.