foss4g 2017 boston locationtech; big data at the heart of geospatial innovation

14
Big Data at the Heart of Geospa1al Innova1on (and Loca1onTech) Marc Vloemans Director Ecosystems Eclipse Founda1onLoca1onTech FOSS4G 2016, Boston

Upload: marc-vloemans

Post on 23-Jan-2018

106 views

Category:

Software


2 download

TRANSCRIPT

Page 1: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Big  Data  at  the  Heart  of  Geospa1al  Innova1on  (and  Loca1onTech)  

Marc  Vloemans  Director  Ecosystems  Eclipse  Founda1on-­‐Loca1onTech  FOSS4G  2016,  Boston  

Page 2: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Eclipse  Founda1on  

FOSS4G  2017   2  

•  One  of  the  top  open  source  founda1ons  •  Organiza1onal  and  individual  members  •  Collabora1ng  on  innova1ve  technology  •  >330  open  source  projects  And  we  are  growing  towards  •  ‘A  community  of  communi1es’  •  Focus  on  industry  sectors  and  markets  •  Industry  Working  Groups  

Page 3: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Eclipse  Founda1on  and  Loca1onTech  

•  Eclipse  Industry  Working  Groups  (IWG)  •  collaborate  and  innovate  on  the  crea1on  of  commercially  friendly  technology,  specifica1ons  and  best  prac1ces  for  a  specific  industry  or  market.  

FOSS4G  2017  

Page 4: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

What  we  do  

FOSS4G  2017  

Page 5: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Loca1onTech  

•  Partner  of,  among  others  OGC,  OSGeo  (FOSS4GNA,  projects,  sponsoring)  

•  More  than  just  a  community  of  developers  •  An  ecosystem  of  service  suppliers,  projects  and  end-­‐user  organiza1ons  

•  Collabora1ve  market  development  for  OS  geospa1al  •  Commercially  friendly  temporal-­‐spa1al  aware  so\ware  

•  Special  focus  on  Big  Geospa1al  Data  

FOSS4G  2017  

Page 6: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Focus  

•  Mission  •  To  be  the  interna1onal  pla]orm  for  sustainable  technical  and  commercial  collabora1on  for  open  geospa1al  

•  Focus  •  Commercial  and  technical  value  add  to  members  •  Diversity  of  end-­‐users  and  partnerships  •  Big  Geospa1al  Data  tools  and  applica1ons  

•  Strategic  execu1on  •  Recruit  projects  for  por]olio  gaps  (e.g.  3D,  Geocoder)  •  Create  projects  in  house  (JTS2,  RPE)  •  Increase  and  broaden  the  user-­‐base  

FOSS4G  2017  

Page 7: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

The  Loca1onTech  Working  Group  Steering  Commi,ee  Member  

Par1cipa1ng  Member  

Guest  (Academic)  Member  

FOSS4G  2017  

Page 8: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

The  future  is  Big  Geospa1al  Data  

•  Sensors,  satellites  and  social  networking  •  20%  growth  rate  per  year  

•  The  80-­‐20  rule  •  The  geospa1al  component  

•  Ac1onable  intelligence  •  monitor,  manage,  interpret,  edit  

•  The  limits  of  open  spa1al  components  and  tools  •  Volume,  velocity,  variability    

FOSS4G  2017  

Page 9: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Loca1onTech  GeoMesa  

FOSS4G  2017  

•  A  collec1on  of  libraries  and  modules  which  can  be  used  to  solve  Big  Geospa1al  Data  challenges.  

•  Management  of  billions  to  trillions  of  vector  data  • Well  suited  for  streaming  vector  data  •  Spark  SQL  support  •  Improved  support  for  HBase  and  Cassandra  backends  •  New  Cloud  Storage  support  (S3,  Azure  Blobstore,  etc)  

Page 10: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Loca1onTech  GeoWave  

•  A  so\ware  library  connec1ng  scalability  of  distributed  compu1ng  frameworks  and  key-­‐value  stores  with  modern  geospa1al  so\ware  to  store,  retrieve  and  analyze  big  geospa1al  datasets.  

•  Scalabel  design  •  Interac1ve  1me  and/or  loca1on  specific  queries  •  Mul1-­‐dimensional  indexing  to  ao.  Accumulo,  HBase,  BigTable  

•  GeoServer  plugin  to  share  and  visualize    geospa1al  data  in  a  GeoWave  datastore  via  OGC  standard  services  

FOSS4G  2017  

Page 11: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Loca1onTech  GeoTrellis  

•  A  framework  to  process  large  and  small  data  sets  with  low  latency  by  distribu1ng  the  computa1on  across  mul1ple  threads,  cores,  CPUs  and  machines.  

•  ability  to  rapidly  process  and  distribute  processing  of  raster  data  •  data  import  and  conversion  tools  for  the  ARG  data  structure  •  designed  to  help  create  simple,  standard  REST  services    

FOSS4G  2017  

Page 12: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

Loca1onTech  GeoGig  

•  A  Distributed  Version  Control  System          specially  designed  to  handle  geospa1al  data  efficiently.  

•  inspira1on  from  the  source  code  versioning  system  Git  •  import  raw  geospa1al  data  (currently  from  Shapefiles,  PostGIS,  MS  SQLServer,  or  Spa1aLite)  in  to  a  repository  •  every  change  to  the  data  is  tracked  •  versioning,  branched  into  sandboxed  areas,  merged  back  and  pushed  to  remote  repositories.  

FOSS4G  2017  

Page 13: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

May  2018  

FOSS4G  2017  

Page 14: FOSS4G 2017 Boston LocationTech; Big Data at the Heart of Geospatial Innovation

More  informa1on  online  

•  Online  • Website;  www.loca1ontech.org  •  Twiier;  @Loca1onTech  •  Mailinglists;  see  website  •  LinkedIn;  hips://www.linkedin.com/groups/4503139  

•  Mail  •  Thea.Aldrich@eclipse-­‐founda1on.org  (Dev.  Advocate)  •  Marc.Vloemans@eclipse-­‐founda1on.org  (Dev.  Ecosystem)  •  Paul.white@eclipse-­‐founda1on.org  (Member  Services)  

FOSS4G  2017