DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

March 4, 2020

Interagency Data Team

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Barney KrucoffChief Data Officer

Office of the Chief Technology Officer

Welcome, AgendaData team news

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Agenda

DAPR Data Request System using Microsoft DynamicsAn-Tsun Huang, Data AnalystAlexander Kitaev, Senior CIO Application DeveloperDepartment of Health Care Finance (DHCF)

Welcome, News & UpdatesBarney Krucoff, Chief Data OfficerOffice of the Chief Technology Officer

Chief Data Officer's Annual Report and Enterprise Dataset InventoryBarney Krucoff, Chief Data OfficerOffice of the Chief Technology Officer

Data ReportMario Field, Data Curation & Governance Program ManagerOffice of the Chief Technology Officer

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Tableau Public Production @

version 2019.4.2

8 Agency websites in

production with ~75 embedded

Tableau Reports/Dashb

oards

Tableau Test/Dev

version 2019.2.4

Login based license management(LBLM)

Tableau server for R and Rserve testing

MIT kerberos ticket authentication for

Hadoop

Whitelist DDOT's Wiki page & MapBox

Tableau Site Administrator

quarterly meeting

Next meeting: end March,

2020

Business Intelligence - Tableau Updates

Tableau Internal

Production @ version

2019.2.4

Next update: 2020.1.1 in late

April

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

MicroStrategy Production @ version 2019 Update 3

Version 2020 will be upgraded in the coming months with new physical server implementation.

Business Intelligence - MicroStrategy Updates

Lower MicroStrategy Environments 2019 Update 3

Enterprise/Self Service

Development Test QA

MicroStrategy Public/SharePoint

DGS SharePoint live

DBH SharePoint in progress

Guidelines are available now

MicroStrategy Stake Holders Meeting

Next meeting will be schedule in Spring 2020

@ OCTO, 200 I Street SE.

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Big Data and Data Integration Updates

New Data Scientist at OCTO

• Welcome Tomash Bukowiecki!

• Assisting agencies with Data Science projects

• Still chair of the Data Science @ DC group – new schedule coming soon!

Data in DC (formerly Data Lake Search) - https://data.in.dc.gov

• Enabling Single Sign-On and Two Factor Authentication for tools

• Help Docs connecting to the DC Data Lake and FAQs about the Data Lake

• Improved Search Layout

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

GIS / Data Science User Meeting

•GIS – March 20th (Via WebEx) contact Eva.Reid@dc.govTopics: DOEE/USGS GIS Collaborations; ESRI Conference roundup

•Data Science @ DCNew Schedule Coming Soon!Location: OCTOTomash.Bukowiecki1@dc.gov

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Introductory training

April 1 and 2 (Full)

New dates coming soon...

Tableau Training

https://octo.in.dc.gov/service/tableau-training-courses

Intermediate training

March 19 and 20 (Two seats left!)

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Introductory training• March 17 and 18

• New dates will be released soon

MicroStrategy Training

https://octo.in.dc.gov/service/microstrategy-introductory-training

Architect/Developer training• Next training in early summer

• By invitation only

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

232 ArcGIS Desktop (Pro): March 25th

230 Overview DC GIS Services: April 1st

233 ArcGIS Online: April 8th

GIS Training

• Requires access to PeopleSoft• More information: https://octo.in.dc.gov/service/enroll-gis-training

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Mario FieldData Curation Program Manager

Office of the Chief Technology Officer

Data Report

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

ArcGIS Server Production UpgradeApril 2 to 6, 2020

ESRI Desktop License Managermoving to support 10.8 Desktop

ArcGIS Pro 2.5 is now available. If already installed, visit About -Software Update

Geographic Information Systems - DC GIS

ArcGIS Portal

Successfully established and tested DR Failover

Orthophoto/Aerial ImageryFlown April 23rd, 2019, now posted to Open Data DC (LINK)

New Planimetric BasemapLayers posted to Open Data DC (LINK)

i,e. St. Elizabeth campus, 3rd Street tunnel and more!

NearMap (DDOT)

Flown Feb 21, 2020Available now (DDOT Only*)

Opportunities for partnership to enable access to additional tools:

3D buildingsObliques

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

2019 Aerial and Basemap LayersThis image shows new, updated, and removed buildings between April 2017 and April 2019. Areas of change include the Wharf, the Capital River Front, and Buzzard’s Point.

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

2019 Aerial and Basemap

This image shows new, updated, and removed buildings between April 2017 and April 2019 at the St. Elizabeth's East Campus

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

New Datasets• All available at

opendata.dc.gov

• Published since last meeting, 10/16/2019

• Contributors: DC Health, DMV, OCTO, OP, DLSBD, DDOT

DC AIDS Drug Assistance Program 2019 Planimetrics

Driver's LicenseFOIA Cumulative Report Data –FY2019

Identification Card Lookup Tables

Customer Disability Placard Robust Retail Grant Recipients

Personalized Plate Historic Preservation Easements

Reciprocity Parking Permit RWIS Road SensorsConvictions DC Equity Emphasis Areas

Vehicle Inspections FY2003-2019 WMATA Priority Corridor Network Routes

District Boards Commissions and Councils

Dockless Bikes and Scooter Georgetown Geofence Parking

Land Boundary ChangesDockless Bikes and Scooter Georgetown Geofence

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Citywide Domain Lookup TablesDatabase tables and services designated by the CDO that provide a standard source of values to be used across District information systems and data transformations. For example, the CDO could designate a table as containing the official list of agency names and abbreviations and promote use of the table by other systems.

Address Police Service Area

Advisory Neighborhood Commission

Property Tax Code

Charter School Property Use Code

DC Quadrant Public Library

District Boards Commissions and Councils

Public School

District Government Agency Single Member District

Fire Alarm District Square Suffix Lot

Fire Station Ward

Police District Zoning Code

Police Sector

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Updated Data• Liquor Licenses• DC Main Street Corridors• Central Employment Area• Clean Team Service Areas• DC Property• Private Security Camera Rebate

Programs• Private Security Camera Voucher

Program• OVSJG Grant Recipients• Charter Schools• Film and Television Rebate Fund• Wetland Types• Salt Domes• Recycling Pickup Days

• Camera Enforcement Locations• Independent Schools• Public Schools• Entertainment Sports Gambling

Restriction Zone• Single Member Districts 2013• Arborist Zones• Notary Public• WDCEP Development Report• Pharmacy Locations• Best Management Practices• Gas Stations• Voting Precincts• Underground Storage Tanks• Leaking Underground Storage

Tanks

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

An-Tsun Huang, Data AnalystAlexander Kitaev, Senior CIO Application Developer

Department of Health Care Finance (DHCF)

DAPR Data Request System using Microsoft Dynamics

Background• Purpose of this project: To replace the current data request tool in Google Forms

• Collaboration: The Division of Analytics and Policy Research (DAPR) and the IT Division are collaborating to use Dynamics 365 to build an automated data request system for DHCF internal and external requestors

• Users: Internal data requestors are all DHCF folks; external data requestors include sister agencies in DC Government and anyone outside of DC Government

• Functionality of the system: submit data requests, track data analysis progress, store requests and associated data, increase transparency of data requesting process

• Data Privacy: Privacy Officer is involved in the approval process to check DUA, MOA, and MOU and to be informed regarding potential data privacy issues of data requests

19

Data Request Process

20

Team lead performs following actions:

• Approves/Rejects request

• Check whether request contains PHI

• Enters estimated completion date

• Assigns request to a team member

DAPR Team Member

• Reviews request• Gather data• Communicates with

requester via email or portal (if needed)

Privacy Officer

• Checks whether requester has data sharing agreement and if request is covered by this agreement

• Communicates with requester via Portal or email to establish agreement (if needed)

• Approves request

DAPR Team Member

• Uploads requested data to portal

• Closes the request

Validation Privacy Officer ReviewProcessing Closing

Note: PHI= Protected Health Information

Key Features

• Secure Dynamics portal accessible by both dc.gov and external users• Using dashboards and customized processes to control requests flow• Clear user roles separation• Total visibility of the communication between DAPR and Requester

(emails and portal comments could be seen on the timeline by other team members)

• Mobile app and outlook addons are available

21

External Authentication: Portal supports ‘local’ and dc.gov accounts

22

External User’s View

23

Internal Authentication

24

Data Requests

25

Data Request Resolution Process

26

Dynamics pulls DUAs/MOAs/MOUs from SharePoint

27Note: Under HIPAA (Health Insurance Portability and Accountability Act), a data request involving Protected Health Information (PHI) is required to execute a data use agreement (DUA) (and maybe MOA) between the requestor and DHCF.

Account page contains requests associated with this account, all available MOAs/MOUs and recent communication

28

DashBoards help control data flow

29

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Barney KrucoffChief Data Officer

Office of the Chief Technology Officer

Chief Data Officer's Annual Report

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Annual report background• Mayor’s Order 2017-115, the District of Columbia Data Policy

mandates the CDO annual report.

• Mayor’s Order 2018-050, aligning the publication of the District’s Enterprise Dataset Inventory (EDI) and CDO Annual Report to March 10, in approximate alignment with the national observance of Sunshine Week.

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Agency Participation

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Datasets by Classification

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

EDI Sensitivity Flag

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

EDI What’s changedExisting and new datasets classified at Levels 3 and 4 must now contain a sensitivity flag, indicating the specific reason for the classification

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Datasets by Category

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

FOIA-Open Data Feedback Loop

• FOIA request-tracking data should inform public bodies about public demand for open data. In fact, the Data Policy mandates use of the system for mayoral agencies

• Open data publication of FOIA request-tracking data can help residents hold public bodies accountable for the timely and consistent processing of requests

• Successful appeals for datasets previously denied under FOIA exemptions can inform public bodies about potential errors in dataset classification.

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

FOIAXpress adoption

FOIAXpress utilization measures by fiscal year

2017 2018 2019

# of agencies enrolled in FOIAXpress 53 55 64

# of agencies processing at least one request in system

51 52 57

# of active DC government users (FOIA Officers)

112 141 153

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

FOIA RequestsFY

2017FY

2018FY

2019FY18-19

%ChangeTotal reported by EOM

8,274 10,450 10,836 3%

Tracked in FOIAXpress System

6,762 7,943 8,701 9%

% of requests in FOIAXpress

82% 76% 80%

FOIAXpress adoption

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Who’s not using FOIAXpressIndependent agencies with the most request outside the system are:

• DC Board of Elections

• DC Council

• DC Housing Authority

• DC Water

• Office of Police Complaints

• Office of the Chief Financial Officer

• Public Charter School Board

Mayoral agencies that use FOIAXpress, but process most of requests outside the system:

• Alcoholic Beverage Regulation Administration

• District of Columbia Retirement Board

• Department of For Hire Vehicles

• Department of Human Services

• Department of Corrections

• Department of Small Local Business Development

• Office of Human Rights

• University of the District of Columbia

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Accomplishments

Good Government

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Accomplishments

Added over 36,000 housing units to Census Records

Education

https://edscape.dc.gov

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Accomplishments

Jobs

https://ozmarketplace.dc.gov

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

AccomplishmentsTransportation

https://opendata.dc.gov/datasets/dockless-equity-emphasis-areas

Dockless scouter drop-offs in DC, October 2019

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Accomplishments

Public Safety

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Accomplishments

Health Environment

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Draft Technology Strategic Plan for DC: Unleashing the Possible

Vision: Unleashing the possible for DC in the digital age.

Mission: Empower DC government through technology by providing valued services, advising agencies, and collaboratively governing information technology.

Commitments: Nine commitments to our agencies, residents, businesses, visitors, and to the OCTO team. They focus on providing exceptional services, products, technology guidance and governance.

Commitment 4: Manage, organize, and leverage data to facilitate DC government mission delivery.

Initiatives: The tasks and initiatives OCTO will undertake to ensure DC agencies have the tools to manage, organize, and leverage data to make better decisions.

• 4.1 Identify high-value mission use cases to improve the use of data in service of specific Mayoral initiatives and focus areas.

• 4.2 Streamline policy and process to share and use data.• 4.3 Support agency use of big data and artificial intelligence

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Goals4.1 “Identify high-value mission use cases to improve the use of data in service of specific Mayor initiatives.” DescriptionNew Goal: Support Mayoral housing focus area We cited our work in support of the Office of Planning for the U.S.

Census and our contribution to Mayor Bowser’s focus area on housing. But we can be doing more to support housing agencies. Next year’s report shall feature an “accomplishment” with a housing agency.

New Goal: Focus on one DC government cluster in depth. While continuing to support all DC agencies, next year we will work closely and voluntarily with one DC government cluster (Education, Health and Human Services, Internal Services, Operations and Infrastructure, Planning and Economic Development, or Public Safety and Justice) to go more in-depth in understanding the cluster’s data and supporting its mayoral initiatives. The report shall include a section that focuses on that cluster.

2019 Goal: Train agency communications and engagement teams in data storytelling

As Mayor Bowser has demonstrated with her mayor.dc.gov website, opendata.dc.gov offers many ways to explain and track policies using open data. Familiarizing communications teams with the capabilities should drive publication and utilization of open data.

Some Progress A data team representative speaks to every web training class hosted by the OCTO Web Team. However, Comms teams still need more exposure to what the OCTO Data Team can help them achieve:• Interactive “Hub” sites, like the one developed by DDOT’s

Urban Forestry Administration

• Public facing dashboards like EdScape developed by the Deputy Mayor for Education

• Add open data integrations like mayor.dc.gov, which was featured in last year’s report.

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Goals4.2. “Streamline policy and process to share and use data” Description

New Goal: Develop technology and processes to help agencies with data anonymization.

There are a variety of ways to summarize or mask PII to make it harder to identify individuals within a dataset. No anonymization is full proof, but OCTO should offer standard practices and tools that make easier to anonymize Level 3 for sharing and analysis. OCTO already has some capital funds dedicated to this project.

New Goal: Leverage the EDI to promote data sharing Develop an interactive dashboard to allow the public and agencies to explore the EDI. This will improve openness and generate more requests to share data.

2019 Goal revised from 2018: Develop eMOU system to support data-sharing agreements

Not all data can be open, and the Data Policy calls on the CDO to develop a “streamlined process for interagency data sharing.” A data-sharing agreement is a document of agreement between two agencies in which the data steward agrees to share specific data with another agency subject to certain terms and limitations. Faster execution, with better tracking and enforcement of data-sharing agreements, is needed across the District government. OCTO already maintains a system known as “eMOU,” where MOU stands for memorandum of understanding. With modifications, such as multilateral agreements, the eMOU can be adapted to handle standardized data-sharing agreements.

• The tool will need to support multilateral or brokered agreements, not just agreements between two agencies.

Progress but not enough

We now have a draft multilateral data-sharing agreement template that establishes a “facilitator” role for OCTO. The template has recently been turned over for legal review and then automation can begin.

2019 Goal: Move open datasets to the opendata.dc.gov portal

OCTO will work with agencies, the Open Government Advisory Group, and the community to prioritize posting the remaining XXX open enterprise datasets identified in the EDI that are not yet on the open data portal.

TBD Waiting on the numbers

2019 Goal: Develop API best practices

Part of the CDO mission is to facilitate data sharing. APIs are a common tool for fast, flexible, and secure data integration. OCTO maintains minimal API standards for District agencies on its intranet site, but much more guidance is required. This is especially true where more and more, but not all, data is moving to cloud-based software and service applications.

Progress

The Data Team has prepared a draft “API and Middleware Policy,” which is going through the review process. We will continue to work on best practices in the coming year.

DC

Governm

entO

ffic

e of

the

Chi

ef T

echn

olog

y O

ffic

er

March 23, 2020

Goals4.3 “Support agency use of big data and artificial intelligence” Description

New Goal: Develop a plan for leveraging Artificial Intelligence (AI) The District agencies and OCTO don’t currently have a shared understanding of what AI is or how we would apply it in support of the Mayor’s Focus Areas. Together with SmarterDC we shall develop and publish such an understanding and direction.

New Goal: Revitalize the DC Data Science User Group OCTO helped to found a Data Scientist user group for District employees. The group promoted information sharing and pest practices for data science projects and predictive analytics. Meetings have fallen off due to staff turnover. The group should be revitalized in the coming year with regular meetings and increased membership.

2019 Goal: Develop cutting-edge data platform to support analyticsNow is the time to push utilization of the Data Lake. • The Lab @ DC has agreed to migrate at least one agency’s datasets

into OCTO’s searchable “Data Lake” and undertake at least one multiagency Data Science Project with the system.

• The OCTO Data Team will gather and catalog as much Level 1 and Level 2 data as we can to populate data.in.dc.gov.

ProgressThe DC Data Lake is up and running. This year we focused on utilization and made progress with three significant customers:• DDOT is using the lake to store and analyze dockless mobility data.

• OCTO’s DC Net program, as part of a proof of concept for Low-Power Wide Area Network, is bringing in smart city sensor data.

• The Lab @ DC has approved the data lake for some of its sensitive datasets.

The less sensitive Level 1 and Level data have been loaded in the lake.