nbd wg: thinking forward...thinking forward wo chang, nist the following presentation is for...
TRANSCRIPT
![Page 1: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/1.jpg)
NBD‐WG:Thinking ForwardWo Chang, NIST
![Page 2: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/2.jpg)
The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups.
DISCLAIMER:
NBG‐WG, Wo Chang, NIST, July 3, 2013 2
![Page 3: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/3.jpg)
Good Approach (outside‐the‐box):• Imagine the Web 20 years ago…
…only a presentation tool with hyperlink using simple HTTP
• Web today and beyond
Central ecosystem which allows value‐added inside‐ and/or outside‐the‐box
Simple, flexible, and extensible!
3NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 4: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/4.jpg)
Big Data Current Approach (inside‐the‐box):• How to optimize analytics tools
• How to better structure larger datasets
• Others…
4
Big DataProducer
(data source)
Consumer(end‐users, repositories,systems, etc.)
Analytics
Computing Platform and Cluster
They are indeed important!NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 5: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/5.jpg)
Semi‐new Approach (outside‐the‐box):• How to orchestrate technology‐agnostic analytics tools with secure mechanisms for end‐users / systems consumption
• How to enable Big Data stakeholders to pick‐and‐choose technology‐agnostic analytics tools for processing and visualization in any computing platform and cluster
• How to allow value‐added from Big Data service providers
Simple, reusable, and extensible!
5NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 6: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/6.jpg)
Big Data Processing Protocol (BDPP) &Big Data Markup Language (BDML)
Data Sources‐ Sensors‐ Simulations‐ Etc.
Security & Privacy
Analytics Visualization
SaaS
PaaS
….
….
IaaS …
SOURCES
RESULTS
Results‐ End users‐ Repositories ‐ SystemsBig Data
Hadoop HPCC
CloudStack futureIaaSEucalyptus OpenStack
futurePaaS
Big Data Processing Protocol (BDPP)
Big Data Processing Protocol (BDPP)
BDML
6NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 7: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/7.jpg)
SUBGROUPSAND THEIR TASKS
NBD‐WGNBD‐WG
Definitions and
Taxonomies
Definitions and
Taxonomies
RequirementsRequirements
Security and Privacy
Security and Privacy
Reference ArchitectureReference
Architecture
Technology RoadmapTechnology Roadmap
7NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 8: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/8.jpg)
Definitions and Taxonomies
Base‐line Definitions:
Big Data refers to digital data volume, velocity and / or variety [veracity] that:
Enables novel approaches to frontier questions previously inaccessible or impractical using current or conventional methods; and / or
Exceeds the capacity or capability of current or conventional methods and systems
• Factual information
• Discussion on Big Data characteristics
• We might want to extend what Big Data can do (or is it too early to say?)
SUBG
ROUP
NBD‐WGNBD‐WG
Definitions and
Taxonomies
Definitions and
Taxonomies
RequirementsRequirements
Security and Privacy
Security and Privacy
Reference ArchitectureReference
Architecture
Technology RoadmapTechnology Roadmap
8NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 9: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/9.jpg)
Data Sources‐ Sensors‐ Simulations‐ Etc.
Security & Privacy
Analytics Visualization
SaaS
PaaS
….
….
IaaS …
SOURCES
RESULTS
Results‐ End users‐ Repositories ‐ SystemsBig Data
Hadoop HPCC
CloudStack futureIaaSEucalyptus OpenStack
futurePaaS
Big Data Processing Protocol (BDPP)
Big Data Processing Protocol (BDPP)
DDML
Taxonomies –Explore actors (roles), activities, components, and sub‐components associated in the surrounding (with *) of Big Data * * *
*
*
*
*
** *
9NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 10: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/10.jpg)
Requirements
• Collect diversified use cases and identify their requirements
• Identify BDPP and BDML usage scenarios
• Identify what components are needed to enable BDPP and BDML
SUBG
ROUP
NBD‐WGNBD‐WG
Definitions and
Taxonomies
Definitions and
Taxonomies
RequirementsRequirements
Security and Privacy
Security and Privacy
Reference ArchitectureReference
Architecture
Technology RoadmapTechnology Roadmap
10NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 11: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/11.jpg)
Security and Privacy
• Security and privacy are needed throughout lifecycle of processing stage and computing environment
• Collect various use cases and see if BDPP and BDML would work or not
• Identify what components are needed to enable BDPP and BDML
SUBG
ROUP
NBD‐WGNBD‐WG
Definitions and
Taxonomies
Definitions and
Taxonomies
RequirementsRequirements
Security and Privacy
Security and Privacy
Reference ArchitectureReference
Architecture
Technology RoadmapTechnology Roadmap
11NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 12: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/12.jpg)
Reference Architecture
• Explore how other widely adopted standard architectures work, such as:• Hardware: Peripheral Component Interconnect (PCI)
• Application: Browser Plug‐ins
• Protocol & Schema: HTTP, XML
• Programming: Tcl / Tk (Tk can run many GUI platforms)
• Markup: HTML5 – enables rich rendition on many systems / devices
• Identify what lessons can be adopted to enable BDPP and BDML
SUBG
ROUP
NBD‐WGNBD‐WG
Definitions and
Taxonomies
Definitions and
Taxonomies
RequirementsRequirements
Security and Privacy
Security and Privacy
Reference ArchitectureReference
Architecture
Technology RoadmapTechnology Roadmap
12NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 13: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/13.jpg)
Technology Roadmap
• Present forward vision for Big Data
• Present cohesive Big Data definitions, characteristics, and taxomies
• Present Big Data roles and activities through use cases and scenarios
• Identify core Big Data requirements
• Present Reference Architecture to address those requirements
• Survey current Big Data standards and activities
• Perform gap analysis between vision and what’s available
• Present recommendations
• Set standardization and adoption priorities for BDPP and BDML
SUBG
ROUP
NBD‐WGNBD‐WG
Definitions and
Taxonomies
Definitions and
Taxonomies
RequirementsRequirements
Security and Privacy
Security and Privacy
Reference ArchitectureReference
Architecture
Technology RoadmapTechnology Roadmap
13NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 14: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/14.jpg)
How can you help?• Provide good use cases
• Provide feedback on Big Data direction
• Provide recommendations on Big Data adoption
• Others…
Standards can benefit all users / systems!
INDUSTRY
ACADEMIA GOVERNMENT
14NBG‐WG, Wo Chang, NIST, July 3, 2013
![Page 15: NBD WG: Thinking Forward...Thinking Forward Wo Chang, NIST The following presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups. DISCLAIMER: NBG‐WG,](https://reader033.vdocuments.us/reader033/viewer/2022053008/5f0b7e1f7e708231d430c9c5/html5/thumbnails/15.jpg)
This presentation is for suggestion only and is not a requirement for NBD‐WG/Subgroups.
DISCLAIMER:
15NBG‐WG, Wo Chang, NIST, July 3, 2013