aws re:invent 2016 recap (part 2)
TRANSCRIPT
AWS re:Invent 2016 re:Cap
Julien Simon Principal Technical Evangelist, AWS [email protected] @julsimon
Security Performance efficiency
Cost optimization
Reliability
Well-Architected Framework
Operational excellence
NEW
A Year In Amazon CloudFormation
20 additional services 20 services updated YAML support Role-based stack creation
Change sets Cross-stack references Failure recovery Resource schemas
Prepare
Amazon EC2 Systems ManagerCollection of AWS tools for package installation, patching, resource configuration, and task automation
Prepare
NEW
Generally Available Today
AWS CodeBuild
NEW
Operate
Generally Available Today
Build service for compiling source code and running unit tests
AWS X-Ray
NEW
Operate
Analyze and debug distributed applications in production
Preview Available Today
fanout-00002
AWS X-Ray NEW
hello-1.mbfzqxzcpe.us-east-..
hello-2.mbfzqxzcpe.us-east-..
fanout-00005 fanout-00003
throttle DynamoDB
index DynamoDB
fanout-00004
400 traces/min avg - 0.30 ms
600 traces / min avg - 0.19 ms
1000 traces /min avg - 0.13 ms
400 traces / min avg - 0.30 ms
1000 traces / min avg - 0.28 ms
400 traces / min avg - 0.30 ms
850 traces / min avg - 0.16 ms
850 traces / min avg - 0.17 ms
Client
Client
800 traces / min avg - 0.19 ms
fanout-00001
560 traces / min avg - 0.19 ms
fanout-00006
AWS Personal Health Dashboard
NEW
Respond
Personalized view of AWS service health
Generally Available Today
Web applications running on AWS are already protected by Shield Standard - no action is required
Protection from volumetric and state exhaustion attacks
NEW
Respond
Generally Available Today
AWS Shield For Everyone
For additional protection against very large and sophisticated attacks
AWS Shield Advanced
Respond
NEW
Generally Available Today
Respond
Advanced notifications via CloudWatch
Cost protection on ELB, CloudFront, Route 53
24/7 DDoS response team and support
WAF included at no additional cost
AWS Shield Advanced
Understand user behavior
Define who to engage
Deliver notifications
Track campaign
results
Amazon Pinpoint
S3 Storage Management
S3 Data Events in CloudTrail S3 Object Tagging S3 Analytics - Storage Class Analysis S3 CloudWatch Metrics S3 Inventory
Innovations In S3 NEW
Integrated with:
Fully-managed data catalog and ETL service
S3, RDS, Redshift & any JDBC-compliant data store
AWS GlueNEW
2. Source Data
S3 Upload
Kinesis Firehose
DynamoDB Streams
Snowball Snowball Edge
Snowmobile
3. Lifecycle management and cold storage
5. Data governance, security, privacy
8. Preparing for Analytics
9. Orchestration and job scheduling
Analytics
Database Migration Service
1. Ingestion
Datastore target
4. Metadata capture
10. Capturing data change
Athena
EMR
Elasticsearch
Redshift
AI
Machine Learning
Quicksight
RDS
DynamoDB
EFS
S3 EBS
6. Self-service discovery, search, access
Glacier
7. Managing data quality
EMR
Glue
The Modern Data Architecture On AWS
Install batch software
Manage jobinterdependencies
Manage job queues
Schedulejobs
Provision server cluster
Scale servercluster
Challenges Of Large-Scale Batch Processing
Dynamic provisioning and scaling
Priority-based queues and scheduling
Cost optimization through EC2 Spot fleet
Fully managed
AWS Batch
High availability
Infrastructure management
Security Task scheduling
Pipeline integration
Container management
Service discovery
Resource access
The Challenges Of Container Based Operations
ELBContainerAuto Scaling
CloudTrailVPCIAM CloudWatch Metrics
InstanceAuto Scaling
CloudWatch Logs
CloudWatchEvents
X-Ray
Deep Integration With AWS Platform
You can now determine scheduling policies based on:
AMI ID Availability zone
Instance type
Distinct instances
Custom
Task Placement Engine (Coming Soon)
They need the ability to:
Create custom schedulers Integrate 3rd party schedulers Develop and test locally
Developers Want More Control
Languages Integrations
Node.js (JavaScript) Java (Java 8 compatible) Python
Amazon API Gateway AWS CodeCommit AWS CloudFormation AWS Config
Amazon Simple Notification Service Amazon Simple Email Service
State Of AWS Lambda
Amazon CloudWatch Amazon Kinesis Streams
Amazon DynamoDB Amazon RDS Amazon Aurora
Amazon Cognito Amazon S3
VPC Support Node 4.3 Simple Proxy
API Gateway Binary Support Environment Variables Serverless Application Model
NEW
New Serverless Features In 2016
“I want to sequence functions”
“I want to run functions in parallel”
“I want to select functions based on data”
“I want to retry functions”
“I want to try/catch/finally”
“I have code that runs for hours”
Turning Functions Into Applications
NEW
AWS Step Functions
Generally Available Today
Coordinate the components of distributed applications using visual workflows
Branching StepsSelect image
converter
RAW to JPEG RAW to PNG RAW to TIFF
Load in Database
Start
End
Unsupported image type
Upload RAW file
Delete RAW file
Start
End
Process photo
Resize image
Start
End
Extract metadata
Facial recognition
Load in Database
Parallel StepsSequential Steps
AWS Step Functions
AWS OpsWorks For Chef Automate
Amazon EC2 Systems Manager
AWS CodeBuild
AWS X-Ray
AWS Personal Health Dashboard
AWS Shield
Amazon Pinpoint
AWS Glue
AWS Batch
C# In AWS Lambda
AWS Lambda@Edge
AWS Step Functions
Elastic GPUs For EC2
Amazon Lightsail
F1 Instances
Amazon Athena
Amazon AI
Amazon Rekognition
Amazon Polly
Amazon Lex
PostgreSQL For Aurora
AWS Greengrass
AWS Snowball Edge
AWS Snowmobile
Day 1 Day 2
https://aws.amazon.com/fr/blogs/aws/well-architected-working-backward-to-play-it-forward/ https://aws.amazon.com/fr/opsworks/chefautomate/ https://aws.amazon.com/fr/ec2/systems-manager/ https://aws.amazon.com/fr/blogs/aws/aws-codebuild-fully-managed-build-service/ https://aws.amazon.com/fr/blogs/aws/aws-x-ray-see-inside-of-your-distributed-application/ https://aws.amazon.com/fr/blogs/aws/new-aws-personal-health-dashboard-status-you-can-relate-to/ https://aws.amazon.com/fr/blogs/aws/aws-shield-protect-your-applications-from-ddos-attacks/ https://aws.amazon.com/fr/blogs/aws/amazon-pinpoint-hit-your-targets-with-aws/ https://aws.amazon.com/fr/blogs/aws/aws-batch-run-batch-computing-jobs-on-aws/ https://aws.amazon.com/fr/blogs/aws/blox-new-open-source-scheduler-for-amazon-ec2-container-service/ https://aws.amazon.com/fr/blogs/aws/coming-soon-lambda-at-the-edge/ https://aws.amazon.com/fr/blogs/compute/announcing-c-sharp-support-for-aws-lambda/ https://aws.amazon.com/fr/blogs/aws/new-aws-step-functions-build-distributed-applications-using-visual-workflows/
AWS re : Invent 2016 : Ach iev ing Agi l i ty by Fo l lowing Wel l -Arch i tected Framework Pr inc ip les (ARC203) ht tps : / /www.youtube.com/watch?v=8e2zCHx-K3M AWS re : Invent 2016 : In f ras t ructure Cont inuous De l i very Us ing AWS CloudFormat ion (DEV313) h t tps : / /www.youtube.com/watch?v=TDalsML3QqY AWS re : Invent 2016 : NEW LAUNCH! Amazon EC2 Systems Manager for Hybr id C loud Management (WIN205) ht tps : / /www.youtube.com/watch?v=2ZqmRSIqQ6Q AWS re : Invent 2016 : NEW LAUNCH! In t roduct ion to AWS X-Ray (DEV316) h t tps : / /www.youtube.com/watch?v=s8tB3YhZd9U AWS re : Invent 2016 : NEW LAUNCH! Transparency and contro l w i th AWS Persona l Hea l th Dashboard (ARC207) ht tps : / /www.youtube.com/watch?v=0kW2rkfQgvM AWS re : Invent 2016 : NEW LAUNCH! AWS Sh ie ld—A Managed DDoS Protect ion Serv ice (SAC322) ht tps : / /www.youtube.com/watch?v=R06GDQBbtRU AWS re : Invent 2016 : NEW LAUNCH! Enab le Rea l -T ime Mobi le App Engagement w i th Amazon P inpo int (MBL304) h t tps : / /www.youtube.com/watch?v=eq3hKt0XxQE AWS re : Invent 2016 : NEW LAUNCH! In t roduct ion to AWS Glue : A Fu l l y Managed ETL Serv ice (BDA209) ht tps : / /www.youtube.com/watch?v=4N_ktE4NFIk AWS re : Invent 2016 : NEW LAUNCH! In t roduc ing AWS Batch : Easy and e f f i c ient batch comput ing (CMP323) ht tps : / /www.youtube.com/watch?v=ebwfhSS4ZkY AWS re : Invent 2016 : NEW LAUNCH! Advanced Task Schedu l ing w i th Amazon ECS and B lox (CON307) ht tps : / /www.youtube.com/watch?v=evYcLW3TLcQ AWS re : Invent 2016 : NEW LAUNCH! Br ing ing AWS Lambda to the Edge (CTD206) ht tps : / /www.youtube.com/watch?v=j26novaqF6M AWS re : Invent 2016 : NEW LAUNCH! Deve lop ing Server less C# Appl i cat ions (DEV207) h t tps : / /www.youtube.com/watch?v=Ymn6WGCSjE4 AWS re : Invent 2016 : NEW LAUNCH! Server less Apps w i th AWS Step Funct ions (SVR201) h t tps : / /www.youtube.com/watch?v=75MRve4nv8s
Thank You Julien Simon Principal Technical Evangelist, AWS [email protected] @julsimon