the 3 models in the nginx microservices reference architecture

Three Models in the NGINX Microservices Reference Architecture

February 8, 2017

MORE INFORMATION AT NGINX.COM

Who Are We?

Chris StetsonChief Architect

Formerly:- Vice President, Technology, Razorfish- Vice President, West Coast, Huge

Floyd SmithTechnical Marketing Writer

Formerly:- Apple, Alta Vista, Google, and more- Author of multiple books on

technology


Agenda

• NGINX Plus• The Big Shift• The Networking Problem

• Service Discovery• Load Balancing• Secure & Fast Intercommunication

• Architectures• Issues


Who Are You?Job TitlesAnalyst ArchitectCEO, CIO, CTOConsultantcool guyCloud Architect, EngineerDeveloperDevOpsEngineerIT Lead, ManagerSecurity ArchitectSystems AnalystTech Lead

Organization Types

AirlinesComputer technologyConsultancyEcommerceFinanceFreelanceGovernmentHigher educationMobile phonesNetworking technologyPressSaaSTelecoms

Reasons for Attending“Build ms platforms”

“Client proposals”“Compare the three models to our solution”“Create API Gateway”“Developing microservices”“DevOps”“Microservices strategies”“Migrate from F5”“Move from .NET” “Move from Apache”“Moving from monolith”“Playing with microservices”


NGINX Plus


About NGINX, Inc.

• Founded in 2011, and NGINX Plus first released in 2013

• VC-backed by enterprise software industry leaders

• Offices in San Francisco, Sunnyvale, Cork, Cambridge, and Moscow

• 1,000+ commercial customers• 100+ employees

>300 million

total sitesrunning on NGINX

7Source: Netcraft June 2016 Web Server Survey

http://news.netcraft.com/archives/category/web-server-survey/

>50%of the top 100,000busiest websites

8Source: W3Techs Web Technology Survey

http://w3techs.com/technologies/cross/web_server/ranking

>40%of sites on AWS

9Source: SumoLogic


OPEN SOURCE PLUSFEATURES

REQUEST ROUTING COMPRESSION LOAD BALANCING APP HEALTH MONITORING GUI VISUALIZATION

SSL EMBEDDED SCRIPT LANGUAGE EDGE CACHE MEDIA STREAMING MONITORING ANALYTICS CONFIGURATION RESTFUL API

What’s Inside NGINX Plus?

11

Internet

Web ServerServe content from disk

Application GatewayFastCGI, uWSGI, Passenger…

Reverse ProxyCaching, load balancing…

HTTP traffic

Where NGINX Plus Fits


Public/Private/Hybrid CloudBare Metal Containers

13

NGINX Plus Works in All Environments


NGINX and Microservices

• Two-thirds of surveyed developers using or investigating microservices

• Microservices is #1 topic on our website• Chris Richardson series,

Introduction to Microservices• Chris Stetson series, NGINX MRA• MRA Training• …and much more; contact Sales for free

evaluation

https://www.nginx.com/resources/library/app-dev-survey/

https://www.nginx.com/blog/tag/microservices/

https://www.nginx.com/blog/introduction-to-microservices/

https://www.nginx.com/blog/introducing-the-nginx-microservices-reference-architecture/

http://university.nginx.com/

https://www.nginx.com/contact-sales/


The Big Shift


Architectural Changes: Monolith to Microservices 1


Architectural Changes: Monolith to Microservices 2


An Anecdote


The Tight Loop Problem• REST calls• 1000s of requests• Looped data


Mitigation• Group requests• Cache data• Optimize the network


NGINX Microservices


Microservices Reference Architecture• Docker containers• Polyglot services• Design incorporates

Twelve-Factor App principles


The Networking

Problem


Service Discovery• Services needs to know

where other services are• Service registries work in

many different ways• Register and read service

information


Load Balancing

• High-quality load balancing

• Developer configurable


Secure & Fast Communication• Encryption at the

transmission layer is becoming standard

• SSL/TLS communication is slow

• Encryption is CPU-intensive


Solution• Service discovery• Robust load balancing• Fast encryption


Network Architectures


Proxy Model• Inbound traffic is

managed through a reverse proxy/load balancer

• Services are left to themselves to connect to each other…

• …often through round-robin DNS


Proxy Model• Focus on Internet traffic• A shock absorber for your app• Dynamic connectivity


Router Mesh Model• Inbound routing through

reverse proxy• Centralized load

balancing through a separate load-balancing service

• Deis Router works like this


Circuit Breakers• Active health checks• Retry • Caching


Router Mesh• Robust service discovery• Advanced load balancing• Circuit breaker pattern


Interprocess Communication• Routing is done at the

container level• Services connect to each

other as needed• NGINX Plus acts as the

forward and reverse proxy for all requests


Normal Process• DNS service discovery• Relies on round-robin

DNS• Each request creates a

new SSL/TLS connection, which fully implemented requires 9 requests


Detail• NGINX Plus runs in each

container• Application code talks to

NGINX Plus locally• NGINX Plus talks to

NGINX Plus• NGINX Plus queries the

service registry


Circuit Breaker Plus• Active health checks• Retry • Caching


Fabric Model• Robust service discovery• Advanced load balancing• Circuit breaker pattern• Persistent SSL Network


NGINX and Microservices

• Two-thirds of surveyed developers using or investigating microservices

• Microservices is #1 topic on our website• Chris Richardson series,

Introduction to Microservices• Chris Stetson series, NGINX MRA• MRA Training• …and much more; contact Sales for free

evaluation

https://www.nginx.com/resources/library/app-dev-survey/

https://www.nginx.com/blog/tag/microservices/

https://www.nginx.com/blog/introduction-to-microservices/

https://www.nginx.com/blog/introducing-the-nginx-microservices-reference-architecture/

http://university.nginx.com/

https://www.nginx.com/contact-sales/


Questions

the 3 models in the nginx microservices reference architecture

Software