codecamp iasi 7 mai 2011 exception tail.com

ExceptionTail.com - MongoDB and RabbitMQ in actionVlad Bălan, Sorin OboroceanuTwitter: @cybyvlad, @sorinoboroceanuRomSoft, www.rms.rowww.exceptiontail.com, @exceptiontail

Iași, 7th of May 2011

Agenda

How we started Demo Architecture Demo

How we startedLife and the way it works…

How we startedWhat we usually work with @work

We needed to look on the dark side(Linux stuff) NOSQL? ASP.NET MVC 3 ThreadTail - analytics engine Smaller events-based project

The Microsoft stack

How we started What we usually work with @work

We wanted to look on the dark side(Linux stuff)

NOSQL? ThreadTail - analytics engine Smaller events-based project

NOSQL CouchDB Hadoop RavenDB Cassandra MongoDB etc.

How we started What we usually work with @work We wanted to look on the dark side(Linux stuff) NOSQL?

ThreadTail - analytics engine Smaller events-based project

github.com/cybyvlad

How we started What we usually work with @work We wanted to look on the dark side(Linux stuff) NOSQL? ThreadTail - analytics engine

Smaller events-based project

Error reporting at its best

Exception flow

App

oops

User

Demo

Architecture of ExceptionTail.com

When simple doesn't cut it

Default architecture of an web application

App

App

App

Web Server SQL Server

Performance Bottleneck: Too much load!

…

App

App

App Web Server SQL Server…Performance Bottleneck:

Too much load!

RabbitMQ

Message Processor

Less load!

Report

Architecture using queuing

Architecture using replication

App

Collection Server

SQL Server Master

Performance Bottleneck: Writes can’t scale!

Reporting Server

SQL Server SlaveSQL Server

SlaveSQL Server Slave

Replication

Scalable Reads!

Queue

Message Processor

SQL Server

Reporting Server

Architecture using sharding

App SQL Server Master

Performance Bottleneck: Writes can’t scale!

SQL Server SlaveSQL Server

SlaveSQL Server Slave

Replication

Scalable Reads!

SQL Server MasterSQL Server

MasterS

hard

ing

Scalable Writes!

Development Bottleneck: Need to write custom code!

Collection Server

Queue

Message Processor

Sha

rdin

g

Architecture using MongoDB!

App

Reporting Server

MongoDB

Scalable Writes!

Scalable Reads!

SQL Server Master

SQL Server MasterSQL Server

Master

Collection Server

Queue

Message Processor

ExceptionTail.com - Final architecture

App

ASP.NET MVC 3

MongoDB

WCF

RabbitMQ

Message Processor

Architecture of ExceptionTail.com

Default architecture of an web app

Architecture using queuing (RabbitMQ)

Architecture using replication

Architecture using sharding

Final architecture using MongoDB & RabbitMQ

MongoDB

Demo

Resources http://www.mongodb.org/ http://www.10gen.com/ http://www.mongovue.com/ http://www.rabbitmq.com/ http://highscalability.com/

Q&A

Please fill the evaluation form

Thank you very much!Vlad Bălan, Sorin OboroceanuTwitter: @cybyvlad, @sorinoboroceanuRomSoft, www.rms.rowww.exceptiontail.com, @exceptiontail

Iași, 7th of May 2011