mule esb with amazon s3 integration
TRANSCRIPT
Integrate Mule ESB with Amazon S3
MuleSoft provides the most widely used integration platform to connect any application, data service or API, across the cloud and on-premise continuum. Amazon S3 is cloud-based data-storage infrastructure that is accessible to the user which is programmable via a MuleSoft Amazon S3 connector. The Amazon S3 Mule connector allows developers to access any amount of data, at any time, from anywhere on the web. With connectivity to the Amazon S3 API, users can interface Amazon S3 to store objects, download and use data with other AWS services, and build applications that call for internet storage – all from within MuleSoft Anypoint Platform.
Instant access to the Amazon S3 API enables businesses to create seamless integrations between Amazon S3 and other databases, CMS applications such as Drupal, and CRM applications such as Salesforce.
Overview
Amazon Account Amazon Access and Secret keys Mule Anypoint Amazon Connector
Prerequisites
Creating Amazon S3 Bucket Before integrating S3, a S3 bucket has to be
created. Every object in Amazon S3 is stored in this bucket. Following are the steps to create a bucket:
Enter a bucket name in the ‘Bucket Name’ field Select the region If we need to set up-logging, then click on ‘Set Up
Logging’, Else, go to ‘Create‘ and create the bucket When Amazon S3 successfully creates the bucket,
console will display the properties of the empty bucket
Amazon Account
Access key and secret key can be retrieved from the Amazon account page
Amazon Access and Secret Key
Configure Mule Anypoint Amazon S3 connector with the following settings – – Configuration:(S3 connector configured using the config element) This element
must be placed out of flow and at the root of the Mule application. We can create as many configurations deemed necessary as long as each carries its own name.
– Connection Pool: S3 connector offers automatic connection management via the use of a connection pool. This pool will act a storage mechanism for all the connections that are in-use by the user of this connector.
Prior to execution of a processor, the connector will attempt to lookup an already established aConfigure Mule Anypoint Amazon S3 connector with the following settings –
– Configuration:(S3 connector configured using the config element) This element must be placed out of flow and at the root of the Mule application. We can create as many configurations deemed necessary as long as each carries its own name.
– Connection Pool: S3 connector offers automatic connection management via the use of a connection pool. This pool will act a storage mechanism for all the connections that are in-use by the user of this connector.
Prior to execution of a processor, the connector will attempt to lookup an already established
Mule Anypoint Amazon S3 Connector
– Reconnection Strategy: Reconnection Strategies specify on how a connector behaves when the connection fails. We can control the attempts by Mule to reconnect using several criteria
Type of exception Number and frequency of reconnection attempts Notifications generated With a reconnection strategy, the behaviour of a failed
connection can be controlled in a much better way by configuring it, for example, to re-attempt the connection only once every 15 minutes, and to give up after 30 attempts. An automatic notification can be sent to the IT administrator whenever this reconnection strategy goes into effect. A strategy can also be defined which attempts to reconnect only during business hours. Such a setting can prove useful if the server is frequently shut down for maintenance.
The below Mule application is used to read the object (.jpeg image) from HTTP outbound component using the absolute URL and upload the same object under Amazon S3 bucket using Mule Anypoint Amazon S3 connector.
Steps to be followed for integrating ‘Amazon S3’ with MuleSoft Applications: Install the Amazon S3 Connector in Anypoint Studio (3.5 and above)
http://repository.mulesoft.org/connectors/releases/3.5 Create a new Anypoint Studio Project and Flow Before using the Amazon S3 Connector in the Mule Flows, create a global element for Amazon S3
configuration which can be reused in all other flows across the Mule project – wherever the objects are created & deleted to & from Amazon S3 cloud server.
Configure the Amazon S3 connector by providing the following information for the global element◦ Access Key◦ Secret Key
Use HTTP outbound endpoint to pass the object location to get the object and upload to the Amazon S3 storage server
Configure the Amazon S3 endpoint by providing the following to create the object under Amazon S3 bucket◦ Link to the ‘global Connector Configuration’◦ Operation◦ Bucket Name
ACL (Access level) Run the Mule Application and trigger the URL (using browser) http://localhost:8081/createObject Check the Amazon S3 bucket, the object (.jpeg object) will be created under the bucket.
Mule ESB – The best way to Integrate Amazon S3
Architecture to Integrate Amazon S3 using Mule Enterprises ESB
No point-to-point integration required Seamless integration running in the background Quick data synchronisation between Amazon S3 with an on-
premise and cloud based application Facilitate applications with Amazon S3 capacities for large volume
data storage Stores application data and can be rolled back during disaster
recovery Bi-directional data communication between applications and
Amazon S3 Highly scalable, it secures a solution for backing up and archiving
the critical data Send event notifications when objects are uploaded to Amazon S3 Access any amount of data, any time and from anywhere on the
web.
Benefits