mft_soasuite_pass_by_reference

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Handling Large Files with Oracle SOA Suite and Managed File Transfer Pass-by-Reference

Dave Berry, Oracle

Senior Manager, Integration Products

Robert van Molken, AMIS

Senior Oracle Integration Specialist

Session CON8736


The following is intended to outline our general product direction. It is intended

for information purposes only, and may not be incorporated into any contract.

It is not a commitment to deliver any material, code, or functionality, and should

not be relied upon in making purchasing decisions. The development, release,

and timing of any features or functionality described for Oracle’s products

remains at the sole discretion of Oracle.


Oracle Fusion Middleware BUSINESS INNOVATION PLATFORM

Complete

Integrated

Best-in-class

Open

On-premise and Cloud

User Engagement

Identity Management

Business Process

Management

Content Management

Business Intelligence

Service Integration Data Integration

Development Tools

Cloud Application Foundation

Enterprise Management

Web Social Mobile


Program Agenda

What is MFT and why you need it?

Functional Use Cases

Real World Use Case and Demo

Discussion


The growing problem with FTP in the enterprise

Uncontrolled proliferation

of FTP servers & clients

No global visibility into

exchange of crucial data files

– including customer data

Not integrated with

enterprise security

standards: FTP servers are

rarely integrated with

directories

Single points of failure: FTP

servers rarely offer HA

capabilities

Lack of control, visibility, security & reliability

Product

specifications

Manufacturing

Design partners

Legal

firm

Contracts Enterprise

Catalogs

Distributors

Media

(photos,

videos)

PR company

Employee

Records

HR consulting

firm


Simple and Secure End-to-End Managed File Gateway

– Large files, encryption, auditing, monitoring, pass-by-reference

Standards Based Middleware Integrations

– (s)FTP, SOA, B2B, Service Bus, Web Services …

Lightweight Web based Design Time Interface

– Easily build, edit and deploy end-to-end transfers

Additional Characteristics

– Scheduling, Embedded sFTP server, FTP proxy, no transformations

– Advanced Management: Pause, Resume, Resubmit

What Is Managed File Transfer? Market Maturing, Consolidating and approaching $1B annually


Oracle MFT Feature Set Core

–“Embedded” FTP(S)/SSH, FTP / FTP-SSL / SSH

server

–File transfer auditing

–Extensible framework – pre/post processing

–HA clustering

–SOA/B2B integration and delivery headers

–Scalable architecture

Monitoring and Management

– Web UI: Managed Server

Designer, Monitor, Administration

– Enterprise Manager: Admin Server

File Delivery

–Very Large Files ~ 500GB+

–Pass by Reference FTP or File, Inline

–Scheduling and Auto Retry

–Pause and Resume Target endpoints

–HTTP, JCA, FTP, In-memory

–Notifications

–Actions

–Zip Compress/Decompress

–PGP Encrypt/Decrypt

–Callouts

–Archive, Delete, Move, Custom


MFT Use Cases

Internal Business Integrations

– Application to Application File sharing: SOA/SB integrations

External Partner Integrations

– (s)FTP File gateway outside firewall. B2B integration, EDI ...

COTS/Cloud

– OOTB End-to-end delivery channel, A2A …

Other

– File management beyond business integration.

– Media, software delivery, smart phones …

Use Case Categories


MFT Functional Use Case Patterns MFT

MFT MFT MFT MFT Direct Fan Out Chained

B2B MFT B2B

B2B MFT

MFT B2B MFT Direct

SOA

MFT SOA

MFT

MFT SOA

SOA MFT

Direct Indirect

Enterprise

MFT B2B SOA MFT

Hybrid


Web-based UI Functionality (MFT UI + EM)

Design Configuration

– Set up Transfers, Sources, Targets

Monitoring and Operations Console

– Application-level functionality, diagnosis, resubmit …

– Dashboard: Metrics, Find File, Activity Deliveries, Recent Errors, Flow instance Reports

System Administration/EM

– System-level functionality, Server Parameters, EXP/IMP …

JDeveloper Bindings

– Composite Bindings/BPEL Services

Enterprise Manager

– MFT App Configuration, Mbeans, global defaults


MFT JDeveloper Binding

• SOA Browse and MFT • Creates an SOA SCA Reference to MFT

• MFT Browse and Consume SOA • Creates an SOA SCA Service from MFT

MFT SOA

SOA MFT

Integrated MFT JDeveloper Component Composite

Bindings

BPEL Services


Transfer Flow Design


Runtime Transfer Flow Report


Monitoring Dashboard


Transfer Report


Partner Profile Robert van Mölken

Specialist in SOA Suite & OSB since 2007

Oracle SOA Suite 12c and MFT Beta tester

Linkedin: www.linkedin.com/in/rvmolken

Blog: technology.amis.nl

Twitter: @robertvanmolken

AMIS was founded in 1991

90+ employees & 1000+ years Oracle expertise

2 ACE directors 3 ACEs

Oracle specialized partner in Database, SOA en ADF

Oracle Middleware partner 2011 & 2013

http://www.linkedin.com/in/rvmolken

http://technology.amis.nl/

http://www.twitter.com/robertvanmolken

http://www.twitter.com/robertvanmolken


MFT Real World Use Case Overview Title

Requesting building permit by submitting web form and (required) attachments

Scenario

A person or company can request a building permit online. When submitting the web form a minimum

of one attachment is included. The web form data is send to a web service (SOA Suite) which creates

a new case in the backend. The uploaded files are saved to a file share where the final MFT picks

them up and transfers them separately to a second SOA Suite web service based on MFT service

definition. The received file references are correlated to the case and are passed to Webcenter

Content. Webcenter Content, which is the final destination, downloads the referenced files.

Business Value

Keep large files from interrupting transactions and gobbling system resources

Features

1. Transfer files by using Pass-By-Reference

2. File content is not visible in instance tracing and secured with user account

3. Transferred files can be monitored and resubmitted if a transaction has failed


MFT Real World Use Case Details Customer Requirements

Submit large files

– Submit web form with max 10 attachments with each 20Mb max file size

Performance

– Processing form data and attachment should not impact performance of

transactions and system resources

Security

– Files should only be accessed by authorized personal / system integrators

– Files should only be stored in Webcenter Content

Track and Trace

– Transferred files should be monitored and able to resubmit when failed


MFT Real World Use Case Details Oracle Managed File Transfer Objectives

Consolidate ad-hoc FTP transfers into a managed, fully audited and HA platform

Working with Design Partners and Beta customers on a new Oracle 12c product to address

high demand for a well integrated MFT solution

Handle large files with flexible payload semantics including pass-by-reference for just-in-time

file processing

Easy to use Web Based Design and Runtime environment

Deliver extensible framework allowing custom callout file manipulation

MFT By Ref

SOAP ______

______

______

______

MFT

File

store

SOA

MFT

Domain

SOA

Domain

______

______

______

______

FTP/File System

Source

Target


MFT Real World Use Case Details Architecture

Front-end

– ADF Web / Mobile Application with Web Forms

Network File Share

– File store for files uploaded when sending Web Form

SOA Suite

– Web services for Case and Document management

Database

– PL/SQL packages for storing/selecting Case data

Managed File Transfer (MFT)

– Transfer files, uploaded through Front-end, to DocumentService (Pass-By-Reference)

Webcenter Content

– Collect and store files from MFT using received reference


MFT Real World Use Case Details Architecture

SCA Composite

BPEL

CaseProcess

BPEL

Document

Process


MFT Demo: Frontend > FTP > SOA > Repository Scenario

eGoverment, a citizen request a building permit and adds some required documents as attachments. The requested

permit is then received and processed using a SOA Suite Composite service. This SCA composites uses a BPEL

process to create a case and it spawns, per attached document, a second BPEL process. This BPEL process uses an

intermediate web service binding to receive the uploaded files (pass-by-reference) from MFT. Using correlation the

files, send by MFT, can be matched to the correct permit. Using a third web service the file references are downloaded

en saved to a file-based repository.

Features

1. MFT Composer: create and deploy MFT Transfer artifacts. 1 Source + 1 Target.

2. MFT Server: transfer files from FTP Server to file system and creates instance data

3. MFT Dashboard: shows transfer results and “Find File” portlet

4. HTML5 Frontend: fill in web form and send data to SOA Suite Composite web service

5. BPEL Process w/ intermediate MFT Binding: process waits till it receives service call from MFT

6. File Repository: the received file(s) are downloaded, by SOA Suite, to a second environment


MFT Demo: Managed File Transfer


MFT Demo: HTML5 Frontend JDeveloper 12c HTML5 Editor HTML5 Frontend


MFT Demo: JDEV with MFT Binding


Q & A

mft_soasuite_pass_by_reference

Technology

oracle andor

oracle soa suite

oracle senior manager

sole discretion of oracle

file management

mft mftsoasoamftcopyright

mft use cases

reference ftp