evisions conference 2014_argos_data_automation
TRANSCRIPT
Jon Crosier – Concordia University Irvine
Building a CRM to Banner Bridge
Using Argos for Data Integration and Automation
@CUI_Crosier #evisions
No documentation or support(Original developer no longer available)
Unreliable and no logging or error output
Complicated and convoluted architecture
24 hours to complete a full cycle
Time consuming to manage and update
Rapidly becoming more mission critical
The Challenge
@CUI_Crosier #evisions
Track down the original developer for help(Whether by bribery or coercion)
Rebuild the broken “black-box” parts on our own
Scrap it all and build it better(Whether we use home-grown or off-the-shelf components)
The Options
@CUI_Crosier #evisions
Develop Argos Datablocks to execute
Use Argos to schedule processes
Build Argos extract reports for return data
The Architecture – Design Process
@CUI_Crosier #evisions
The Architecture – Components
20
21
12
3
8
9
10
17
18
19
11
12
13 14
15
16
5
6
7
1. AY Application Started Dataset2. AY Application Submitted Dataset3. Web Inquiry Form Submitted Dataset4. Bulk Loaded Dataset5. CAO Application In Progress Dataset6. CAO Application Completed Dataset7. CAO Application Supplement Submitted Dataset8. CRM Application Create/Update Dataset9. CRM Application Decision/Deposit Dataset10. CRM Merit Award Dataset11. MySQL Application Submitted Dataset12. MySQL Application Decision/Deposit Dataset13. MySQL Merit Award Dataset14. Banner ID Dataset15. Banner Financial Aid Award Dataset16. Banner Enrolled / Cancelled Dataset17. MySQL Banner ID Dataset18. MySQL Financial Aid Award Dataset19. MySQL Enrolled / Cancelled Dataset20. Argos Admissions Application Funnel Dataset21. Banner Student Records Information Dataset
Hobsons Apply Yourself (AY)
CUI Web Inquiry Form
Common App Online (CAO)
Local Application BridgeSchema
Hobsons Connect (CRM)
Banner StudentSchema
Argos Application Engine & Scheduler
External Bulk Dataload & Paper
Applications
4
@CUI_Crosier #evisions
The Architecture – Dataflow Overview
Student
Applies
in AY/CAO
or CUI App
App Bridged
to Connect
App
Submitted
App Submit
Set in
Connect
Connect App
Bridged to
Banner
ID Created
in Banner
ID Bridged
to Connect
Accept /
Deposit in
Connect
Dec/Dep
Bridged to
Banner
SAADMS
Updated in
Banner
SGASTDN
Record
Generated
IT Process
Creates
Accounts
FA
Information
Bridged to
Hobsons
Student
Registers in
Banner Self-
Service
Enroll
Bridged to
Hobsons
@CUI_Crosier #evisions
App
Submit
Data
Banner ID
Extract
Financial
Aid Extract
Decision
Data
Deposit
Data
Enroll
Extract
Other Data
Extract
The Architecture – Dataflow & Datablocks
Misc Data Datablock Apps Datablock
CID/BID Datablock
FINAID DatablockDec/Dep Datablock
Reg Datablock
@CUI_Crosier #evisions
Develop Argos Datablocks to execute
Use Argos to schedule processes
Build Argos extract reports for return data
Use the existing Oracle “bolt-on” schema
Develop new packages and procedures
Continue using internal Banner App Processing
The Architecture – Design Process
@CUI_Crosier #evisions
The Architecture – Technical
@CUI_Crosier #evisions
Reliable bridging with verbose error logs
4+ hours/week maintaining is now > 5 min/week
Complete documentation and source code
Most bridge process run hourly or on-demand
Average failure rate from ~12% to > 2%
Very simple to extend and expand as needed
The Results
@CUI_Crosier #evisions
Incorporate Web Services for App/Dec data
Update App Submit to hourly, rather than 4x/day
Update Dec/Dep to hourly, rather than 4x/day
Add New Race/ New Ethnicity to bridge
Add new reporting dataset for Argos
Add error detection and auto-mitigation
What’s Next
@CUI_Crosier #evisions
Questions&
Answers
Jon Crosier – Concordia University Irvine
@CUI_Crosier #evisions