dynamic batch processing march 19 10:00 am david steger
TRANSCRIPT
![Page 1: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/1.jpg)
Dynamic Batch ProcessingMarch 19 10:00 AM
David Steger
![Page 2: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/2.jpg)
Batch Types
• Run my routine in background right now • Run my routine in the evening or another day• Run my group of programs when requested• Run my programs on a regular schedule• Others?
![Page 3: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/3.jpg)
Batch Processing with 36.14 Today
![Page 4: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/4.jpg)
36.14.1 and 36.14.13
![Page 5: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/5.jpg)
36.14.13
![Page 6: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/6.jpg)
Dynamic Batch Processing
![Page 7: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/7.jpg)
Dynamic Batch Processor
Batch Entries
Batch ParameterDefinitions
Dynamic BatchEntries
+
=
![Page 8: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/8.jpg)
Dynamic Batch Processor
Batch Entries
Batch ParameterDefinitions
Dynamic BatchEntries
+
=
Standard QAD MFG/Pro
![Page 9: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/9.jpg)
Dynamic Batch Processor
Batch Entries
Batch ParameterDefinitions
Dynamic BatchEntries
+
=
Date Formulas, Operations,
Etc.
![Page 10: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/10.jpg)
Dynamic OperationsBlank
Literal - the data entered in the value field
UUnix Environment Variable: The Unix environment variable name is entered in the value field.
DThe date that is returned by the Date Formula that is entered in the value field
SSubstring of a value. Three parameters are entered in the value field:
P Value of another parameter
MMMonth of a date returned by the Date Formula that is entered in the value field
DDDay of a date returned by the Date Formula that is entered in the value field
Y2Year of a date returned by the Date Formula that is entered in the value field - the 2 digit year is returned
Y4Year of a date returned by the Date Formula that is entered in the value field - 4 digit year is returned
VValue of another parameter. This is used when "con-cating" the values of fields together.
![Page 11: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/11.jpg)
Dynamic Date FormulasEOM End of Month
BOM Beginning of Month
EOY End of year
BOY Beginning of Year
TODAY Today's date
HI QAD High Date
HIGH QAD High Date
LO QAD Low Date
LOW QAD Low Date
LYD Last year's date (this date, but last year)
EOQ End of Quarter
BOQ Beginning of Quarter
ECP End of GL Calendar Period
BCP Beginning of GL Calendar Period
PER Period
Sun,Mon,Tue,Wed,
Thu,Fri,SatSelect this day of this week
+n Add n number of days
-n Subtract n number of days
![Page 12: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/12.jpg)
Example 1: User Run Batch
![Page 13: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/13.jpg)
Determine the Parameters
![Page 14: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/14.jpg)
Determine the Parameters
Capture frame object“a”
![Page 15: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/15.jpg)
Determine the Parameters
![Page 16: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/16.jpg)
Load the Parameters
![Page 17: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/17.jpg)
Load the Parameters
![Page 18: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/18.jpg)
Modify Static Parameters
![Page 19: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/19.jpg)
Modify Static Parameters
![Page 20: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/20.jpg)
Define Dynamic Parameters
![Page 21: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/21.jpg)
Using Date FormulasEOM End of Month
BOM Beginning of Month
EOY End of year
BOY Beginning of Year
TODAY Today's date
HI QAD High Date
HIGH QAD High Date
LO QAD Low Date
LOW QAD Low Date
LYD Last year's date (this date, but last year)
EOQ End of Quarter
BOQ Beginning of Quarter
ECP End of GL Calendar Period
BCP Beginning of GL Calendar Period
PER Period
Sun,Mon,Tue,Wed,
Thu,Fri,SatSelect this day of this week
+n Add n number of days
-n Subtract n number of days
![Page 22: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/22.jpg)
Using Date FormulasEOM End of Month
BOM Beginning of Month
EOY End of year
BOY Beginning of Year
TODAY Today's date
HI QAD High Date
HIGH QAD High Date
LO QAD Low Date
LOW QAD Low Date
LYD Last year's date (this date, but last year)
EOQ End of Quarter
BOQ Beginning of Quarter
ECP End of GL Calendar Period
BCP Beginning of GL Calendar Period
PER Period
Sun,Mon,Tue,Wed,
Thu,Fri,SatSelect this day of this week
+n Add n number of days
-n Subtract n number of days
![Page 23: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/23.jpg)
Test the Formula
Today, BCP, -1, ECP
![Page 24: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/24.jpg)
Define Output
![Page 25: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/25.jpg)
Run the Batch
![Page 26: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/26.jpg)
Example 2: Scheduled Batchs
![Page 27: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/27.jpg)
Dynamic Batch Scheduling
Queue Processor
Batch Schedule
Run Queue(batches)
+
=
![Page 28: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/28.jpg)
Dynamic Batch Scheduling
Queue Processor
Batch Schedule
Run Queue(batches)
+
=
Run by cron:DB, Queue, at HH:MM
![Page 29: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/29.jpg)
Dynamic Batch Scheduling
Queue Processor
Batch Schedule
Run Queue(batches)
+
=
Run this Queue onDate, Hour, etc.
![Page 30: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/30.jpg)
Key Scripts
• bpsched
– The batch processor script bpsched is run on regular intervals each hour, up to once each minute. This script is executed by cron under the crontab file for the userid batproc. bpsched checks the minute number (00-59) to determine which combination of queue and database to execute that specific minute.
• schedpro2
– bpsched executes the script schedpro2. schedpro2 can launch multiple instances of the batch processor based on the data in it's configuration file. The configuration file lists database and pf file combinations. Configuration files are stored in the system batchproc directory.
• m9sched
– schedpro2 executes m9sched for each database defined in the configuration file. The m9sched script executes the progress session which runs t2bpstart.p from the QAD menu.
![Page 31: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/31.jpg)
What is a Queue?
• Configured in bpshed
case $M in 00) $BP -q Q00 -c live 15) $BP -q Q15 -c live 30) $BP -q Q30 -c live45) $BP -q Q45 -c liveesac
![Page 32: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/32.jpg)
Dynamic Batch Output
Queue Processor
Batch Output
Processor Run Logand
creates
![Page 33: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/33.jpg)
Dynamic Batch Output
Queue Processor
Batch Output
Processor Run Logand
creates
Text Output, PDF Output,
Email to user, etc.
![Page 34: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/34.jpg)
Define the Scheduled Batch
![Page 35: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/35.jpg)
How the batch id can alter results
![Page 36: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/36.jpg)
How the batch id can alter results
![Page 37: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/37.jpg)
How the batch id can alter results
![Page 38: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/38.jpg)
Other Operation TypesBlank
Literal - the data entered in the value field
UUnix Environment Variable: The Unix environment variable name is entered in the value field.
DThe date that is returned by the Date Formula that is entered in the value field
SSubstring of a value. Three parameters are entered in the value field:
P Value of another parameter
MMMonth of a date returned by the Date Formula that is entered in the value field
DDDay of a date returned by the Date Formula that is entered in the value field
Y2Year of a date returned by the Date Formula that is entered in the value field - the 2 digit year is returned
Y4Year of a date returned by the Date Formula that is entered in the value field - 4 digit year is returned
VValue of another parameter. This is used when "con-cating" the values of fields together.
![Page 39: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/39.jpg)
Logs
![Page 40: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/40.jpg)
Logs
Batch Log
![Page 41: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/41.jpg)
Future SOX Enhancements
• Error detection via keywords– Email notification for job errors– Email notification for report errors
• Batch Run Access Restrictions– Group ID batproc can run all batch events– “Submitted by” used to restrict users to their batch events
• Enable/Disable extended to individual batch events– New “batch” or “background” events default to enable– All other new events default to disable
![Page 42: Dynamic Batch Processing March 19 10:00 AM David Steger](https://reader038.vdocuments.us/reader038/viewer/2022102801/5697bf751a28abf838c7fff5/html5/thumbnails/42.jpg)
Dynamic Batch Processing