advanced agent builder - information sciences institute · url deconstruction miscellaneous....
TRANSCRIPT
![Page 1: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/1.jpg)
Advanced AgentBuilder
Martin Michalowski
![Page 2: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/2.jpg)
Announcements
Homework 3 posted Read submission instructions
Penalties from now on if submitted incorrectly DO NOT leave agents on lab computers
Will be deleted at the end of office hours Export your agents to hand in
![Page 3: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/3.jpg)
![Page 4: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/4.jpg)
Advanced Agent Builder
Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 5: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/5.jpg)
Advanced Agent Builder
Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 6: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/6.jpg)
Troubleshooting connectors
Look at header being submitted (in internetview) Make sure your connector is sending the right
values Redirects Sessions
Makes URL deconstruction easier (coveredlater)
![Page 7: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/7.jpg)
![Page 8: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/8.jpg)
Advanced Agent Builder Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 9: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/9.jpg)
Training Sample Pages
Adding additional pages because You already fetched all pages from connectors You need one more “representative” page
Can be added by: Local file From an existing connector
![Page 10: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/10.jpg)
![Page 11: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/11.jpg)
![Page 12: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/12.jpg)
Training Sample Pages
Setting Validation Checks that extracted value is correct Main source of agent errors
![Page 13: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/13.jpg)
![Page 14: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/14.jpg)
Training Sample Pages
Post-processing Done after extraction Not part of validation
![Page 15: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/15.jpg)
![Page 16: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/16.jpg)
Advanced Agent Builder Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 17: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/17.jpg)
Extraction Rules
Manual classification possible Playing with rules
Rules are created by example if you are using bad sample pages, then agent learns
incorrect rules Rule locking
Useful when adding items after learning rules
Do it at your own risks
![Page 18: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/18.jpg)
![Page 19: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/19.jpg)
![Page 20: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/20.jpg)
Advanced Agent Builder Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 21: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/21.jpg)
Filtering
Filter the value of an attribute in dataschema view Filter all data or a list (can’t do individual item)
Why would you want to filter data? Limit the number of items returned
Example: Google results Limit how many times you follow next links
![Page 22: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/22.jpg)
![Page 23: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/23.jpg)
![Page 24: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/24.jpg)
Advanced Agent Builder Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 25: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/25.jpg)
URL deconstruction When submitting a form, sometimes a
website redirects to a different url Session id Forms within tables (homework #3??????) What can we do?
Make an output connector that points to thecorrect URL
Where can we find the pieces? On the page Capturing the header
![Page 26: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/26.jpg)
![Page 27: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/27.jpg)
![Page 28: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/28.jpg)
![Page 29: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/29.jpg)
![Page 30: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/30.jpg)
Advanced Agent Builder Troubleshooting connectors Training sample pages Extraction Rules Filtering URL deconstruction Miscellaneous
![Page 31: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/31.jpg)
Cloning a wrapper
![Page 32: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/32.jpg)
Parameter list
![Page 33: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/33.jpg)
Number of rows in a list
![Page 34: Advanced Agent Builder - Information Sciences Institute · URL deconstruction Miscellaneous. Advanced Agent Builder ... Google results](https://reader033.vdocuments.us/reader033/viewer/2022043004/5f88a33a8b2eb8294758fc2b/html5/thumbnails/34.jpg)
Questions?