1/4/2023 0 Comments Fme schoolParent/Child Workspace Pitfalls x Not all writers can be used concurrently x Slow to run each child workspace separately x Recovery from data errors not easy if concurrent runs used Parent/Child Workspace Enticements Separate transformation from workflow Generate audit logs All authored within Workbench Parent/Child Workspace Ingredients Parent Workspace: PathReader WorkspaceRunner Child Workspace: FeatureWriter Batch Deploy Pitfalls x Recovery from data errors difficult x No granular log x Destination dataset naming can be tricky Batch Deploy Enticements Simple to set up Runs quickly Can script via command line Run on demand Wildcard Bulk Data Processing Pitfalls x Recovery from data errors difficult x Feature Type vs File vs Format Issues x No granular log x No ability to parallelize Wildcard Bulk Data Processing Enticements Simple to set up Can transform across file boundaries - Needs memory & time Any character between a and d inclusive Any of the sub-patterns a, b /**/ 0 or more subdirectories Dataset Wildcards Extended glob syntax: Symbol Matches ? Any single character * Any sequence of zero or more characters Any single character in chars. Multi-Dataset Picker Shapefile MapInfo Most rasters DWG DGN SQLite 250,000 CAD files & rasters on mobile devices FeatureReader and Writer In the Real World Web Client with FME copy data after writing FTP results Email an attachment Load into Dropbox or S3 Insert data into HTML file Database validation FME Server Notification 3rd Party Integration Can Write in Parallel! FeatureWriter (since FME 2016) Do things AFTER the data is written in FME Workbench. Read in data FME has written in the same workspace FeatureReader (since FME 2011) Solves problems such as: 1. The Heavy Lifters: Two key Transformers for Bulk Data Processing Meet the FeatureReader & FeatureWriter Course Schedule Tuesday: Your Data and FME Wednesday: Automating Everything Thursday: Expanding Frontiers FME Workbench Performance Tips & Tricks A Database for Every Occasion Working with Attributes in FME Bulk data processing Ultimate Real-Time: Monitor Anything, Update Anything FME in the Enterprise Remote sensing providers Web and business data into gold New + Upcoming in FME Cloud 40-minute talks
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
January 2023
Categories |