Cover image for Building Custom Tasks for SQL Server Integration Services: The Power of .NET for ETL for SQL Server 2019 and Beyond

Building Custom Tasks for SQL Server Integration Services: The Power of .NET for ETL for SQL Server 2019 and Beyond

Release Date: 2021/02/01
ISBN: 9781484264829
Topic:
0%
29
Chapters
0-1
Hours read
0k
Total Words
    Start Reading Now    
       Add to Wishlist       
View table of contents

Build custom SQL Server Integration Services (SSIS) tasks using Visual Studio Community Edition and C#. Bring all the power of Microsoft .NET to bear on your data integration and ETL processes, and for no added cost over what you’ve already spent on licensing SQL Server. New in this edition is a demonstration deploying a custom SSIS task to the Azure Data Factory (ADF) Azure-SSIS Integration Runtime (IR).

All examples in this new edition are implemented in C#. Custom task developers are shown how to implement custom tasks using the widely accepted and default language for .NET development.

Why are custom components necessary? Because even though the SSIS catalog of built-in tasks and components is a marvel of engineering, gaps remain in the available functionality. One such gap is a constraint of the built-in SSIS Execute Package Task, which does not allow SSIS developers to select SSIS packages from other projects in the SSIS Catalog. Examples in this book show how to create a custom Execute Catalog Package task that allows SSIS developers to execute tasks from other projects in the SSIS Catalog. Building on the examples and patterns in this book, SSIS developers may create any task to which they aspire, custom tailored to their specific data integration and ETL needs.

 


What You Will Learn

  • Configure and execute Visual Studio in the way that best supports SSIS task development
  • Create a class library as the basis for an SSIS task, and reference the needed SSIS assemblies
  • Properly sign assemblies that you create in order to invoke them from your task
  • Implement source code control via Azure DevOps, or your own favorite tool set
  • Troubleshoot and execute custom tasks as part of your own projects
  • Create deployment projects (MSIs) for distributing code-complete tasks
  • Deploy custom tasks to Azure Data Factory Azure-SSIS IRs in the cloud
  • Create advanced editors for custom task parameters


Who This Book Is For

For database administrators and developers who are involved in ETL projects built around SQL Server Integration Services (SSIS). Readers do not need a background in software development with C#. Most important is a desire to optimize ETL efforts by creating custom-tailored tasks for execution in SSIS packages, on-premises or in ADF Azure-SSIS IRs.

Table of Contents

  1. Cover
  2. Front Matter
  3. 1. The Story of This Book
  4. 2. Preparing the Environment
  5. 3. Creating the Assembly Project
  6. 4. Check in the Project Code
  7. 5. Signing the Assembly
  8. 6. Preparing to Build
  9. 7. Coding the Task
  10. 8. Coding a Simple Task Editor
  11. 9. Signing and Binding
  12. 10. Expanding Editor Functionality
  13. 11. Minimal Coding for the Complex Editor
  14. 12. Editor Integration
  15. 13. Implement Views and Properties
  16. 14. Implement New Connection
  17. 15. Implement Use32bit, Synchronized, and LoggingLevel SettingsView Properties
  18. 16. Refactoring SourceConnection
  19. 17. Refactoring the SSIS Package Hierarchy
  20. 18. Instrumentation and Validation
  21. 19. Crushing Bugs
  22. 20. Adding Synchronous Execution Properties
  23. 21. Testing the Task
  24. 22. Building the Setup Project
  25. 23. Using the Execute Catalog Package Task in an SSIS Framework
  26. 24. Deploying to Azure-SSIS
  27. 25. Test the Task in Azure Data Factory
  28. 26. Notes from My Experience
  29. Back Matter
18.191.186.72