DataStage: Script To Deploy Jobs

I have written a batch script to deploy DataStage jobs. The script itself runs on your computer and can push jobs wherever you want. The script is leveraging the DSXImportService that comes with DataStage installation.

The script can:

  • Push both parallel and sequence jobs and parameter files.
  • Works between projects as well as between environments (for example, dev to prod)

Steps

(1) Export the job into a folder on your computer.

(2) Prepare the authentication file in the same folder where the script is.

(3) Open Windows Command Prompt and run the batch script with the folder path of the exported job as an argument.

script.bat ./Desktop/Exported/

Script

@ECHO off
setlocal enabledelayedexpansion
set "dir1=%1
FOR /R %dir1% %%X in (*.dsx) DO (
<your installation path>\bin\DSXImportService  -ISAuthFile auth_file.txt \
-DSProject <Your Project Name> -DSXFile %%X -Overwrite -Verbose
echo %%X
)

auth_file.txt

user=<Your DataStage User name>
password=Your Password>
domain=<DataStage Server URL>:<Port No. Usually 9445>
server=<DataStage Server URL>
ETL
Running Jobs with Informatica Cloud REST API

Informatica Cloud offers REST API for us to interact with the platform programmatically. At this point in time, the latest official reference is found here. In this post, we are going to use Python to trigger jobs through API. Triggering a job is a 2-step process. We need to authenticate …

ETL
Tips and Troubleshooting For Uploading CSV to Database In Talend

There will be time when you want to upload a big csv file (with many rows and hundreds of columns) to a relational database table. Talend Open Studio is an open source ETL tool that I use regularly to do odd jobs like that. I like using it because it …

ETL
How To Rename Mapping Job In Informatica Cloud

Mappings are where all the magic happens in Informatica Cloud. When I started using it, it took me a while to work out how to rename a mapping job. Since then, a few people asked me the same question. So, I decided to write about it. This is probably the …