Process Management in DataStage

May 12, 2008 · Filed Under DataStage Articles 

Purpose :

  • How to avoid “Kill -9” or “SIGKILL” use.
  • How to release a stuck job from DataStage Director.
  • How to kill orphaned / runaway processes using DS Administrator.
  • Use Kill command wihout “-9″.
  • Clean up zombies / orphan phantom processes.
  • How to increase number of jobs / processes to run in DataStage.

What are Phantom processes?

      When a DataStage job runs, it creates one or more phantom processes on your DataStage server. Generally, one phantom process for the job, and one for each active stage within the job. Each phantom process has its own log file that records information about the process’s execution. Log files are created in the folder &PH&. A &PH& folder exist in each DataStage project folder. A DataStage job phantom will create a log file in the &PH& folder named with the prefix DSD.RUN_, a DataStage active stage will create a log file in the &PH& folder named with the prefix DSD.StageRun_. All log files end with a time and date suffix.

Phantom processes hogging CPUs

      DataStage server can experience very slow response time due to system resources being tied up by Orphaned/Runaway processes. These processes can occur when DataStage processes are not exited properly, i.e. the main process terminates abnormally or unexpectedly. Runaway processes are especially problematic; runaway processes can take up CPU cycles and other system resources (memory, disk space) which can result in sluggish performance from the DataStage server. Orphaned processes clog up the process table.

Clearing PH folder

The &PH& folder fills over time. You may notice that the time between when a job says it is finishing, and when it actually ends, increases (i.e. Delays in the termination of a DataStage jobs). This may be a symptom of a too full &PH& folder. To correct this, periodically delete the files in the &PH& folder. Way to do this is in DataStage Administrator, select the projects tab, click your project, then press the Command button, enter the command CLEAR.FILE &PH&, and press the execute button.

NOTE: Ensure there are no DataStage jobs running anywhere on the system when you do this.

Full document can be found in this link (Password Protected) :  Process Management in DS

Tags: , , , , ,

Comments

4 Responses to “Process Management in DataStage”

  1. swarup on June 24th, 2008 8:19 pm

    Please provide the password for Process Management in DS document.

    Thanks in advance….

    Thanks & regards,
    swarup

  2. Sai Kiran on July 1st, 2008 10:14 pm

    Hi Joshy,

    The document is very informative. Can you plz provide me with the login credentials?

    Rgds,
    Sai

  3. Ajith on July 4th, 2008 2:05 pm

    Hi Joshy,

    Can you please provide me with the password for reading Process Management in DS document.

    Thanks,
    Ajith

  4. sushree on July 8th, 2008 5:51 pm

    This doc is very informatic . Thanks

Leave a Reply