Friday, February 1, 2013



Datastage Common Errors and Solutions



1.      Failed to authenticate the current user against the selected Domain: Could not connect to server.

RC:     Client has invalid entry in host file
Server listening port might be blocked by a firewall
Server is down

SOL:   Update the host file on client system so that the server hostname can be resolved from client.
Make sure the WebSphere TCP/IP ports are opened by the firewall.
Make sure the WebSphere application server is running. (OR)
Restart Websphere services.

2.      The connection was refused or the RPC daemon is not running (81016)

RC:     The dsprcd process must be running in order to be able to login to DataStage.
If you restart DataStage, but the socket used by the dsrpcd (default is 31538) was busy, the dsrpcd will fail to start. The socket may be held by dsapi_slave processes that were still running or recently killed when DataStage was restarted.

SOL:   Run "ps -ef | grep dsrpcd" to confirm the dsrpcd process is not running.
Run "ps -ef | grep dsapi_slave" to check if any dsapi_slave processes exist. If so, kill them.
Run "netstat -a | grep dsprc" to see if any processes have sockets that are ESTABLISHED, FIN_WAIT, or CLOSE_WAIT. These will prevent the dsprcd from starting. The sockets with status FIN_WAIT or CLOSE_WAIT will eventually time out and disappear, allowing you to restart DataStage.
Then Restart DSEngine.       (if above doesn’t work) Needs to reboot the system.


3.      To save Datastage logs in notepad or readable format

SOL:   a) /opt/ibm/InformationServer/server/DSEngine  (go to this directory)
                ./bin/dsjob  -logdetail project_name job_name >/home/dsadm/log.txt
           b) In director client, Project tab  Print  select print to file option and save it in local directory.

4.      "Run time error '457'. This Key is already associated with an element of this collection."
SOL:   Needs to rebuild repository objects.

a)     Login to the Administrator client
b)     Select the project
c)      Click on Command
d)     Issue the command ds.tools
e)     Select option ‘2’
f)       Keep clicking next until it finishes.
g)     All objects will be updated.

5.      To stop the datastage jobs in linux level

SOL:   ps –ef   |  grep dsadm
           To Check process id and phantom jobs
           Kill -9 process_id

6.      To run datastage jobs from command line

SOL:   cd  /opt/ibm/InformationServer/server/DSEngine
           ./dsjob  -server $server_nm   -user  $user_nm   -password   $pwd  -run $project_nm    $job_nm



7.      Failed to connect to JobMonApp on port 13401.

SOL:   needs to restart jobmoninit script (in /opt/ibm/InformationServer/Server/PXEngine/Java)
           Type    sh  jobmoninit  start $APT_ORCHHOME
           Add 127.0.0.1 local host in /etc/hosts file
           (Without local entry, Job monitor will be unable to use the ports correctly)

8.   While running ./NodeAgents.sh start command... getting the following error: “LoggingAgent.sh process stopped unexpectedly”

SOL:   needs to kill LoggingAgentSocketImpl
              Ps –ef |  grep  LoggingAgentSocketImpl   (OR)
              PS –ef |               grep Agent  (to check the process id of the above)

9.     Warning: A sequential operator cannot preserve the partitioning of input data set on input port 0
SOL:    Clear the preserve partition flag before Sequential file stages.


10.     Warning: A user defined sort operator does not satisfy the requirements.
  SOL:   Check the order of sorting columns and make sure use the same order when use join stage after sort to joing two inputs.

11.     Conversion error calling conversion routine timestamp_from_string data may have been lost. xfmJournals,1: Conversion error calling conversion routine decimal_from_string data may have been lost

SOL:    check for the correct date format or decimal format and also null values in the date or decimal fields before passing to datastage StringToDate, DateToString,DecimalToString or StringToDecimal functions.

12.     To display all the jobs in command line

SOL:   cd /opt/ibm/InformationServer/Server/DSEngine/bin
./dsjob -ljobs <project_name>

13.      “Error trying to query dsadm[]. There might be an issue in database server”
SOL:   Check XMETA connectivity.
db2 connect to xmeta (A connection to or activation of database “xmeta” cannot be made because of  BACKUP pending)

14.      “DSR_ADMIN: Unable to find the new project location”
SOL:   Template.ini file might be missing in /opt/ibm/InformationServer/Server.
           Copy the file from another severs.

15.      “Designer LOCKS UP while trying to open any stage”
SOL:   Double click on the stage that locks up datastage
           Press ALT+SPACE
           Windows menu will popup and select Restore
           It will show your properties window now
           Click on “X” to close this window.
           Now, double click again and try whether properties window appears.

16.      “Error Setting up internal communications (fifo RT_SCTEMP/job_name.fifo)
SOL:   Remove the locks and try to run (OR)
           Restart DSEngine and try to run (OR)
Go to /opt/ibm/InformationServer/server/Projects/proj_name/
ls RT_SCT* then
           rm –f  RT_SCTEMP
           then try to restart it.

17.      While attempting to compile job,  “failed to invoke GenRunTime using Phantom process helper”
RC:     /tmp space might be full
           Job status is incorrect
           Format problems with projects uvodbc.config file
SOL:   a)         clean up /tmp directory
           b)        DS Director à JOB à clear status file
           c)         confirm uvodbc.config has the following entry/format:
                       [ODBC SOURCES]
                       <local uv>
                       DBMSTYPE = UNIVERSE
                       Network  = TCP/IP
                       Service =  uvserver
                       Host = 127.0.0.1

DataStage Client/Server Connectivity


Connection from a DataStage client to a DataStage server is managed through a mechanism based upon the UNIX remote procedure call mechanism.  DataStage uses a proprietary protocol called DataStage RPC
which consists of an RPC daemon (dsrpcd) listening on TCP port number 31538 for connection requests from DataStage clients.

Before dsrpcd gets involved, the connection request goes through an authentication process.  Prior to version 8.0, this was the standard operating system authentication based on a supplied user ID and password 
(an option existed on Windows-based DataStage servers to authenticate using Windows LAN Manager, supplying the same credentials as being used on the DataStage client machine – this option was removed for 
version 8.0). With effect from version 8.0 authentication is handled by the Information Server through its login and security service.

Each connection request from a DataStage client asks for connection to the dscs (DataStage Common Server) service.The dsrpcd (the DataStage RPC daemon) checks its dsrpcservices file to determine whether there is an entry for that service and, if there is, to establish whether the requesting machine's IP address is authorized to request the service.  If all is well, then the executable associated with the dscs service (dsapi_server) is invoked.

DataStage Processes and Shared Memory

Each dsapi_server process acts as the "agent" on the DataStage server for its own particular client connection, among other things managing traffic and the inactivity timeout.  If the client requests access to the Repository, then the dsapi_server process will fork a child process called dsapi_slave to perform that work.
Typically, therefore, one would expect to see one dsapi_server and one dsapi_slave process for each connected DataStage client.  Processes may be viewed with the ps -ef command (UNIX) or with Windows Task Manager.
Every DataStage process attaches to a shared memory segment that contains lock tables and various other inter-process communication structures.  Further each DataStage process is allocated its own private 
shared memory segment.  At the discretion of the DataStage administrator there may also be shared memory segments for routines written in the DataStage BASIC language and for character maps used for National 
Language Support (NLS).  Shared memory allocation may be viewed using the ipcs command (UNIX) or the shrdump command (Windows).  The shrdump command ships with DataStage; it is not a native Windows command.

RUN-TIME

Now let us turn our attention to run-time, when DataStage jobs are executing.  The concept is a straightforward one; DataStage jobs can run even though there are not clients connected (there is a command line interface (dsjob) for requesting job execution and for performing various 
other tasks).

However, server jobs and parallel jobs execute totally differently.  A job sequence is a special case of a server job, and executes in the same way as a server job.

Server Job Execution

        Server jobs execute on the DataStage server (only) and execute in a shell called uvsh (or dssh, a synonym).  The main process that runs the job executes a DataStage BASIC routine called DSD.RUN – the name of this program shows in a ps –ef listing (UNIX). This program interrogates the local Repository to determine the runtime configuration of the job, what stages are to be run and their interdependencies.  When a server job includes a Transformer stage, a child process is forked from uvsh also running uvsh but this time executing a DataStage BASIC routine called DSD.StageRun.  Server jobs only ever have uvsh processes at run time, except where the job design specifies opening a new shell (for example sh in UNIX or DOS in Windows) to perform some specific task; these will be child processes of uvsh.

Parallel Job Execution

        Parallel job execution is rather more complex.  When the job is initiated the primary process (called the “conductor”) reads the job design, which is a generated Orchestrate shell (osh) script.  The conductor also reads the parallel execution configuration file specified by the current setting of the APT_CONFIG_FILE environment variable.  Based on these two inputs, the conductor process composes the “score”, another osh script that specifies what will actually be executed.  (Note that parallelism is not determined until run time – the same job might run in 12 nodes in one run and 16 nodes in another run. 

        This automatic scalability is one of the features of the parallel execution technology underpinning Information Server (and therefore DataStage).Once the execution nodes are known (from the configuration file) the conductor causes a coordinating process called a “section leader” to be started on each; by forking a child process if the node is on the same machine as the conductor or by remote shell execution if the node is on a different machine from the conductor (things are a little more dynamic in a grid configuration, but essentially this is what happens).  Each section leader process is passed the score and executes it on its own node, and is visible as a process running osh.  Section leaders’ stdout and stderr are redirected to the conductor, which is solely responsible for logging entries from the job.

        The score contains a number of Orchestrate operators.  Each of these runs in a separate process, called a “player” (the metaphor clearly is one of an 
orchestra).  Player processes’ stdout and stderr are redirected to their parent section leader.  Player processes also run the osh executable.Communication between the conductor, section leaders and player 
processes in a parallel job is effected via TCP.  The port numbers are configurable using environment variables.  By default, communication between conductor and section leader processes uses port number 10000 (APT_PM_STARTUP_PORT) and communication between player processes and player processes on other nodes uses port number 11000 (APT_PLAYER_CONNECTION_PORT).
To find all the processes involved in executing a parallel job (they all run osh) you need to know the configuration file that was used.  This can be found from the job's log, which is viewable using the Director client or the dsjob command line interface.



To Release Locks in DATASTAGE



There are Three methods to unlock the DataStage jobs:

     – Using DataStage Administrator Tool.

     –Using UV Utility

     – Using DataStage Director


Unlock jobs -Using DataStage Administrator Tool:

      • Log into Administrator (as dsadm)

      • Open the Command line for the project

      • Execute “LIST.READU EVERY”

      • Identify the values for INODE and USER columns for the job for which the locks need to be released.

      • Execute UNLOCK INODE <inodenumber> ALL

      • UNLOCK USER <user number> ALL


Unlock jobs -Using UV Utility:

     • Logon to Unix

     • Su to dsadm

     • Go to a corresponding project

     • Type “UV”


     • Type “DS.TOOLS”

     • Select the option “4” (4. Administer processes/locks >>)

     • Again Select the option “4” (4. List all locks)

     • Identify the values for PID columns for the job for which the locks need to be released.

     • Then select the Option “7” (7. Clear locks held by a process)

     • Give the PID value here(Enter pid#=) and press Enter.

Unlock jobs -Using DataStage Director:

    – Open DataStage Director

    – Go to the Job

    – Cleanup Resources

    – In the Job Resources window,

    – Select “Show All” (Processes)

    – Find your User Name and click on “Logout”


 E

Monday, January 28, 2013


Facebook Prank



Facebooking is full of fun with chatting, commenting,liking and lot more stuff.But how long can we do the boring repeated things. So here are few funny Facebook tricks and pranks which makes your facebooking more interesting and more fun. 



1. Gost profile prank:

This is the best prank ever that I played on my friends. Ask your friends to check this [ GOST PROFILE ] . It will look like a scary ghost profile.But that's not the interesting part here, Ask your friend to click on photos. 
Here come the scary part, Out  of nowhere a ghost face comes out from the centre with a scary shout.
Your Friends shouts-Our prank rocks.
When I tried this prank on my friends few girls even shouted in fear.

2. Create your own Fake Wall Post:

fake+wall+post


Through [ Wall machine ] You can create a fake facebook status and conversation, And surprise your friends.. Check the below fake wall post of mine.

3. Facebook status Prank:

This is the yet another best prank I ever had with my friends on facebook. Just visit the below url.

http://facebook.com/profile.php?=73322363
Surprised? 
The above url will redirect to your home page.Now you might be questioning me whats prank in this.I will show you an example below how I used this to prank with my friends.

The person with facebook profile given below http://facebook.com/profile.php?=73322363 has posted some abusive content or photos on facebook. Cyber Crime police are searching for the person with above profile link.Please inform the police if you find that person.

Now when the person clicks the above link it will be redirected to his profile and the person will be shocked.Enjoy :) 

3. Fake news Generator:

Using this trick you can create a funny fake news about your friend on a website.
Go to [ Noob ]and enter the details mentioned there. Select a best news about your friend. and  After the entering the details. click publish. Now copy the link and share it on facebook and Prank your friends.

4. Find your friends crush using fake love calculator:

fake+love+calculator

Go to [ Crush bits ] and sign up for a free account. It will provide you a link. Now you just put your status like this.
"I have never seen such an accurate love calculating app like this " (along with your link)
Now just wait for few minutes. Definitely after seeing your status many of your friends will enter their crush names and will get trapped . You will receive an email whenever any friend of you enter the details there.
Using this prank I came to known many interesting crushes of my friends. 


Now its your turn to use them on your friends.





Mobile users get many missed calls daily. Sometimes it becomes necessary to trace out the number.In this article I posted 4 Best Possible Ways To Trace Out A Mobile Number in IndiaI listed the best possible ways though they may not gives you whole information but helps you to a great extent. 


HOW TO TRACE MOBILE NUMBER IN INDIA-4 BEST WAYS:

1.WIKI PAGE

Wiki Page contains mobile numbering system which contains a list of phone numbers and their network operators with locations. Thus, only first 4 digits of target phone number can be useful to trace mobile number in India using this mobile numbering system.
You can check out Wiki Page

2. Internet4Mobile:

If you want an automated system to trace mobile number, use this service provided by Internet4Mobile. There are many similar services available on Internet, but I recommend this one as it provides you following information about Mobile number:
  • State
  • City (only provided by this service).
  • Operator
  • Locate mobile number on Google Maps.
Trace out using Internet4Mobile

3. Mobile Tracking Software:

If you want to trace a mobile number in India directly from your cell phone, you can use Mobile phone application - Mobile Number Locator. This application allows you to find mobile number location right from your cellphone.

4.Some useful sites:

The following are some other useful sites in tracing mobile numbers

Is it really possible to know "Who Viewed Your Facebook Profile" ? 


     Are you eager to know what sorts of people visit your Facebook profile?

    This is quite natural. People who use social networking site like LinkedIn, Orkut and MySpace can get          to know this by tracking the visitors and can view the profile of the visitor. This feature is missing in    Facebook. However, there are few applications that let you know who visited your profile. But, speaking truly these applications cannot be trusted in terms of efficiency and security. Below are the oft spoken apps that claim to track profile visitors.

who-viewed-my-profile

DoorBell:

This app has more than 30,000 visitors currently. This is not very accurate as the user has to click the doorbell to get the stats recorded. This apps lets you put a doorbell, so that you get to know who visits your profile in Facebook.

Unfaced.com:

John Arrow, who developed the Unfaced.com apps, has been banned from Facebook. This apps is the only one that really works on Facebook. However it is against the rules and regulations of this social networking site. In fact Facebook tried to get into terms with John Arrow and suggested deleting the site, so that his Facebook account can be reinstated.

There are criticisms that Unfaced.com is a scam and cannot be relied completely. You cannot use this tracker site on your profile, because it is a violation of Facebook terms and your account will be terminated.

What is the reality?

Anybody using any form of tools or applications to track the people who visit his or her profile is against the terms and conditions of Facebook. When such applications are used Facebook may delete your account without warning as a breach of terms. The applications that claim to track the visitors’ profile are not owned or authorized by Facebook.

Fake Applications:

fake+facebook+apps


                     Most of the applications for tracking profiles are fake and fraudulent applications. They may be owned by hackers. They may also contain virus. In such cases, your Facebook account may be exploited by them for their own benefit. It is better to extremely cautious as these activities may turn you in bad light, for no fault of yours. Again virus tools may also lead to malfunctioning of your system. Few applications are well designed to get information about your email id. These will not only lead to unwanted marketing emails being received, but also, all your personal information can be tracked. Imagine what if your bank transactions are followed by your mail id? That is the worst that can happen.

                 It is never possible in Facebook for applications to see who has viewed your profile. Even the News feeds and other community feed applications, cannot track this piece of information but only see who keeps replying to the news feeds and people who are engaged to a specific sort of posts in a wall.
Best Practices To Protect Facebook Account From Hackers.

The terms and policies of Facebook clearly states that no one can track or view the visitors who visits the profiles. So, you can too visit anyone’s profile without his or her knowledge and using of the apps will not let them track you.

20 Proxy sites to browse the net anonymously
There are several reasons why you want to browse the internet anonymously. The most common reason is that when you're browsing the net, you'll leave a calling card on every website where you're from, what webbrowser you're using, what computer you use and more details. For some people this is reason enough to browse the internet hidden under a proxy. These servers will hide your details so that you'll be sure nobody will find out who you are. Additionally, these sites can be used to unblock sites such asMySpaceYouTube and other sites that are blocked on your work / school.
When you use a proxy, the request of the website will not be send to the website directly, but to the proxy. This request is the one with your personal information. The proxy sends your request to the website you want to view, but now uses the information of that proxy server. This simply means that you'll not be directly connected to the website, but the proxy site is. This extra step will make the browsing go slower, but that's all it takes to browse anonymously.
Proxy Websites
Here's a list of websites where you can enter an URL to browse the internet hidden under a proxy. Don't abuse these websites. For example, even if you're under a proxy, clicking links on Google Ads on your webpage will not help and is strictly against their TOS.

  • Anonymouse
    Anonymouse
     - It is fast, it is easy, and it is free!.
    Host: anonymouse.org
  • cIP-C
    cIP-C (Change IP Country)
     - The Change IP Country (cIPC) is our anonymizer program which acts as an HTTP or FTP proxy. Through it, you can can retrieve any resource that is accessible from the server this runs on. This is useful when your own access is limited, but you can reach a server that can in turn reach others that you can't. Selection of various countries.
    Host: ns.km21103.keymachine.de
  • You Are Hidden
    You Are Hidden
     - Unblock any website and hide your ip address. Many options, like removing client side scripting (JavaScript), storing cookies in sessions etc.
    Host: vps22.lunarpages.com
  • Maximum Proxy
    Maximum Proxy
     - Browse the internet securely. You can unblock popular sites such as Orkut, Gmail, Yahoo, MySpace, Bebo, Facebook, YouTube, Friendster and many other sites. Feel free to browse 24/7.
    Host: www.maximumproxy.com
  • The Proxy Bay
    The Proxy Bay
     - Identity theft is a huge problem in today's society. The transformation to online banking, checking, and bill paying has spawned a new avenue for thieves to steal from you. More important than money, though, is the personal information they can steal. Thieves use tactics commonly referred to as phishing. By using a proxy such as this one, you can greatly reduce your risk of identity theft.This website has a lot of partner websites also offering proxy surfing.
    Host: Depending on which partner
  • Nr1surf
    Nr1surf
     - The best and fastest free anonymous proxy. Surf and browse the web anonymously at school and work. Has a couple of partner websites in their proxy network.
    Host: Depending on which partner
  • BetterUnblock
    BetterUnblock
     - BetterUnblock is the better place to unblock websites at school or work. Using this site, you can unblock your favorite sites for free. Many options, like removing ads and having no referrer.
    Host: .
  • MySpace Unblocker
    MySpace Unblocker
     - If you're not comfortable knowing that any web site out there can easily collect this data (and much more) about you everytime you surf the web, then you should take advantage of free anonymous proxy sites such as this one. Many options, like removing client side scripting (JavaScript), storing cookies in sessions etc.
    Host: .
  • BypassMyspace
    BypassMyspace
     - Myspace Proxy allows users to access any blocked sites at school or work. Normally in schools and work you have sites are blocked by certain filters, using this site, you can access them by simply entering their address here. Many options, like removing client side scripting (JavaScript), storing cookies in sessions etc.
    Host: ht8.hagioteam.com
  • Proxy 108
    Proxy 108
     - Is your right to privacy being attacked? Are sites that you frequent being blocked by network administrators without your consent? Do you want to bypass these filters and surf where you want, when you want? Has a couple of partner websites where you can browse under a proxy.
    Host: Depending on which partner
  • I am Unblocked
    I am Unblocked
     - Fast, easy and free anonymous webbrowsing. Many options, like removing client side scripting (JavaScript), storing cookies in sessions etc.
    Host: .
  • Sneaky Anon
    Sneaky Anon
     - Sneaky Anon is a free anonymous web based proxy service. With our service you can browse websites even from firewall or blocked ports. Another one with many stripping options.
    Host: t512.1paket.com
  • Proxy 24
    Proxy 24
     - Proxy24 is a free web proxy list that allows anonymous surfing and online privacy. This site lists their proxy partners. Choose one to browse.
    Host: Depending on which partner
  • Proxytor
    Proxytor
     - Browse the internet securely using Proxytor.net. You can unblock popular social networking sites such as MySpace, Bebo, Facebook, YouTube, Friendster and many other sites. Our proxy is faster than others.
    Host: German IP address
  • Top 10 Proxy
    Top 10 Proxy
     - This is a list of the best proxy websites, the proxies are web-based. Browse the internet securely by using our proxies. Another website listing their partner proxy websites.
    Host: Depending on which partner
  • Free MySpace layouts
    Free MySpace layouts
     - Free site where you can get links to Myspace Proxy, Hi5 Proxy, Friendster Proxy and Anonymous Proxing Serving Sites. Scroll down to enter the URL.
    Host: foley.globat.com
  • PinkSocks
    PinkSocks
     - Pinksocks works with Youtube. Now you can watch youtube videos anywhere without being blocked. If by popular demand, we will also add support for Break, DailyMotion, and MetaCafe. Really fast proxy.
    Host: 74.86.11.229-static.reverse.eukvps.com
  • VGY7
    VGY7
     - Use our service to hide your IP address and bypass your work/school web filter with ease. Select from PHP proxy and CGI proxy.
    Host: meshkini.com
  • SilverSurf
    SilverSurf
     - Free web-based proxy sites let you to bypass work and school security by fetching the website's data themselves, and then sending it to you through the proxy site. Very fast proxy.
    Host: .
  • ProxyTop
    ProxyTop
     - Proxies are constantly being blocked by either schools work or your country. Proxytop will provide you with fresh proxies to stay one step ahead at all times. Website listing lots of partner websites providing a proxy. Select one to browse the net.
    Host: Depending on which partner