Monday, 23 May 2016

adop phase=prepare AdminServer has not yet started by master. Will wait for another minute

i was trying to run adop phase=prepare  and see the below error

"AdminServer has not yet started by master. Will wait for another minute"

The same error is seen , even if I run 

adop phase=fs_clone allnodes=no force=yes



      [EVENT]     [END   2016/05/19 23:29:32] Executing txkADOPValidation script on ovpxvcppd
    [EVENT]     [END   2016/05/19 23:29:32] Executing txkADOPValidation script on ovpxvcppd
        [EVENT]     [START 2016/05/19 23:29:32] Performing check to see if pending cleanup actions exist
          [EVENT]     No pending cleanup actions, proceeding with other steps
        [EVENT]     [END   2016/05/19 23:29:32] Performing check to see if pending cleanup actions exist
          [ERROR]     Cannot connect to database
          [ERROR]     Error Message : ORA-12514: TNS:listener does not currently know of service requested in connect descriptor (DBD ERROR: OCIServerAttach)
          [ERROR]     *** Error occurred while calling ad_zd_log. Please check log file for the details. ***
          [ERROR]     *** Error occurred while calling ad_zd_log. Please check log file for the details. ***
          [ERROR]     *** Error occurred while calling ad_zd_log. Please check log file for the details. ***
        AdminServer has not yet started by master. Will wait for another minute


First thing first , i thought its a db connection issue, since we see the below error in the log file:

 ORA-12514: TNS:listener does not currently know of service requested in connect descriptor (DBD ERROR: OCIServerAttach)

I checked the tnsnames.ora file  at $TNS_ADMIN and found the following entry 

  (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=xxxxxx)(PORT=1541))
            (CONNECT_DATA=
                (SERVICE_NAME=ebs_patch)
                (INSTANCE_NAME=EBSPD1)
            )
        )

Ran the following in database so that the listener registers the service ebs_patch as well.

alter system set service_names='EBSDB,ebs_patch'; 

Ran adop phase=abort and adop phase=cleanup and re-ran adop phase=prepare.

Again , it failed with the error " AdminServer has not yet started by master. Will wait for another minute"

Upon researching , I see no single hit in metalink(support.oracle.com)

Upon searching in google, some people commented, that the admin server in the patch file system needs to be started manually, for this command to finish successfully. 

I started up the admin server manually.

you can use the below command from patch file system

./adadminsrvctl.sh start forcepatchfs

or just run the nohup ./startWebLogic.sh & 
from
/u01/install/APPS/fs1/FMW_Home/user_projects/domains/EBS_domain_EBSPD/bin

After starting the admin server, I reran adop phase=abort and adop phase=cleanup and re-ran adop phase=prepare and it went through successfully.