G Troubleshooting

Plugins Prerequisites Check Configuration Assistant

Log Files

Review the following log files:

• $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

• $<OMS_HOME>/cfgtoollogs/pluginca/configplugin_prereq_check_<timestamp>.log

Workaround Steps

Run the following command:

$<OMS_HOME>/oms/bin/pluginca -action prereqCheck -oracleHome <oms_home_path> -middlewareHome <middleware_home_path> -plugins <plugin_id>=<plugin_version>

Repository Configuration Assistant

Log Files

Review the following log files:

• $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

• $<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.<ACTION>/

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Clean up the Management Repository by running the following command:

   $<OMS_HOME>/sysman/admin/emdrep/bin/RepManager <repository_database_host> <repository_database_port> <repository_database_sid> -action dropall -dbUser <repository_database_user> -dbPassword <repository_database_password> -dbRole <repository_database_user_role> -mwHome <middleware_home> -mwOraHome <oms_oracle_home> -oracleHome <oms_oracle_home>

   Note:

   • For Microsoft Windows, invoke RepManager.bat.

   • RepManager 12.1 and 11.1 from the OMS home support -action dropall (drops SYSMAN as well as SYSMAN_MDS) and -action drop (drops only SYSMAN).

   • RepManager 10.2.0.5 supports -action drop (drops only SYSMAN).

3. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

Repository Out Of Box Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.<ACTION>/

Workaround Steps

1. Resolve the cause of the issue.

   Caution:

   Do NOT clean up or drop the Management Repository.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

MDS Schema Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/emmdscreate_<timestamp>.log

For more information, review the following log files:

• <OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.CREATE/mds.log

• $<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.CREATE/rcu.log

Workaround Steps

Follow these steps:

1. Drop the MDS schema by running the following command from the OMS home:

   $<OMS_HOME>/sysman/admin/emdrep/bin/mdsschemamanager.pl -action=-dropRepository -connectString=<database_connect_string> -dbUser= <database_user> -dbPassword=<database_password> -oracleHome=<OMS_oracle_home> -mwHome=<middleware_home>

   Where <database_connect_string> must be in the following format:<database_host>:<database_port>:<database_sid>

2. Rerun the Configuration Assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

OMS Configuration Assistant

Log Files

Review the following log files:

• If the installer fails BEFORE the OMS configuration assistant starts running, then review the following log file:

  $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

• If the installer fails AFTER the OMS configuration assistant starts running, then review the following log file:

  $<OMS_HOME>/cfgtoollogs/omsca/omsca_<timestamp>.log

Workaround Steps

Follow these steps:

1. Check whether any Java processes are running from the Middleware home. To do so, run the following command from the host where the OMS is running:

   ps -ef | grep java | grep <Oracle_Middleware_Home>

2. Kill all the running processes, except for installer-related Java processes, by the running the following command. The installer-related Java processes run from the temp directory, so you can ignore the processes from that directory.

   kill -9 <process_id>

3. Remove the Oracle Management Service Instance Base by running the following command:

   rm -rf <OMS_Instance_Home>

4. Rerun the Configuration Assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

Plugins Deployment and Configuration Configuration Assistant

Log Files

Review the following log files:

• $<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

• $<OMS_HOME>/cfgtoollogs/pluginca/configplugin_deploy_<timestamp>.log

Workaround Steps

Run the following command:

$<OMS_HOME>/oms/bin/pluginca -action deploy -oracleHome <oms_home_path> -middlewareHome <middleware_home_path> -plugins <plugin_id>=<plugin_version>

Start Oracle Management Service Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Run the following command:

$<OMS_HOME>/bin/emctl start oms

Plugins Inventory Migration Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

Oracle Configuration Manager Repeater Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

OCM Configuration for OMS Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

Agent Configuration Assistant

Log Files

Review the following log files:

• $<AGENT_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

• If secure fails, then review the following log file:

  $<AGENT_HOME>/sysman/log/secure.log

• In the log file, search for the following statement:

  SEVERE:Plugin configuration has failed.

  If you find this statement, then review the following log file:

  $<AGENT_INSTANCE_HOME>/install/logs/agentplugindeploy_<timestamp>.log

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

   If you are installing in silent mode, then run the following command from the Management Agent home:

   $<AGENT_HOME>/sysman/install/agentDeploy.sh OMS_HOST=<oms_host_name> EM_UPLOAD_PORT=<oms_upload_https_port> AGENT_REGISTRATION_PASSWORD=<agent_reg_password>

   Note:

   Enter the HTTPS port (secure port) for the EM_UPLOAD_PORT argument.

Agent Upgrade Configuration Assistant

Log Files

If the agent upgrade configuration assistant fails, then review the following log file:

$<AGENT_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Resolve the cause of the issue, and rerun the configuration assistant from the Jobs page of the Enterprise Manager Cloud Control console.

Repository Upgrade Configuration Assistant

Log Files

Review the following log files:

$<OMS_HOME>/cfgtoollogs/cfgfw/emmdscreate_<timestamp>.log

$<OMS_HOME>/sysman/log/schemamanager/m_<timestamp>/m_<timestamp>.<ACTION>/

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

Stopping APM Engines Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

Stop Admin Server Configuration Assistant

Log Files

Review the following log file:

$<OMS_HOME>/cfgtoollogs/cfgfw/CfmLogger_<timestamp>.log

Workaround Steps

Follow these steps:

1. Resolve the cause of the issue.

2. Rerun the configuration assistant.

   If you are installing in graphical mode, then return to the Enterprise Manager Cloud Control Installation Wizard and click Retry.

   If you accidentally exit the installer before clicking Retry, then do NOT restart the installer to reach the same screen; instead, invoke the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If you are installing in silent mode, then rerun the runConfig.sh script (runConfig.bat on Microsoft Windows) from the OMS home:

   $<OMS_HOME>/oui/bin/runConfig.sh ORACLE_HOME=<oms_home_path> MODE=perform ACTION=configure COMPONENT_XML={encap_oms.1_0_0_0_0.xml}

   If the runConfig.sh script fails, then clean up your environment and redo the installation.

   Note:

   For Microsoft Windows, run runConfig.bat.

ADP Manager Name Conflict

Error Message

When you deploy ADP Manager to an existing managed server whose instance (for example: EMGC_ADPMANAGER2) has not been completely removed, then the new deployment of ADP manager with the same name fails on the unzip step with the following error:

@ Are you sure you haven't deployed adp manager to a managed server with name  
@ <ADP_managed_server> already?

Workaround Steps

To remove the existing managed server completely, perform the following steps:

1. Follow the steps listed in Chapter 17 to remove the ADP Manager application and the managed server to which the ADP application is deployed.

2. Connect to the host machine where the managed server was present, and navigate to the following location to manually delete the managed server (EMGC_ADPMANAGER2):

   $DOMAIN_HOME/<ADP_managed_server>
   
   Where, $DOMAIN_HOME is the location of the Cloud Control domain
   

Failure to Deploy ADP Agent On a Target

Error Message

While deploying the ADP Agent, the deployment job may fail on the Deploy ADP Agent On Target step, with the following error:

Failed to connect to https://<host>:<port>/HttpDeployer/HttpDeployerServlet

Also, if you check the output of the Deploy HttpDeployer OnTarget (the previous step), then you will see a message as follows:

Operation is pending and will be activated or cancelled when the ongoing edit session is activated or cancelled.

Workaround Steps

To correct this error, perform the following steps:

1. Log into WebLogic Administration Console of the domain where the ADP Agent was to be deployed.

2. On the Administration home page, click Save Changes or Discard Changes, and start deploying the ADP agent afresh.

SSL Handshake Failure Agent Deployment Errors

Error Message

If the WebLogic Domain is SSL enabled using a demo certificate, then the agent deployment may fail due to an SSL Handshake Failure. The following error normally occurs because the demo certificate is not present in AgentTrust.jks:

Certificate chain received from myhost.acme.com - 123.34.11.11 was not trusted causing SSL handshake failure. Check the certificate chain to determine if it should be trusted or not. If it should be trusted, then update the client trusted CA configuration to trust the CA certificate that signed the peer certificate chain. If you are connecting to a WLS server that is using demo certificates (the default WLS server behavior), and you want this client to trust demo certificates, then specify -Dweblogic.security.TrustKeyStore=DemoTrust on the command line for this client.

Note: If the WebLogic Domain is using a production certificate, then this issue will not occur as AgentTrust.jks has trusted certificates from all well known CA's.

Workaround Steps

To correct the error, import WebLogic demo certificate to Management Agent keystore as follows:

1. Export WebLogic Demo certificate from cacerts file. This file is present under the WebLogic home of the Middleware installation at the following location:

   keytool -export -keystore $WEBLOGIC_HOME/server/lib/cacerts -alias certgencab -file mycert.cer

   Press Enter when prompted for a password.

2. Import WebLogic Demo certificate to TrustStore of Oracle Management Agent as follows:

   keytool -import -keystore $ORACLE_HOME/core/12.1.0.0.0/stage/sysman/config/montrust/AgentTrust.jks -alias wlscertgencab -file mycert.cer

   Enter the password welcome when prompted, and press Enter.

To check if the certificate has been imported correctly, run the following command:

keytool -list -keystore $ORACLE_HOME/core/12.1.0.0.0/stage/sysman/config/montrust/AgentTrust.jks

Where, $ORACLE_HOME is Oracle Management Agent home.

Press Enter when prompted for password, a certificate with the name wlscertgencab is generated with the current date.

Copying ADP Agent Zip or Javadiagnosticagent Ear Step Failure

Error Message

If the users who installed the OMS, and the Management Agent are not in the same group, then the job fail on Copying ADP Agent Zip step for an ADP agent, and Copy Javadiagnosticagent Ear step for a JVMD agent, with the following error:

oracle.sysman.emSDK.emd.comm.RemoteOperationException: Error while streaming
JobReader:java.io.IOException: Broken pipe

Workaround Steps

To correct the error, either install the Enterprise Manager Agent using OMS host user credentials.

OR

Enable sudo or Powerbroker settings for the agent host, so that the job runs as if run by an OMS host user.

To set the sudo, or Powerbroker settings, do the following:

1. In Cloud Control, from the Setup menu, select Security, and then click Privilege Deligation.

2. On the Manage Privilege Delegation Settings page, do the following:

   1. Select the Sudo or PowerBroker from the type menu.

   2. Enter the host name, or alternatively select the name from the list of host targets. Ensure that the host selected corresponds to the EM Agent; this agent must be the one monitoring the WebLogic Domain where the ADP/JVMD agents have to be deployed.

   3. Click Go.