Oracle® Fusion Middleware Administrator's Guide for Oracle Enterprise Scheduling Service 11g Release 1 (11.1.1.6.0) Part Number E24712-01 |
|
|
PDF · Mobi · ePub |
This chapter describes how you can monitor performance of Oracle Enterprise Scheduling Service job requests and server instances. You can also get component status and log information.
This chapter includes the following topics:
Monitoring Oracle Enterprise Scheduling Service Request Activity
Monitoring the Performance of a Single Oracle Enterprise Scheduling Service Instance
Monitoring Key Performance Metrics for Oracle Enterprise Scheduling Service
Viewing General Oracle Enterprise Scheduling Service Instance Information
Much of the monitoring you'll do is related to job requests, where Oracle Enterprise Scheduling Service work is done. You can get a snapshot of recent work done as job requests, including the load those requests are placing on the system. You can also view the status of current and pending requests.
For an Oracle Enterprise Scheduling Service instance, you can find out how it is performing currently and how it has performed historically.
You can get the status of a service instance, as well as service components such as the request dispatcher and processor.
Finally, you can get log information about job requests and Oracle Enterprise Scheduling Service.
Use Fusion Middleware Control to do most of the monitoring you'll need. It's user interface provides data about system performance in both graphical and tabular form.
You can monitor job requests using Oracle Enterprise Manager Fusion Middleware Control Console. On the console's Scheduling Service Home page, you can get the following information:
A list of the 10 job requests that have been running for the longest period of time.
A list of the top 10 job requests that are waiting to be run.
A chart showing completion status percentages for job requests over the last hour.
A chart showing the number of requests completed in the last hour, along with the average processing time over that period.
A list of performance data, such as average and maximum processing and wait times.
In the Oracle Enterprise Manager Fusion Middleware Control Console, the Oracle Enterprise Scheduling Service home page displays two important categories of information: data about the top ten long running scheduled jobs and data about the top ten job requests awaiting execution. These are displayed on separate tabs.
By default, only the job requests within the current scheduling service display. However, you can change the scope such that all relevant scheduled jobs running on all scheduling services sharing the Oracle Enterprise Scheduling Service repository display in the tabs.
Each of the tabs includes a table that displays a short list of job requests. The Show All Ready or Show All Running link at the bottom of the region displays a search page in which it is possible to search for a more comprehensive list of relevant job requests.
Each tab displays the following information about scheduled job requests:
Request ID: The ID associated with the job request.
Run Time/Wait Time: The period of time during which the job request has been running or awaiting execution, respectively.
Job Definition: The job definition associated with the job request.
Submitted by: The name of the user who submitted the job request.
Application: The name of the application with which the job request is associated.
Execution Type: The category of job being executed—Java, SQL or process job.
Description: An optional description of the scheduled job request.
This section contains the following topics:
Viewing Top Ten Long Running Oracle Enterprise Scheduling Service Requests
Viewing Top Ten Oracle Enterprise Scheduling Service Jobs Ready to Be Executed
The Top Ten Long Running Requests tab displays the top ten long running scheduled job requests, including request ID, job run time, job definition used, executing application, job execution type and description. You can set the scope of the top ten long running requests displayed to the current scheduling service only, or all scheduling services sharing the Oracle Enterprise Scheduling Service repository.
Use the Top Ten Long Running Job Requests tab to view the job requests that have been running for the longest period of time on the Oracle Enterprise Scheduling Service service. You can alternatively change the scope of the region to display the top ten long running job requests on all scheduling services sharing the same repository.
The job requests displayed will all have a status of RUNNING
.
To view the top ten long running requests:
From the navigation pane, expand the Scheduling Services folder and select the Oracle Enterprise Scheduling Service application.
At the top of the Oracle Enterprise Scheduling Service home page, click the Top 10 Long Running Requests tab to display the ten job requests that have been running the longest.
To display all running job requests, click Show All Running at the bottom of the chart. This displays a search form that searches for all requests that are currently running. Click Search to display the requests.
The Top Ten Ready Job Requests tab displays the top ten scheduled job requests that await execution. The tab displays the same information as the Top Ten Long Running Requests tab, except the wait time displays for each job rather than the run time.
Use the Top Ten Ready Job Requests tab to view the job requests that are awaiting execution on the Oracle Enterprise Scheduling Service. You can also change the scope of the region to display the top ten ready job requests on all scheduling services sharing the same repository.
The job requests displayed will all have a status of READY
.
To view the top ten ready job requests:
From the navigation pane, expand the Scheduling Services folder and select the Oracle Enterprise Scheduling Service application.
At the top of the Oracle Enterprise Scheduling Service page, click the Top 10 Ready Requests tab to display the ten job requests with the status READY
.
To display all ready job requests, click Show All Ready at the bottom of the chart. This displays a search form that searches for all requests with the status READY
. Click Search to display the requests.
You can view the status of completed job requests on the Scheduling Service home page of the Fusion Middleware Control. There, in the Completed Job Requests region, each completion status is shown as a percentage of the total of job requests completed in the last hour. Status shown includes Success, Warning, Error, and Cancelled.
You can view the information about the processing load that has been required to complete job requests on the Scheduling Service home page of the Fusion Middleware Control. In the Response and Load region, you can view performance monitoring statistics regarding the time required to process to job requests.
Table 6-1 describes the performance monitoring statistics in the Response and Load region.
Table 6-1 Response and Load Statistics
Statistic | Description |
---|---|
Average Processing time for Last Hour |
This metric specifies the average time required to process jobs during the last hour. |
Requests Completed Per Hour |
This metric specifies the number of scheduled job requests completed within the last hour. |
You can view job request processing and wait times on the Scheduling Service home page of the Fusion Middleware Control.
Table 6-2 describes the performance monitoring statistics in the Performance region.
Table 6-2 Performance Statistics
Statistic | Description |
---|---|
Maximum Processing Time |
The maximum amount of time required to process a scheduled job. |
Average Processing Time |
The average amount of time required to process a scheduled job. |
Maximum Wait Time |
The maximum amount of time during which a scheduled job waits before running. |
Average Wait Time |
The average amount of time during which a scheduled job waits before running. |
You can monitor the performance of an Oracle Enterprise Scheduling Service instance, specifically current and historical performance data, as well as a summary of all performance data. Performance data displays in a chart set that you can save, delete, and reorder. You can also modify the time period for which performance data displays.
This section contains the following topics:
Viewing a Summary of Oracle Enterprise Scheduling Service Activity
Viewing Current Oracle Enterprise Scheduling Service Activity
Viewing Historical Oracle Enterprise Scheduling Service Reports
The Oracle Enterprise Scheduling Service Performance Summary page displays current charts of job requests such as requests completed per hour, running requests, requests by processing time and requests by status.
To view a summary of Oracle Enterprise Scheduling Service activity:
From the Scheduling Service menu, choose Performance > Service Summary.
By default, this page displays job requests running during a selected time period in the following categories:
Requests completed per hour
Processing times, average, minimum and maximum
Running requests and maximum running requests
Requests over the past hour with the status SUCCESS
, WARNING
, ERROR
or CANCEL
.
You can change the metrics displayed on the Service Summary performance page. Click the Show Metric Palette button to display the metric palette for Oracle Enterprise Scheduling Service.
You can change the duration for which performance data display.
Optionally, you can change the display format of performance data on the page.
Choose View > Grid to remove the grid display format from the charts.
Click the Table View link to display the performance data in table format.
You can overlay an additional scheduler service over the current service performance metrics.
Choose Overlay > Another Scheduler Service.
In the Search and Select: Targets window, enter the name of the target and host server and click Go to search for the relevant service.
From the search results table, select the relevant service and click Select to choose the scheduler service to overlay.
Additionally, you can take any of the following actions.
Save the chart set, as described in Section 6.3.4.1, "Saving a Chart Set".
Reorder the chart set, as described in Section 6.3.4.3, "Reordering Charts".
Revert to an old chart set, as described in Section 6.3.4.4, "Reverting to an Old Chart Set".
Delete a chart set, as described in Section 6.3.4.2, "Deleting a Chart Set".
The Oracle Enterprise Scheduling Service Current Activity page displays pending and running requests by user and application.
To view current Oracle Enterprise Scheduling Service activity:
From the Scheduling Service menu, choose Performance > Current Activity.
You can view pending and running requests by user or application, or workload by work assignment.
To view pending and running requests by user, choose View > Requests By User.
To view pending and running requests by application, choose View > Requests By Application.
To view workloads by work assignment, choose View > Workload By Work Assignment. For more information about work assignment details, see Section 5.3.1.1, "Creating or Editing a Work Assignment."
The Oracle Enterprise Scheduling Service Historical Reports page displays completed job requests by user, application and work assignment.
To view historical Oracle Enterprise Scheduling Service reports:
From the Scheduling Service menu, choose Performance > Historical Reports.
From the View list, choose one of the following report views:
Completed Request Statistics By Job Name
Completed Request Statistics By User
Request Metrics By Work Assignment
Completed Request Statistics
Adjust the filter criteria as required. The filter criteria vary depending on the report view you choose.
Table 6-3 Completed Request Statistics by Job Name
Filter Criterion | What to Do... |
---|---|
Application |
From the list, choose the application whose statistics you want to view. |
Minimum Run Time |
Enter the shortest run time period for jobs whose statistics you want to view. Use the text field to enter a number, and select a unit of time from the list: Seconds, Minutes, Hours or Days. |
Completed between |
Use the calendar icons on either side of the text fields to select a start and end date and time. |
Table 6-4 Completed Request Statistics by User
Filter Criterion | What to Do... |
---|---|
Application |
From the list, choose the application whose statistics you want to view. |
Minimum Total Run Time |
Enter the shortest total time period for jobs whose statistics you want to view. Use the text field to enter a number, and select a unit of time from the list: Seconds, Minutes, Hours or Days. |
Completed between |
Use the calendar icons on either side of the text fields to select a start and end date and time. |
Click Go to search for and display the historical data.
You can save or delete the chart set displayed in the Oracle Enterprise Scheduling Service Performance Summary page. You can also re-organize the order of a chart and revert to an old chart set.
This section contains the following topics:
You can save the chart set displayed in the Oracle Enterprise Scheduling Service Performance Summary page. Saving a chart set allows preserving a specific set of metrics selected for display, as opposed to the default metrics.
To save a chart set:
Display the Oracle Enterprise Scheduling Service Performance Summary page.
Choose View > Save Chart Set.
In the Save Chart Set dialog box, enter a name for the chart set and click OK.
Once you have saved the chart set, you can display it by choosing Chart Set > My Chart Set.
You can delete saved chart set files created in the Oracle Enterprise Scheduling Service Performance Summary page.
To delete a chart set:
Display the Oracle Enterprise Scheduling Service Performance Summary page.
Choose View > Delete Chart Sets.
In the Delete Chart Sets dialog box, select the name of the chart set to be deleted and click OK.
You can organize the display of performance charts in the Oracle Enterprise Scheduling Service Performance Summary page. Charts can be moved up or down, or removed entirely.
To reorder chart sets:
Display the Oracle Enterprise Scheduling Service Performance Summary page.
Choose View > Reorder Charts.
In the Reorder Charts popup window, select the chart you want to move and click Move Up or Move Down, respectively.
To delete a chart from the Performance Summary page, select the chart and click Delete.
Click OK.
If you have re-organized your chart sets, you can revert to the chart set as you had originally saved it.
To revert chart sets:
Display the Oracle Enterprise Scheduling Service Performance Summary page.
From the Chart Set list, choose the chart you want to revert to its original display.
Choose View > Revert Chart Set.
In the Oracle Enterprise Scheduling Service Performance Summary page, you can change the time period for which the performance summary displays.
To select the performance time period:
Display the Oracle Enterprise Scheduling Service Performance Summary page.
Change the duration for which job requests display.
All: Click to display all job requests within a specified, finite period.
15 minutes: Click to display all job requests within the past fifteen minutes.
Slider: Click to display a slider that enables scrolling horizontally to show job requests from a specified period. The slider defaults to whichever time segment is selected, "all," 2 hours, or 15 minutes.
Calendar: Click the calendar icon to select a time period for which you want to display job requests.
Use Table 6-7 to locate the key performance metrics for Oracle Enterprise Scheduling Service.
Table 6-7 Oracle Enterprise Scheduling Service Key Performance Metrics
Metric Name | Location in Fusion Middleware Control |
---|---|
Number of active processor threads for each instance |
|
Processing Time (for jobs) Wait Time |
|
Job running time |
|
You can view information about a particular Oracle Enterprise Scheduling Service instance by using the Scheduling Service General Information popup window in Fusion Middleware Control. The popup window displays the locations of Oracle Fusion Middleware home, the domain and the target application, as well as the version of Oracle Fusion Middleware currently running and the URI of the hosting server.
To view general information about Oracle Enterprise Scheduling Service:
From the Scheduling Service menu, select General Information.
Fusion Middleware Control displays the following information.
Target Name: The location of the target application, in this case, Oracle Enterprise Scheduling Service, running on the domain.
Version: The version number of Oracle Fusion Middleware.
Middleware Home: The location of the Oracle Fusion Middleware directory.
Domain Home: The full path of the domain.
Host: The URI of the hosting server.
You can view status for components of Oracle Enterprise Scheduling Service. On the Scheduling Service home page of Fusion Middleware Control, the Scheduler Components region displays status for the job request processor and dispatcher. The region displays the status (such as whether it's started or stopped) of each component, the name of the server to which it is deployed, and whether or not the component is enabled. You can start and stop each component there.
You can search for and view log data for individual job requests, as well as set log levels for Oracle Enterprise Scheduling Service. You can also save job request logs to a file, and trace job requests for additional troubleshooting information.
This section contains the following topics:
Note:
The Oracle WebLogic Server logger (logging.xml
) only shows logs written by Oracle Enterprise Scheduling Service job running in Oracle WebLogic Server. Once Oracle Enterprise Scheduling Service transfers control of running PL/SQL to the PL/SQL process, PL/SQL job logging data is not written to the Oracle Enterprise Scheduling Service logs as they run in a separate process.You can use the Fusion Middleware Control to view log messages for the domain on which Oracle Enterprise Scheduling Service is deployed.
To view domain logs:
From the Scheduling Service menu, select Logs > View Log Messages.
For more information, see the Oracle Fusion Middleware Administrator's Guide.
You can view the log for a particular job request from the Request Details pane.
To view job request logs:
Search for the relevant job requests as described in Section 4.2.2.1
In the table displaying the job request search results, select the job request whose log you want to view.
To view job request details, click the job request ID. Alternatively, click the parent ID associated with the job request to view the details of the job set with which the job is associated.
In the job request details page, select Action and then select Request Log to display log information for the job request.
You can use the Oracle Enterprise Scheduling Service log messages page to view logging information regarding scheduled job requests.
To view log messages for scheduled job requests with Fusion Middleware Control:
From the navigation pane, expand the farm, and then Scheduling Services.
Select the ESSAPP application for the appropriate Managed Server.
In the Scheduling Service home page, from the Scheduling Service menu, choose Logs and then select View Log Messages.
Search for the relevant log messages using the Date Range, Message Types and Message fields. You can optionally add additional search fields.
You can use the ECID to retrieve more information about a given job request. The Execution Context ID (ECID) is a global unique identifier of the execution of a particular request in which the originating component participates. You can use the ECID to correlate error messages from different components
By default, when view the logs for a request, Fusion Middleware Control displays only messages logged in the scope of the Oracle Enterprise Scheduling Service cluster. If the Oracle Enterprise Scheduling Service application is not deployed to a cluster, Fusion Middleware Control displays the messages logged in the managed server scope. However, Oracle Enterprise Scheduling Service propagates the ECID associated with the job request across sub-systems such as SOA, ADF, and so on.
To view messages logged by other sub-systems, broaden the target scope to display messages logged across the domain or farm. Click Broaden Target Scope and select the target whose log messages you want to view.
It is possible to configure Oracle Enterprise Scheduling Service server logging for a Oracle WebLogic Server by modifying the logging.xml
file of that Oracle WebLogic Server. By default, there is no explicit logger entry for Oracle Enterprise Scheduling Service. Oracle Enterprise Scheduling Service inherits the logging level and log handlers configured for the parent logger, typically the oracle
logger or the root logger.
By default, the log messages for the Oracle Enterprise Scheduling Service logger can be found in the Oracle WebLogic Server diagnostic log file for that Oracle WebLogic Server. The logging.xml
file is located under DOMAIN_HOME/config/fmwconfig/servers/WebLogic_Server_Name
, where DOMAIN_HOME
is the domain home directory for the Oracle WebLogic Server domain and WebLogic_Server_Name
is the name of the Oracle WebLogic Server that uses the logging.xml
file.
Table 6-8 shows the Oracle Enterprise Scheduling Service logger names, log levels and a description for each level.
Table 6-8 Loggers and log levels for Oracle Enterprise Scheduling Service
Logger Name | Log Level | Description |
---|---|---|
|
|
Problems encountered by Oracle Enterprise Scheduling Service runtime in the context of request processing that result in the request errors. Errors include exceptions thrown by the job code, unchecked exceptions when running the job code and exceptions when running Oracle Enterprise Scheduling Service code. Problems encountered by Oracle Enterprise Scheduling Service runtime outside the context of request processing, such as dispatching, system event handling, and so on. |
|
Less severe problems encountered by Oracle Enterprise Scheduling Service runtime during or outside of request processing, which might not cause requests to enter error state. |
|
|
Messages for request state transitions. Messages related to work assignment activities. Messages about batch delete failures. Start and stop of Oracle Enterprise Scheduling Service resource adapter. |
|
|
Application endpoint activation and de-activation for Oracle Enterprise Scheduling Service resource adapter. |
Request Logging: Oracle Enterprise Scheduling Service job implementation might write business-specific job request execution log information to the job request log file. This log file is specific to each request, and is automatically enabled by default. For more information about viewing the log file for a job request, see Section 6.7.2.
For information about setting the log levels for Oracle WebLogic Server, see Section 6.7.5.
Set the log levels for the Oracle WebLogic Server running Oracle Enterprise Scheduling Service as described in the Oracle WebLogic Server documentation.
Enabling tracing for Oracle Enterprise Scheduling Service jobs provides additional information regarding job requests, which can then be relayed to Oracle technical support to help solve any Oracle Enterprise Scheduling Service-related issues.
This section contains the following topics:
Before You Begin
Before enabling tracing, note that tracing log messages may produce a considerable amount of output. By default, traces go to the Oracle WebLogic Server console stdout
. If the stdout
is re-directed to a file, it may occupy a significant amount of disk space and possibly affect server performance.
To enable tracing for Oracle Enterprise Scheduling Service jobs:
Navigate to the Log Configuration pane and expand the Specify Loggers region.
In Fusion Middleware Control, in the navigation pane, select WebLogic Domain and then select the domain and server names.
Click the WebLogic Server menu and select Logs and then select Log Configuration.
The Log Configuration pane displays.
In the Log Levels tab, from the View dropdown list select Loggers with Persistent Log Level State. Expand the Specify Loggers region toward the bottom of the pane.
Create the following loggers: oracle.as.scheduler.security.internal.SecurityExecutorFactory
and oracle.as.scheduler.security.internal.SecurityHelper
.
In the Name text field, enter the name of the logger.
From the Oracle Diagnostic Logging Level (Java Level) dropdown list, select the desired logging level.
Repeat for the second logger name.
Attach the loggers to the Oracle Diagnostic Logging Handler.
In the Log Configuration pane, click the Log Files tab.
From the list of handlers, select odl-handler and click Edit Configuration.
From the Loggers to Associate dropdown list, select the loggers you created and click OK.
Download the trace file.
In Fusion Middleware Control, in the navigation pane, select WebLogic Domain and then select the domain and server names.
Click the WebLogic Server menu and select Logs and then select View Log Messages.
The Log Messages pane displays.
In the Search field, expand the Selected Targets region and select the relevant Oracle Enterprise Scheduling Service target.
Select the relevant date range, message type and so on, and click Search.
From the list of log messages that displays, select the relevant message.
In the Log File column, click the name of the log file.
The View Log File pane displays.
Next to the name of the log file, click Download to download the file.
It is possible to save job request log data to the server log file. Job request logs are normally stored to Oracle WebCenter Content. However, when setting the log level to FINER
, all job request logs are copied to the server log file.
To save job request logs to the server diagnostic file:
In Fusion Middleware Control, in the navigation pane, select WebLogic Domain and then select the domain and server names.
Click the WebLogic Server menu and select Logs and then select Log Configuration.
The Log Configuration pane displays.
In the Log Configuration pane, click the Log Levels tab.
In the Search text field, search for oracle.as.scheduler. and find the oracle.as.scheduler.security.internal.SecurityExecutorFactory
logger.
Set the log level to FINER
and click Apply.
Run a diagnostic test, as described in Oracle Fusion Middleware Administrator's Guide. The log messages are now saved to the <
server
>-diagnostic.log
file.
The logs are saved to the server diagnostic file, <
Oracle Enterprise Scheduling Service server name
>-diagnostic.log.