Hello
I have been searching for what causes adstrtal.sh to exit with status 4. The sub scripts adapcctl.sh, adoacorectl.sh, adformsctl.sh, and adoafmctl.sh all exit with status 150. I ran the master script as apps/apps. Has anyone come across this problem during start of app services?


Thanks
Jon

Is your listener up and running? This could happen if your listener is down.

cd PROD
cd db
cd tech*
cd 11*
cd appsutil
cd scripts
cd PROD*
./addlnstl start PROD

Hasan

Also please verify if your database is up
./addbctl.sh start
Hasan

Hi Hasan

Both listener and database were (and are) up and running but the App service adstrtal.sh exits with status 4 with sub scripts adapcctl.sh, adoacorectl.sh, adformsctl.sh, and adoafmctl.sh exiting with status 150.

Thanks
Jon

Can you connect to the database through sqlplus?

1)source the environemnt file
2)sqlplus apps/apps

Once the above test is taken care then we need to take a look at your log files.

Hasan

I am not sure how to perform the test. Please advise on the steps.

Thanks
Jon

To source env file:
cd PROD
cd ap*
cd ap*
cd ap*
. APPSPROD_linux

To run sqlplus:
sqlplus apps/apps

See if you could connect.

Hasan

1. When trying to run SQLPlus is get:

[Jon@linux ~]$ sqlplus apps/apps
bash: sqlplus: command not found

2. Below is the content of APPSPROD_linux.env

:
# $Header: APPSORA_ux.env 120.0 2005/06/20 15:33:34 appldev noship $
# =============================================================================
# NAME
# APPSORA.env
#
# DESCRIPTION
# Execute environment for Oracle and APPL_TOP
#
# NOTES
#
# HISTORY
#
# =============================================================================
#
# ###############################################################
#
# This file is automatically generated by AutoConfig. It will be read and
# overwritten. If you were instructed to edit this file, or if you are not
# able to use the settings created by AutoConfig, refer to Metalink Note
# 387859.1 for assistance.
#
# ###############################################################

#
# Source the custom file if it exists
customfile=/home/Oracle/PROD/apps/apps_st/appl/customPROD_linux.env
if $ sqlplus apps/apps
bash: sqlplus: command not found

2. Below is the content of APPSPROD_linux.env

:
# $Header: APPSORA_ux.env 120.0 2005/06/20 15:33:34 appldev noship $
# =============================================================================
# NAME
# APPSORA.env
#
# DESCRIPTION
# Execute environment for Oracle and APPL_TOP
#
# NOTES
#
# HISTORY
#
# =============================================================================
#
# ###############################################################
#
# This file is automatically generated by AutoConfig. It will be read and
# overwritten. If you were instructed to edit this file, or if you are not
# able to use the settings created by AutoConfig, refer to Metalink Note
# 387859.1 for assistance.
#
# ###############################################################

#
# Source the custom file if it exists
customfile=/home/Oracle/PROD/apps/apps_st/appl/customPROD_linux.env
if [ -f $customfile ]; then
. /home/Oracle/PROD/apps/apps_st/appl/customPROD_linux.env
fi
. /home/Oracle/PROD/inst/apps/PROD_linux/ora/10.1.2/PROD_linux.env
. /home/Oracle/PROD/apps/apps_st/appl/PROD_linux.env

Did you source the environment file by running this command:

. APPSPROD_linux.env

?
Hasan

I sourced the environment running . APPSPROD_linux.env without issues and connect to the database. But the mega script adstrtal.sh still fails with status 4, some of the subscripts exit with status 150. Please find attached the script log file.

~~~~~~~~~~~~~~~~~~Running adstrtal.sh fails ~~~~~~~~~~~~~~~~~~
adstrtal.sh: Exiting with status 4
adstrtal.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adstrtal.log
for more information ...
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

I was also able to run SQLPlus and connet to the database as per below.

~~~~~~~~~~~ Connect to database with sqlplus ~~~~~~~~~~~~~~~~
[Jon@linux scripts]$ sqlplus apps/apps

SQL*Plus: Release 10.1.0.5.0 - Production on Tue Jan 12 22:56:12 2010

Copyright (c) 1982, 2005, Oracle. All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL>

I am able to login to Oracle through IE as sysadmin but get an error when trying to create a new user, the error occurs when assigning the inital password to the user (please see attached image) the error message is "Verification failed. Please try again" . I also have not been able to start all the Oracle services as can be seen in the attached log file.

Here is the log file.

For some reason I was eventually able to create a new user, assign responsibilities, and login as the new user and change the initial password.

The main issues are that not all the Oracle start scripts are running. Some of the scripts exit with status 150 and status 2. As I am not able to attach the adstrtal.sh log file, please see the below log file output:


Setting Service Group Root Service to mode 2
Setting Service Group Web Entry Point Services to mode 2
Setting Service Group Web Application Services to mode 2
Setting Service Group Batch Processing Services to mode 2
Service Group Other Services is disabled.

Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adopmnctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

You are running adopmnctl.sh version 120.6

Starting Oracle Process Manager (OPMN) ...

adopmnctl.sh: exiting with status 0

adopmnctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adopmnctl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adalnctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

adalnctl.sh version 120.3

Checking for FNDFS executable.
Listener APPS_PROD has already been started.

adalnctl.sh: exiting with status 2


adalnctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adalnctl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adapcctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

You are running adapcctl.sh version 120.7.12010000.2

Starting OPMN managed Oracle HTTP Server (OHS) instance ...

adapcctl.sh: exiting with status 150

adapcctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adapcctl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adoacorectl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

You are running adoacorectl.sh version 120.13

Starting OPMN managed OACORE OC4J instance ...

adoacorectl.sh: exiting with status 150

adoacorectl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adoacorectl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adformsctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

You are running adformsctl.sh version 120.16

Starting OPMN managed FORMS OC4J instance ...

adformsctl.sh: exiting with status 150

adformsctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adformsctl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adoafmctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

You are running adoafmctl.sh version 120.8

Starting OPMN managed OAFM OC4J instance ...

adoafmctl.sh: exiting with status 150

adoafmctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adoafmctl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/adcmctl.sh start
Timeout specified in context file: 1000 second(s)

script returned:
****************************************************

You are running adcmctl.sh version 120.17.12010000.3

Starting concurrent manager for PROD ...
Starting PROD_0112@PROD Internal Concurrent Manager
Default printer is noprint

adcmctl.sh: exiting with status 0


adcmctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adcmctl.txt
for more information ...


.end std out.

.end err out.

****************************************************


Executing service control script:
/home/Oracle/PROD/inst/apps/PROD_linux/admin/scripts/jtffmctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

You are running jtffmctl.sh version 120.3

Validating Fulfillment patch level via
/home/Oracle/PROD/apps/apps_st/comn/java/classes
Fulfillment patch level validated.
Starting Fulfillment Server for PROD on port 9300 ...

jtffmctl.sh: exiting with status 0


.end std out.

.end err out.

****************************************************



[Service Control Execution Report]
The report format is:
<Service Group> <Service>
<Script> <Status>

Root Service
Enabled
Root Service Oracle Process Manager for PROD_linux
adopmnctl.sh Started
Web Entry Point Services
Enabled
Web Entry Point Services Oracle HTTP Server PROD_linux
adapcctl.sh Failed
Web Entry Point Services OracleTNSListenerAPPS_PROD_linux
adalnctl.sh Already Started
Web Application Services
Enabled
Web Application Services OACORE OC4J Instance PROD_linux
adoacorectl.sh Failed
Web Application Services FORMS OC4J Instance PROD_linux
adformsctl.sh Failed
Web Application Services OAFM OC4J Instance PROD_linux
adoafmctl.sh Failed
Batch Processing Services
Enabled
Batch Processing Services OracleConcMgrPROD_linux
adcmctl.sh Started
Batch Processing Services Oracle Fulfillment Server PROD_linux
jtffmctl.sh Started
Other Services
Disabled
Other Services OracleFormsServer-Forms PROD_linux
adformsrvctl.sh Disabled
Other Services Oracle Metrics Client PROD_linux
adfmcctl.sh Disabled
Other Services Oracle Metrics Server PROD_linux
adfmsctl.sh Disabled
Other Services Oracle MWA Service PROD_linux
mwactlwrpr.sh Disabled


ServiceControl is exiting with status 4

This password error seems to be a separate issue. A new thread is always better to discuss a new issue.
You know that the password has to be entered twice? You still get this error when you enter the exact same password twice.
Please start a new thread if you are still getting password errors.
Thanks
Hasan

Looks like there is one common problem that is causing most scripts to error out. Usually this happens when you database or the db listener is down, but you are saying you can connect to the database via sqlplus.
Take a look at the log file of the concurrent manager and see if you can spot any thing:
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adapcctl.txt
Also try stopping all services
adstpall.sh apps/apps
... and then restarting them again adstrtal.sh apps/apps
And see if you still these errors.
Hasan

Please see below the content of the adapcctl.sh log file. Is this an issue with port numbers?

Thanks
Jon

01/14/10-12:55:33 :: adapcctl.sh version 120.7.12010000.2
01/14/10-12:55:34 :: adapcctl.sh: starting OPMN if it is not running

opmnctl: opmn is already running.

01/14/10-12:55:37 :: adapcctl.sh: starting OPMN managed OHS instance

opmnctl: starting opmn managed processes...
================================================================================opmn
id=linux.server:6200
no processes or applications matched this request

01/14/10-12:55:40 :: adapcctl.sh: exiting with status 150

I ran "adopmnctl.sh status" to check the status of OPMN managed processes and got the below. These processes are alive. Any other processes I should check?
~~~~~~~~~~~~~~~~~~~~

[Jon@linux scripts]$ ./adopmnctl.sh status

You are running adopmnctl.sh version 120.6

Checking status of OPMN managed processes...

Processes in Instance: PROD_linux.linux.server
---------------------------------+--------------------+---------+---------
ias-component | process-type | pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group | OC4J:oafm | 6958 | Alive
OC4JGroup:default_group | OC4J:forms | 6956 | Alive
OC4JGroup:default_group | OC4J:oacore | 6957 | Alive
HTTP_Server | HTTP_Server | 6955 | Alive


adopmnctl.sh: exiting with status 0

adopmnctl.sh: check the logfile
/home/Oracle/PROD/inst/apps/PROD_linux/logs/appl/admin/log/adopmnctl.txt
for more information ...

Please check two things:

See if linux.server is responding. I have a feeling that linux.server is not mapped to local ip address 127.0.0.1.

su root
ping linux.server

Do you have an ethernet interface up?
Type ifconfig as root and see if any of the interfaces are up.
su root
/sbin/ifconfig

Hasan

Hi Jon, I have the same error. Have you solved the problem?

I dont know if Jon was able to fix the problem but what I have seen is that if one day suddenly services refuse to start up then most likely it has something to do with your IP address or file permissions.
Before digging deep into log files to find out what exatly is causing the failure, you can try two things:

1) If you are behind a router, make your IP static (e.g. 192.168.1.2). Put the same IP in settings as it was at the time of installation.
As root go to /usr/sbin/system-config-network


2) Make sure Oracle is the owner of all the files under oracle folder.
As root go to Oracle home /home/Oracle

Change owner and group to Oracle for all the files underneath it.
chown -R Oracle *
chgrp -R Oracle *

Hope that does the fix.