R3trans -d gives a return code 0012 2EETW169 no connect possible after a server restart

[former_member636576]

trans-log-file.txttnsnames.txtlistener-file.txtHi,

We are unable to re-start our server after a planned shutdown for maintenance. R3 trans -d gives the following error :

DEV:devadm 11> R3trans -d
This is R3trans version 6.24 (release 721 - 19.10.16 - 20:16:07).
unicode enabled version
2EETW169 no connect possible: "DBMS = ORACLE --- dbs_o
ra_tnsname = 'DEV'"
R3trans finished (0012).
DEV:devadm 12>

For starters I have checked the entries in the tnsnames.ora and listener.ora files ,everything seems to be in order .

Re-started the listener service.

$ORACLE_HOME and $ORACLE_SID seems to set alright .

Tried to shut down oracle from the sql prompt and re-start, no luck.

# su - oradev
DEV:oradev 1> sqlplus /nolog

SQL*Plus: Release 10.2.0.2.0 - Production on Tue Oct 15 15:17:02 2019

Copyright (c) 1982, 2005, Oracle. All Rights Reserved.

SQL> shutdown
ORA-01012: not logged on
SQL> shutdown immediate
ORA-01012: not logged on
SQL> startup
ORA-01031: insufficient privileges
SQL>

Unable to run basic sql queries/commands:

e.g.,

SQL> SELECT * FROM v$version;
SP2-0640: Not connected
SQL>

AIX version : 6.1

Following are the o/p's of env/sapcontrol and the parameters in the instance profile

DEV:oradev 14> env
TERM=ansi
AUTHSTATE=files
SHELL=/bin/csh
HOME=/oracle/DEV
USER=oradev
PATH=/oracle/DEV/102_64/bin:.:/oracle/DEV:/usr/sap/DEV/SYS/exe/run:/usr/bin:/etc
:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/usr/java5/jre/bin:/usr/java5/bin
TZ=GMT0BST
LANG=en_US
LOCPATH=/usr/lib/nls/loc
LC__FASTMSG=true
ODMDIR=/etc/objrepos
CLCMD_PASSTHRU=1
LOGNAME=oradev
LOGIN=oradev
SAPSYSTEMNAME=DEV
DIR_LIBRARY=/usr/sap/DEV/SYS/exe/run
THREAD=NOPS
dbms_type=ORA
dbs_ora_tnsname=DEV
dbs_ora_schema=SAPSR3
ORACLE_SID=DEV
DB_SID=DEV
ORACLE_BASE=/oracle
ORACLE_HOME=/oracle/DEV/102_64
NLS_LANG=AMERICAN_AMERICA.UTF8
SAPDATA_HOME=/oracle/DEV
NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
LIBPATH=/usr/lib:/lib:/usr/sap/DEV/SYS/exe/run:/oracle/DEV/102_64/lib

DEV:oradev 15> sapcontrol -nr 00 -function GetEnvironment

15.10.2019 15:34:21
GetEnvironment
OK
lines
LOGNAME=devadm
HOME=/home/devadm
SHELL=/bin/csh
TERM=vt100
PATH=/oracle/DEV/102_64/bin:/oracle/DEV/102_64/jdk/jre/bin:/home/devadm:/usr/sap
/DEV/SYS/exe/run:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/devadm/bin:/usr/bin/X11:
/sbin:.
TZ=GMT0BST
LANG=en_US
LOCPATH=/usr/lib/nls/loc
LC__FASTMSG=true
ODMDIR=/etc/objrepos
CLCMD_PASSTHRU=1
USER=devadm
SAPSYSTEMNAME=DEV
DIR_LIBRARY=/usr/sap/DEV/SYS/exe/run
JAVA_HOME=/oracle/DEV/102_64/jdk/jre
IBM_JAVA_OPTIONS=-Xmx256M
THREAD=NOPS
dbms_type=ORA
dbs_ora_tnsname=DEV
dbs_ora_schema=SAPSR3
ORACLE_SID=DEV
DB_SID=DEV
ORACLE_BASE=/oracle
TNS_ADMIN=/usr/sap/DEV/SYS/profile/oracle
ORACLE_HOME=/oracle/DEV/102_64
NLS_LANG=AMERICAN_AMERICA.UTF8
SAPDATA_HOME=/oracle/DEV
MAIL=/var/spool/mail/devadm
MAILMSG=[YOU HAVE NEW MAIL]
NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
LIBPATH=/usr/sap/DEV/DVEBMGS00/exe:/usr/lib:/lib:/usr/sap/DEV/SYS/exe/run:/oracl
e/client/10x_64/instantclient

DEV:oradev 23> more DEV_DVEBMGS00_DEV
#.******************************************************************************
************************************************
#.*
*
#.* Instance profile DEV_DVEBMGS00_DEV
*
#.*
*
#.* Version = 000008
*
#.* Generated by user = CON_BASIS
*
#.* Generated on = 13.07.2018 , 15:35:49
*
#.*
*
#.******************************************************************************
************************************************
#parameter created by: CON_BASIS 13.07.2018 15:04:24
login/create_sso2_ticket = 2
#parameter created by: CON_BASIS 12.07.2018 16:12:13
icm/server_port_1 = PROT=SMTP,PORT=25000
#parameter created by: CON_BASIS 12.07.2018 16:11:26
is/SMTP/virt_host_0 = *:25000;
SAPGLOBALHOST = DEV
changed: CON_BASIS 12.07.2018 16:10:42
changed: CON_BASIS 13.07.2018 15:04:55
changed: CON_BASIS 13.07.2018 15:05:27
icm/host_name_full = DEV.lincpen.com
SAPSYSTEMNAME = DEV
SAPSYSTEM = 00
INSTANCE_NAME = DVEBMGS00
DIR_CT_RUN = $(DIR_EXE_ROOT)/run
DIR_EXECUTABLE = $(DIR_INSTANCE)/exe
login/accept_sso2_ticket = 1
PHYS_MEMSIZE = 512
exe/saposcol = $(DIR_CT_RUN)/saposcol
rdisp/wp_no_dia = 4
rdisp/wp_no_btc = 1
exe/icmbnd = $(DIR_CT_RUN)/icmbnd
icm/server_port_0 = PROT=HTTP,PORT=80$$
#-----------------------------------------------------------------------
# SAP Messaging Service parameters are set in the DEFAULT.PFL
#-----------------------------------------------------------------------
dbms_type=ORA
dbs_ora_tnsname=DEV
dbs_ora_schema=SAPSR3
ORACLE_SID=DEV
DB_SID=DEV
ORACLE_BASE=/oracle
TNS_ADMIN=/usr/sap/DEV/SYS/profile/oracle
ORACLE_HOME=/oracle/DEV/102_64
NLS_LANG=AMERICAN_AMERICA.UTF8
SAPDATA_HOME=/oracle/DEV
MAIL=/var/spool/mail/devadm
MAILMSG=[YOU HAVE NEW MAIL]
NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
e/client/10x_64/instantclient
ms/server_port_0 = PROT=HTTP,PORT=81$$
rdisp/wp_no_enq = 1
rdisp/wp_no_vb = 1
rdisp/wp_no_vb2 = 1
rdisp/wp_no_spo = 1

#---------------------------------------------------------------------
#Values proposed by SAP for shared memory pool sizes
#---------------------------------------------------------------------
ipc/shm_psize_10 = 154000000
ipc/shm_psize_14 = 0
ipc/shm_psize_18 = 0
ipc/shm_psize_19 = 0
ipc/shm_psize_30 = -10
ipc/shm_psize_40 = 488000000
ipc/shm_psize_41 = 0
ipc/shm_psize_51 = -10
ipc/shm_psize_52 = -10
ipc/shm_psize_54 = -10
ipc/shm_psize_55 = -10
ipc/shm_psize_57 = -10
ipc/shm_psize_58 = -10

Attaching the following logs/files :

1) trans.log

2) listener.ora file

3) tnsnames.ora file

Please suggest the approach we should follow in troubleshooting this issue.

[Reagan]

DEV:oradev 1> sqlplus /nolog
SQL*Plus: Release 10.2.0.2.0 - Production on Tue Oct 15 15:17:02 2019
Copyright (c) 1982, 2005, Oracle. All Rights Reserved.
SQL> shutdown
ORA-01012: not logged on
SQL> shutdown immediate
ORA-01012: not logged on
SQL> startup
ORA-01031: insufficient privileges
SQL>
Unable to run basic sql queries/commands:

Doesn't surprise me. With "sqlplus /nolog" you basically connected to the SQL prompt but not with ay user. This is the reason why the system threw these ORA- errors "ORA-01012: not logged on" and "ORA-01031: insufficient privileges". You need to connect with a user having SYSDBA role before you can run shutdown/startup commands.

Try this: sqlplus "/as sysdba"

Good luck

RB

[former_member636576]

Hi RB,

Thanks for replying . I did as told (logged in with a user having sysdba role)

* *
* *
* Please see the README file in /usr/lpp/bos for information pertinent to *
* this release of the AIX Operating System. *
* *
* *
*******************************************************************************
Last unsuccessful login: Mon Oct 14 12:37:04 BST 2019 on /dev/pts/0 from 172.16.
80.7
Last login: Tue Oct 15 12:58:41 BST 2019 on /dev/pts/0 from 172.16.80.7

# su - oradev
DEV:oradev 1> sqlplus "/as sysdba"

SQL*Plus: Release 10.2.0.2.0 - Production on Wed Oct 16 11:08:13 2019

Copyright (c) 1982, 2005, Oracle. All Rights Reserved.

Connected to an idle instance.

SQL> shutdown
ORA-01034: ORACLE not available
ORA-27121: unable to determine size of shared memory segment
IBM AIX RISC System/6000 Error: 13: Permission denied
SQL>

What approach to take next ? It would be extremely grateful if you could review the logs that I have attached. Kindly let me know if you need any further inputs from my end.

Regards,

Abhishek Gupta

[Reagan]

Abhishek,

The database is down. You need to start the database if that is what you are trying to achieve.

sqlplus "/as sysdba"

startup

[former_member636576]

Hi Regan,

Yes, I am trying to get the database up. The system has been down ever since we tried to do a restart.

R3trans -d gives the following error:

DEV:devadm 1> R3trans -d
This is R3trans version 6.24 (release 721 - 19.10.16 - 20:16:07).
unicode enabled version
2EETW169 no connect possible: "DBMS = ORACLE --- dbs_o
ra_tnsname = 'DEV'"
R3trans finished (0012).

I tried starting the database as follows, no luck .

* Please see the README file in /usr/lpp/bos for information pertinent to *
* this release of the AIX Operating System. *
* *
* *
*******************************************************************************
Last unsuccessful login: Mon Oct 14 12:37:04 BST 2019 on /dev/pts/0 from 172.16.
80.7
Last login: Wed Oct 16 11:07:49 BST 2019 on /dev/pts/0 from 172.16.80.7

# su - oradev
DEV:oradev 1> sqlplus "/as sysdba"

SQL*Plus: Release 10.2.0.2.0 - Production on Wed Oct 16 15:30:04 2019

Copyright (c) 1982, 2005, Oracle. All Rights Reserved.

Connected to an idle instance.

SQL> startup
ORA-27121: unable to determine size of shared memory segment
IBM AIX RISC System/6000 Error: 13: Permission denied
SQL>

ORA-27121

- is this the crux of the problem ?

I have checked the env variables, everything seems to be okay .

Following are the o/p's of env/sapcontrol and the parameters in the instance profile

DEV:oradev 14> env
TERM=ansi
AUTHSTATE=files
SHELL=/bin/csh
HOME=/oracle/DEV
USER=oradev
PATH=/oracle/DEV/102_64/bin:.:/oracle/DEV:/usr/sap/DEV/SYS/exe/run:/usr/bin:/etc
:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/usr/java5/jre/bin:/usr/java5/bin
TZ=GMT0BST
LANG=en_US
LOCPATH=/usr/lib/nls/loc
LC__FASTMSG=true
ODMDIR=/etc/objrepos
CLCMD_PASSTHRU=1
LOGNAME=oradev
LOGIN=oradev
SAPSYSTEMNAME=DEV
DIR_LIBRARY=/usr/sap/DEV/SYS/exe/run
THREAD=NOPS
dbms_type=ORA
dbs_ora_tnsname=DEV
dbs_ora_schema=SAPSR3
ORACLE_SID=DEV
DB_SID=DEV
ORACLE_BASE=/oracle
ORACLE_HOME=/oracle/DEV/102_64
NLS_LANG=AMERICAN_AMERICA.UTF8
SAPDATA_HOME=/oracle/DEV
NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
LIBPATH=/usr/lib:/lib:/usr/sap/DEV/SYS/exe/run:/oracle/DEV/102_64/lib

DEV:oradev 15> sapcontrol -nr 00 -function GetEnvironment

15.10.2019 15:34:21
GetEnvironment
OK
lines
LOGNAME=devadm
HOME=/home/devadm
SHELL=/bin/csh
TERM=vt100
PATH=/oracle/DEV/102_64/bin:/oracle/DEV/102_64/jdk/jre/bin:/home/devadm:/usr/sap
/DEV/SYS/exe/run:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/devadm/bin:/usr/bin/X11:
/sbin:.
TZ=GMT0BST
LANG=en_US
LOCPATH=/usr/lib/nls/loc
LC__FASTMSG=true
ODMDIR=/etc/objrepos
CLCMD_PASSTHRU=1
USER=devadm
SAPSYSTEMNAME=DEV
DIR_LIBRARY=/usr/sap/DEV/SYS/exe/run
JAVA_HOME=/oracle/DEV/102_64/jdk/jre
IBM_JAVA_OPTIONS=-Xmx256M
THREAD=NOPS
dbms_type=ORA
dbs_ora_tnsname=DEV
dbs_ora_schema=SAPSR3
ORACLE_SID=DEV
DB_SID=DEV
ORACLE_BASE=/oracle
TNS_ADMIN=/usr/sap/DEV/SYS/profile/oracle
ORACLE_HOME=/oracle/DEV/102_64
NLS_LANG=AMERICAN_AMERICA.UTF8
SAPDATA_HOME=/oracle/DEV
MAIL=/var/spool/mail/devadm
MAILMSG=[YOU HAVE NEW MAIL]
NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
LIBPATH=/usr/sap/DEV/DVEBMGS00/exe:/usr/lib:/lib:/usr/sap/DEV/SYS/exe/run:/oracl
e/client/10x_64/instantclient

DEV:oradev 23> more DEV_DVEBMGS00_DEV
#.******************************************************************************
************************************************
#.*
*
#.* Instance profile DEV_DVEBMGS00_DEV
*
#.*
*
#.* Version = 000008
*
#.* Generated by user = CON_BASIS
*
#.* Generated on = 13.07.2018 , 15:35:49
*
#.*
*
#.******************************************************************************
************************************************
#parameter created by: CON_BASIS 13.07.2018 15:04:24
login/create_sso2_ticket = 2
#parameter created by: CON_BASIS 12.07.2018 16:12:13
icm/server_port_1 = PROT=SMTP,PORT=25000
#parameter created by: CON_BASIS 12.07.2018 16:11:26
is/SMTP/virt_host_0 = *:25000;
SAPGLOBALHOST = DEV
changed: CON_BASIS 12.07.2018 16:10:42
changed: CON_BASIS 13.07.2018 15:04:55
changed: CON_BASIS 13.07.2018 15:05:27
icm/host_name_full = DEV.lincpen.com
SAPSYSTEMNAME = DEV
SAPSYSTEM = 00
INSTANCE_NAME = DVEBMGS00
DIR_CT_RUN = $(DIR_EXE_ROOT)/run
DIR_EXECUTABLE = $(DIR_INSTANCE)/exe
login/accept_sso2_ticket = 1
PHYS_MEMSIZE = 512
exe/saposcol = $(DIR_CT_RUN)/saposcol
rdisp/wp_no_dia = 4
rdisp/wp_no_btc = 1
exe/icmbnd = $(DIR_CT_RUN)/icmbnd
icm/server_port_0 = PROT=HTTP,PORT=80$$
#-----------------------------------------------------------------------
# SAP Messaging Service parameters are set in the DEFAULT.PFL
#-----------------------------------------------------------------------
dbms_type=ORA
dbs_ora_tnsname=DEV
dbs_ora_schema=SAPSR3
ORACLE_SID=DEV
DB_SID=DEV
ORACLE_BASE=/oracle
TNS_ADMIN=/usr/sap/DEV/SYS/profile/oracle
ORACLE_HOME=/oracle/DEV/102_64
NLS_LANG=AMERICAN_AMERICA.UTF8
SAPDATA_HOME=/oracle/DEV
MAIL=/var/spool/mail/devadm
MAILMSG=[YOU HAVE NEW MAIL]
NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
e/client/10x_64/instantclient
ms/server_port_0 = PROT=HTTP,PORT=81$$
rdisp/wp_no_enq = 1
rdisp/wp_no_vb = 1
rdisp/wp_no_vb2 = 1
rdisp/wp_no_spo = 1

#---------------------------------------------------------------------
#Values proposed by SAP for shared memory pool sizes
#---------------------------------------------------------------------
ipc/shm_psize_10 = 154000000
ipc/shm_psize_14 = 0
ipc/shm_psize_18 = 0
ipc/shm_psize_19 = 0
ipc/shm_psize_30 = -10
ipc/shm_psize_40 = 488000000
ipc/shm_psize_41 = 0
ipc/shm_psize_51 = -10
ipc/shm_psize_52 = -10
ipc/shm_psize_54 = -10
ipc/shm_psize_55 = -10
ipc/shm_psize_57 = -10
ipc/shm_psize_58 = -10

What troubleshooting steps do I follow next ? What check are needed to be done ?

Regards,

Abhishek Gupta

[former_member636576]

To add to what I said (provide you further information ), here is the permission for the /oracle/DEV/102_64/bin file

drwxr-xr-x 2 oradev dba 16384 Aug 25 2017 bin

Shared memory segments :

# ipcs
IPC status from /dev/mem as of Wed Oct 16 18:18:44 BST 2019
T ID KEY MODE OWNER GROUP
Message Queues:

Shared Memory:
m 0 0x58002133 --rw-rw-rw- root system
m 1048577 0x7800001d --rw-rw-rw- root system
m 1048578 0x78000018 --rw-rw-rw- root system
m 1048579 0x0d0009d8 --rw-rw---- root system
m 1048580 0xc675769c --rw-r----- devadm sapsys
m 5 0xffffffff --rw-r----- devadm sapsys
m 6 0x0382be84 --rw-r----- devadm sapsys
Semaphores:
s 2097152 0x58002133 --ra-ra-ra- root system
s 1 0x44002133 --ra-ra-ra- root system
s 3 0x620002e1 --ra-r--r-- root system
s 8 0xa1001006 --ra-ra-ra- root system
s 9 0x01000214 --ra------- root security
s 10 0x020007cc --ra-ra-ra- root system
s 11 0x010007cc --ra-ra-ra- root system
s 76 0x002dc7db --ra-r----- devadm sapsys
#

Listener file :

# more listener.ora
################
# Filename......: listener.ora
# Created.......: created by SAP AG, R/3 Rel. >= 6.10
# Name..........:
# Date..........:
# @(#) $Id: //bc/700-1_REL/src/ins/SAPINST/impl/tpls/ora/ind/LISTENER.ORA#4 $
################
ADMIN_RESTRICTIONS_LISTENER = on
LISTENER =
(ADDRESS_LIST =
(ADDRESS =
(PROTOCOL = IPC)
(KEY = DEV.WORLD)
)
(ADDRESS=
(PROTOCOL = IPC)
(KEY = DEV)
)
(ADDRESS =
(COMMUNITY = SAP.WORLD)
(PROTOCOL = TCP)
(HOST = DEV)
(PORT = 1527)
)
)
STARTUP_WAIT_TIME_LISTENER = 0
CONNECT_TIMEOUT_LISTENER = 10
TRACE_LEVEL_LISTENER = OFF
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = DEV)
(ORACLE_HOME = /oracle/DEV/102_64)
)
)

tnsnames.ora file

# more tnsnames.ora
################
# Filename......: tnsnames.ora
# Created.......: created by SAP AG, R/3 Rel. >= 6.10
# Name..........:
# Date..........:
# @(#) $Id: //bc/700-1_REL/src/ins/SAPINST/impl/tpls/ora/ind/TNSNAMES.ORA#4 $
################
DEV.WORLD=
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS =
(COMMUNITY = SAP.WORLD)
(PROTOCOL = TCP)
(HOST = DEV)
(PORT = 1527)
)
)
(CONNECT_DATA =
(SID = DEV)
(GLOBAL_NAME = DEV.WORLD)
)
)
tnsnames.ora: END

[Reagan]

I see you are on AIX. Could you please restart the LPAR? Afterwards restart the database. If it fails to start and throws the same error then check the groups assigned to oradev user. Restarting the server will cleanup the shared memory segments.

[former_member636576]

I don't think there is any problem with the groups of oradev user.Here,have a look :

Last unsuccessful login: Mon Oct 14 12:37:04 BST 2019 on /dev/pts/0 from 172.16.
80.7
Last login: Thu Oct 17 11:03:45 BST 2019 on /dev/pts/0 from 172.16.80.7

# id
uid=0(root) gid=0(system) groups=2(bin),3(sys),7(security),8(cron),10(audit),11(
lp),201(sapinst)
# groups
system bin sys security cron audit lp sapinst
# id oradev
uid=203(oradev) gid=203(dba) groups=201(sapinst),204(oper)
# groups oradev
oradev : dba sapinst oper
#

[former_member636576]

As per your suggestion, I performed a lpar reboot using the shutdown -Fr command

AIX Version 6
Copyright IBM Corporation, 1982, 2011.
login: root
root's Password:
\*******************************************************************************
* *
* *
* Welcome to AIX Version 6.1! *
* *
* *
* Please see the README file in /usr/lpp/bos for information pertinent to *
* this release of the AIX Operating System. *
* *
* *
*******************************************************************************
Last unsuccessful login: Mon Oct 14 12:37:04 BST 2019 on /dev/pts/0 from 172.16.
80.7
Last login: Thu Oct 17 11:08:33 BST 2019 on /dev/pts/0 from 172.16.80.7

# shutdown -Fr

SHUTDOWN PROGRAM
Thu Oct 17 11:11:32 BST 2019
Stopping The LWI Nonstop Profile...
Waiting for The LWI Nonstop Profile to exit...
Stopped The LWI Nonstop Profile.

Wait for 'Rebooting...' before stopping.
Error reporting has stopped.
Advanced Accounting has stopped...
Process accounting has stopped.
nfs_clean: Stopping NFS/NIS Daemons
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
0519-010 libodm: The specified object class does not exist.
Check path name and permissions.
telnetd: failed to write to /var/adm/wtmp: Value too large to be stored in data
type.

Connection to host lost................

After rebooting :

AIX Version 6
Copyright IBM Corporation, 1982, 2011.
login: root
root's Password:
******************************************************************************
*
*
* Welcome to AIX Version 6.1!
*
*
* Please see the README file in /usr/lpp/bos for information pertinent to
* this release of the AIX Operating System.
*
*
******************************************************************************
Last unsuccessful login: Mon Oct 14 12:37:04 BST 2019 on /dev/pts/0 from 172.1
80.7
Last login: Thu Oct 17 11:11:21 BST 2019 on /dev/pts/0 from 172.16.80.7

# su - oradev
DEV:oradev 1> sqlplus "/as sysdba"

SQL*Plus: Release 10.2.0.2.0 - Production on Thu Oct 17 11:17:40 2019

Copyright (c) 1982, 2005, Oracle. All Rights Reserved.

Connected to an idle instance.

SQL> startup
ORACLE instance started.

Total System Global Area 2298478592 bytes
Fixed Size 2072936 bytes
Variable Size 1157631640 bytes
Database Buffers 1124073472 bytes
Redo Buffers 14700544 bytes
Database mounted.
Database opened.
SQL>

Thereafter I re-started the listener,stopped sap and started :

Last unsuccessful login: Mon Oct 14 12:37:04 BST 2019 on /dev/pts/0 from 172.16.
80.7
Last login: Thu Oct 17 11:17:17 BST 2019 on /dev/pts/0 from 172.16.80.7

# su - oradev
DEV:oradev 1> lsnrctl start

LSNRCTL for IBM/AIX RISC System/6000: Version 10.2.0.2.0 - Production on 17-OCT-
2019 11:22:20

Copyright (c) 1991, 2005, Oracle. All rights reserved.

Starting /oracle/DEV/102_64/bin/tnslsnr: please wait...

TNSLSNR for IBM/AIX RISC System/6000: Version 10.2.0.2.0 - Production
System parameter file is /oracle/DEV/102_64/network/admin/listener.ora
Log messages written to /oracle/DEV/102_64/network/log/listener.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=DEV.WORLD)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=DEV)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=DEV)(PORT=1527)))

Connecting to (ADDRESS=(PROTOCOL=IPC)(KEY=DEV.WORLD))
STATUS of the LISTENER
------------------------
Alias LISTENER
Version TNSLSNR for IBM/AIX RISC System/6000: Version 10.2.0.2
.0 - Production
Start Date 17-OCT-2019 11:22:24
Uptime 0 days 0 hr. 0 min. 2 sec
Trace Level off
Security ON: Local OS Authentication
SNMP ON
Listener Parameter File /oracle/DEV/102_64/network/admin/listener.ora
Listener Log File /oracle/DEV/102_64/network/log/listener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=DEV.WORLD)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=DEV)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=DEV)(PORT=1527)))
Services Summary...
Service "DEV" has 1 instance(s).
Instance "DEV", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
DEV:oradev 2> logout
# su - devadm
[YOU HAVE NEW MAIL]
DEV:devadm 1> stopsap all
Checking DEV Database
Database is running
-------------------------------------------
stopping the SAP instance DVEBMGS00
Shutdown-Log is written to /home/devadm/stopsap_DVEBMGS00.log
-------------------------------------------
/usr/sap/DEV/DVEBMGS00/exe/sappfpar=>sapparam(6): /usr/sap/DEV/SYS/profile/DEV_D
VEBMGS00_DEV: missing '=' in line 53
Instance DVEBMGS00 was not running!
Trying to stop DEV database ...
Log file: /home/devadm/stopdb.log
/usr/sap/DEV/SYS/exe/run/stopdb: Terminating with error code 13
/usr/sap/DEV/SYS/exe/run/stopdb: DB shutdown failed

please send the tracefile /home/devadm/stopsap.trc to support

DEV:devadm 2> startsap all
Checking DEV Database
Database is running
-------------------------------------------
/usr/sap/DEV/DVEBMGS00/exe/sappfpar=>sapparam(6): /usr/sap/DEV/SYS/profile/DEV_D
VEBMGS00_DEV: missing '=' in line 53
Starting Startup Agent sapstartsrv
OK
Instance Service on host DEV started
-------------------------------------------
starting SAP Instance DVEBMGS00
Startup-Log is written to /home/devadm/startsap_DVEBMGS00.log
-------------------------------------------
/usr/sap/DEV/DVEBMGS00/exe/sapcontrol -prot NI_HTTP -nr 00 -function Start
Instance on host DEV started
DEV:devadm 3>

SAP is now up and running . Thanks a lot for your help. Really appreciate it.

Regards,

Abhishek Gupta

[Reagan]

Thanks for letting us know that the issue is now fixed. You may now close your question.

Take care