SA12 dbremote errors

[Former Member]

We are currently experiencing issues with dbremote running on remote databases. Replication has been running for months without issue but now we are getting the database locking up and dbremote failing to run. Dbremote seems to lose connection while processing files:

I. 2013-11-11 17:43:29. UPDATE shipclip.NIIN
                           SET FSC=NULL,
                               COG=NULL,
                               DESCR=NULL,
                               UNIT_PRICE=224.08,
                               BRF=NULL,
                               UOM=NULL,
                               AAC=NULL,
                               SLC=NULL,
                               SLAC=NULL,
                               NET_PRICE=NULL
                        VERIFY (FSC,COG,DESCR,UNIT_PRICE,BRF,UOM,AAC,SLC,SLAC,NET_PRICE)
                        VALUES ('4820','9B','SEAT,VALVE',222.21,.25,'EA','Z','0','00',0)
                         WHERE NIIN='012090384'
E. 2013-11-11 18:02:07. SQL statement failed: (-85) Communication error
E. 2013-11-11 18:04:08. SQL statement failed: (-832) Connection error: Shared memory connection to server timed out
E. 2013-11-11 18:04:08. Error connecting to database
E. 2013-11-11 18:04:08. SQL statement failed: (-101) Not connected to a database
E. 2013-11-11 18:04:08. SQL statement failed: (-85) Communication error
E. 2013-11-11 18:04:08. Communication error (-85)
E. 2013-11-11 18:04:08. SQL statement failed: (-85) Communication error
E. 2013-11-11 18:04:08. Communication error (-85)
E. 2013-11-11 18:04:08. SQL statement failed: (-101) Not connected to a database
I. 2013-11-11 18:04:08. Shutdown by request
I. 2013-11-11 18:04:08. Execution completed
I. 2013-11-11 19:02:43. SQL Remote Message Agent Version 12.0.1.3750

[VolkerBarth]

You may try to add the LOG=filename connection parameter to DBREMOTE's connection string to get debug information on connection issues.

You also might use sa_conn_info() and sa_locks() in a DBISQL session to try to find out whether the operations from SQL Remote are blocked by concurrent OLAP transactions...

---

If this is a blocking issue, have you set individual values for the BLOCKING and BLOCKING_TIMEOUT options, or are they used with their default values (ON and 0, meaning infinite waiting on blocks to be released)?

[regdomaratzki]

Does the database engine log have any entries from around the same time to indicate what might have happened?

[former_SQLA_member1694878]

Are you modifying the SUBSCRIBE BY values for an article when this happens?

[Former Member]

VERSION=12.0.1.3817
FILENAME=C:\\ProgramData\\SQL Anywhere 12\\diagnostics\\SA12_20131112_113104_8228.crash_log
OS=Windows 7 Build 7601 Service Pack 1
PROCESSOR=X86_64
EXEC_ARCH=X86
EXEC_PATH=C:\\Program Files\\SQL Anywhere 12\\Bin32\\dbsrv12.exe
MODULE_PATH=C:\\Program Files\\SQL Anywhere 12\\Bin32\\dbserv12.dll
EXCEPTION_PTR=08EBEC18
EXCEPTION_CODE=3221225477
EXCEPTION_FLAGS=0
EXCEPTION_RECORD=00000000
EXCEPTION_ADDRESS=00AE1F35
EXCEPTION_NumParameters=2
EXCEPTION_Param0=00000001
EXCEPTION_Param1=08ECF0FD
TRYING_TO_SAVE_MINI_DUMP C:\\ProgramData\\SQL Anywhere 12\\diagnostics\\SA12_20131112_113104_8228.dmp
DUMPLEVEL 0
SAVING_MINI_DUMP_COMPLETED
CRASH_LOG_COMPLETE
ATTEMPTING_TO_SUBMIT_MINIDUMP...

[reimer_pods]

This looks like a mini dump has been created. You might want to check for unsent crash reports in a command window with

dbsupport -lc

[Former Member]

There is nothing in the Server Log. It does not even show the database shutdown

I. 11/12 10:45:55. Now accepting requests I. 11/12 10:45:55. Starting TCPIP listener on IP address (::):2641 I. 11/12 10:45:55. Starting TCPIP listener on IP address 0.0.0.0:2641 I. 11/12 10:52:30. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:52 I. 11/12 10:52:31. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:52 I. 11/12 10:59:11. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:59 I. 11/12 10:59:11. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:59 I. 11/12 11:05:52. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:05 I. 11/12 11:05:52. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:05 I. 11/12 11:12:32. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:12 I. 11/12 11:12:33. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:12 I. 11/12 11:19:13. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:19 I. 11/12 11:19:13. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:19 I. 11/12 11:25:54. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:25 I. 11/12 11:25:54. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:25 I. 11/12 11:31:03. Connection ID 1: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 1: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 1: Server character set conversion is enabled, but not required using character set "windows-1252" I. 11/12 11:31:03. Connection ID 2: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 2: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 2: Server character set conversion is enabled, but not required using character set "windows-1252" I. 11/12 11:31:03. Connection ID 3: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 3: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 3: Server character set conversion is enabled, but not required using character set "windows-1252" I. 11/12 11:31:03. Connection ID 4: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 4: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 4: Server character set conversion is enabled, but not required using character set "windows-1252"

[regdomaratzki]

Are you sure no mini-dump files were generated? They would likely be at "%ALLUSERSPROFILE%SQL Anywhere 12diagnostics", although the page below gives more information about where the files might be located.

http://dcx.sybase.com/index.html#1201/en/dbadmin/dbutilities-s-3600377.html*diagnostic-directory-loc...

[Former Member]

No the subscribe by value is not being modified.

No mini dump file.

Tue Nov 12 2013 11:31:03 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Trying to start SharedMemory link ... 11:31:03 SharedMemory link started successfully 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 1] Connected to database successfully 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=get_remote_option;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 2] Connected to database successfully 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=Worker0;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 3] Connected to database successfully 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=SYNCH;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 4] Connected to database successfully 11:31:04 [ 3] Disconnecting shared memory client, process id not found 11:31:04 [ 3] Communication function i_cs_HandleSQLPresError code 4 11:31:04 [ 3] Communication function StrmGetInd code 7 11:31:04 Attempting to connect using: UID=rep_dbo;PWD=**;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=ERROR;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:04 Attempting to connect to a running server... 11:31:04 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:04 Failed to connect over SharedMemory 11:31:04 Cannot connect to server 11:31:04 [ 2] Disconnecting shared memory client, process id not found 11:31:04 [ 2] Communication function i_cs_HandleSQLPresError code 4 11:31:04 [ 2] Communication function StrmGetInd code 7 11:31:04 [ 4] Disconnecting shared memory client, process id not found 11:31:04 [ 4] Communication function i_cs_HandleSQLPresError code 4 11:31:04 [ 4] Communication function StrmGetInd code 7 11:31:05 [ 1] Disconnecting shared memory client, process id not found 11:31:05 [ 1] Communication function i_cs_HandleSQLPresError code 4 11:31:05 [ 1] Communication function StrmGetInd code 7

[regdomaratzki]

That's the log generated on the client side as a result of adding "log=" into the connection string. It tells us the database engine isn't running anymore.

What about the database engine log? We need to figure out why the database engine shut down.

[Former Member]

We have pulled the remote database from the remote server and currently running the database on a stand-alone server with no other connections but the dbremote replication and still getting the same errors.

The database stops and dbremote ends after 1 update statement.
BLOCKING and BLOCKING_TIMEOUT options are default

[regdomaratzki]

re: "the database stops"

Does the database engine log have any entries from around the same time to indicate what might have happened?

Did the database engine crash and generate a mini-dump file?