Windows Debugger ( Windbg) – Analyze – “sqldumperlibraryinvoke” – 2018-June ( Session 4 )

Background

Let us start analyzing some of our mdmp files.

Process

Outline

  1. Launch windbg
  2. Open dump file
  3. Download Symbols Library
  4. Analyze

Open Dump  File

Image

bucket_20180627_0933AM.png

Text


Loading Dump File [E:\Program Files\Microsoft SQL Server\MSSQL13.MSSQLSERVER\MSSQL\Log\SQLDump0057.mdmp]
User Mini Dump File with Full Memory: Only application data is available

Comment: 'Stack Trace'
Comment: 'Location: bckioreq.cpp:2037
Expression: GetBytesRequested () == GetBytesTransferred ()
SPID: 53
Process ID: 1336'
Symbol search path is: srv*

Explanation

  1. Error
    • Comment: ‘Stack Trace’Comment: ‘Stack Trace’Comment: ‘Location: bckioreq.cpp:2037Expression: GetBytesRequested () == GetBytesTransferred ()SPID: 53

 

Analyze

Syntax


!analyze -v

Output


0:050> !analyze -v
*******************************************************************************
*                                                                             *
*                        Exception Analysis                                   *
*                                                                             *
*******************************************************************************

WARNING: Thread 1b2484 exited during dump writing (open status NTSTATUS 0xC000000B)
WARNING: Thread 1b2484 exited during dump writing (open status NTSTATUS 0xC000000B)
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
WARNING: Teb 76 pointer is NULL - defaulting to 00000000`7ffde000
WARNING: 00000000`7ffde000 does not appear to be a TEB
GetUrlPageData2 (WinHttp) failed: 12002.

KEY_VALUES_STRING: 1

TIMELINE_ANALYSIS: 1

Timeline: !analyze.Start
    Name: 
    Time: 2018-06-27T16:13:27.633Z
    Diff: 1083451633 mSec

Timeline: Dump.Current
    Name: 
    Time: 2018-06-15T03:15:56.0Z
    Diff: 0 mSec

Timeline: Process.Start
    Name: 
    Time: 2018-06-11T19:49:21.0Z
    Diff: 285995000 mSec

Timeline: OS.Boot
    Name: 
    Time: 2018-06-11T19:48:34.0Z
    Diff: 286042000 mSec

DUMP_CLASS: 2

DUMP_QUALIFIER: 400

CONTEXT:  (.ecxr)
rax=000000800194ab60 rbx=0000000080004005 rcx=000000800194a900
rdx=0000008024699cd0 rsi=0000000000008060 rdi=0000000000000000
rip=00007ff94c7b8eac rsp=000000800194ad30 rbp=00000001b069d19a
 r8=0000000000000001  r9=0000000000000000 r10=00007ff942a5da38
r11=00000000fffffffe r12=00007ff93f6d3600 r13=00000001b069d19a
r14=00007ff93ee4f4d0 r15=00007ff66d0fbd80
iopl=0         nv up ei pl nz na po nc
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206
KERNELBASE!RaiseException+0x68:
00007ff9`4c7b8eac 488b8c24c0000000 mov     rcx,qword ptr [rsp+0C0h] ss:00000080`0194adf0=000009b980e74c0b
Resetting default scope

FAULTING_IP:
sqllang!SQLDumperLibraryInvoke+1f6
00007ff9`3de802c6 448bf8          mov     r15d,eax

EXCEPTION_RECORD:  (.exr -1)
ExceptionAddress: 00007ff93de802c6 (sqllang!SQLDumperLibraryInvoke+0x00000000000001f6)
   ExceptionCode: 000042ac
  ExceptionFlags: 00000000
NumberParameters: 0

DEFAULT_BUCKET_ID:  APPLICATION_FAULT

PROCESS_NAME:  sqlservr.exe

ERROR_CODE: (NTSTATUS) 0x42ac - 

EXCEPTION_CODE: (Win32) 0x42ac (17068) - 

EXCEPTION_CODE_STR:  42ac

WATSON_BKT_PROCSTAMP:  58145622

WATSON_BKT_PROCVER:  2015.130.4001.0

PROCESS_VER_PRODUCT:  Microsoft SQL Server

WATSON_BKT_MODULE:  sqllang.dll

WATSON_BKT_MODSTAMP:  581456b1

WATSON_BKT_MODOFFSET:  5602c6

WATSON_BKT_MODVER:  2015.130.4001.0

MODULE_VER_PRODUCT:  Microsoft SQL Server

BUILD_VERSION_STRING:  6.3.9600.17415 (winblue_r4.141028-1500)

MODLIST_WITH_TSCHKSUM_HASH:  a60dd8f5be5ecf77c0efc2309e59f0c75e9e3d93

MODLIST_SHA1_HASH:  df74a5b9ff12b3cb21e79eddd897492af85c05d4

COMMENT:  Stack Trace

NTGLOBALFLAG:  0

PROCESS_BAM_CURRENT_THROTTLED: 0

PROCESS_BAM_PREVIOUS_THROTTLED: 0

APPLICATION_VERIFIER_FLAGS:  0

PRODUCT_TYPE:  3

SUITE_MASK:  272

DUMP_FLAGS:  8000c07

DUMP_TYPE:  3

MISSING_CLR_SYMBOL: 0

ANALYSIS_SESSION_HOST:  HRDB

ANALYSIS_SESSION_TIME:  06-27-2018 09:13:27.0633

ANALYSIS_VERSION: 10.0.17134.12 amd64fre

MANAGED_CODE: 1

MANAGED_ENGINE_MODULE:  clr

MANAGED_ANALYSIS_PROVIDER:  SOS

THREAD_ATTRIBUTES:
OS_LOCALE:  ENU

PROBLEM_CLASSES: 

    ID:     [0n316]
    Type:   [APPLICATION_FAULT]
    Class:  Primary
    Scope:  DEFAULT_BUCKET_ID (Failure Bucket ID prefix)
            BUCKET_ID
    Name:   Add
    Data:   Omit
    PID:    [Unspecified]
    TID:    [Unspecified]
    Frame:  [0]

BUGCHECK_STR:  APPLICATION_FAULT

PRIMARY_PROBLEM_CLASS:  APPLICATION_FAULT

LAST_CONTROL_TRANSFER:  from 00007ff66d0b9c9c to 00007ff94c7b8eac

STACK_TEXT:
00000080`0194ad30 00007ff6`6d0b9c9c : 00000080`0194ae80 00000000`00000000 00000080`0194aeb0 00000080`0194aea0 : KERNELBASE!RaiseException+0x68
00000080`0194ae10 00007ff9`3de802c6 : 00007ff6`6d0fbd80 00000000`00000002 00000000`00000000 00000000`00000002 : sqlservr!CDmpDump::Dump+0x4c
00000080`0194ae50 00007ff9`3e97c411 : 00007ff6`6d0fbd80 00000000`00008060 00000000`00000000 00007ff9`4c7b1616 : sqllang!SQLDumperLibraryInvoke+0x1f6
00000080`0194ae90 00007ff9`3e97ce94 : 00000000`00029164 00000080`0194ccb0 00000000`00000000 00007ff9`3fcdfe30 : sqllang!SQLLangDumperLibraryInvoke+0x161
00000080`0194af40 00007ff9`3e94cd0b : 00000081`8ed00e20 00000080`0194ccb0 00000081`8ed00e20 00000081`8ed00160 : sqllang!CImageHelper::DoMiniDump+0x475
00000080`0194b150 00007ff9`3e9872a9 : 00000000`00000000 00000080`0194ccb0 0fffffff`fffffff0 00000080`000000bf : sqllang!stackTrace+0x9db
00000080`0194cb70 00007ff9`3cc1d714 : 00000000`00000000 ffffffff`fffffffe 00000001`00000003 ffffffff`fffffffe : sqllang!utassert_fail_imp+0x60c
00000080`0194d370 00007ff9`414eacf4 : 00000000`00000000 00007ff9`4c7b22d4 00000000`0040008a 00000000`00000000 : sqldk!utassert_fail+0x2e4
00000080`0194d860 00007ff9`414eb8f7 : 00000080`0194d9a8 00000081`3edb55d0 00000081`3edb55d0 00000000`00000200 : sqlmin!BackupIoRequest::WaitForCompletionInternal+0x254
00000080`0194d8f0 00007ff9`415682c0 : 00000081`3edb55d0 00007ff9`3fed1390 00000081`3edb52b0 ffffffff`ffffff00 : sqlmin!BackupIoRequest::Quiesce+0x47
00000080`0194d990 00007ff9`414c10f3 : 00000081`3edb5450 00000000`00000000 00000081`303a12b0 00000081`303a12c8 : sqlmin!BackupMediaIoRequest::Cleanup+0x80
00000080`0194da70 00007ff9`4155f39d : 00000081`303a1260 00000081`9f706160 00000082`21496e80 00000081`303a1880 : sqlmin!BackupBufferSet::Empty+0x63
00000080`0194daa0 00007ff9`4155f2c0 : 00000081`303a1260 00000081`303a1260 00000082`21496e80 00000081`8ed00160 : sqlmin!BackupMediaIo::ReleaseResources+0x7d
00000080`0194dad0 00007ff9`41516259 : 00000081`303a1260 00000082`21496e80 00000081`0f260160 00007ff9`3cbc26d4 : sqlmin!BackupMediaIo::Discard+0x180
00000080`0194dba0 00007ff9`415220b4 : 00000081`303a0200 00000081`303a0270 00000081`ffffffff 00000080`0194dca8 : sqlmin!BackupStream::ThreadMainRoutine+0x109
00000080`0194dc50 00007ff9`4000f7a9 : 00000081`303a0270 00007ff9`419c6758 00000082`21496e80 00000000`00000000 : sqlmin!BackupThread::ThreadBase+0x54
00000080`0194dcf0 00007ff9`3cbc5bfd : 00000080`0194f600 00000081`9f70ace8 ffffffff`ffffffff 00000000`00000000 : sqlmin!SubprocEntrypoint+0x10ab
00000080`0194f550 00007ff9`3cbc58f5 : 00000081`9f70ace8 00000081`9f70aca8 00000081`9f70ad30 ffffffff`00000000 : sqldk!SOS_Task::Param::Execute+0x231
00000080`0194fb50 00007ff9`3cbc554d : 00000081`8b980040 00000080`0194fc39 00000081`8b980040 00000081`9f706160 : sqldk!SOS_Scheduler::RunTask+0xaa
00000080`0194fbc0 00007ff9`3cbed7c8 : 00000000`00000000 00000081`9f706160 0000002b`6e565d04 00007ff9`3cbedf00 : sqldk!SOS_Scheduler::ProcessTasks+0x3cd
00000080`0194fca0 00007ff9`3cbedb10 : 00000081`9f706160 0000002b`6e565d04 00000081`9f706160 0000002b`6e565d04 : sqldk!SchedulerManager::WorkerEntryPoint+0x2a1
00000080`0194fd70 00007ff9`3cbedcd7 : 00000081`9f706160 00000080`0194fe10 00000082`260803c0 00000080`245bf180 : sqldk!SystemThread::RunWorker+0x8f
00000080`0194fda0 00007ff9`3cbed9f8 : 00000082`26080370 00000000`00000000 00000000`00000000 00000082`260802b0 : sqldk!SystemThreadDispatcher::ProcessWorker+0x2de
00000080`0194fe50 00007ff9`4f2f13d2 : 00000000`00000000 00000000`00000000 00000080`245bf180 00000080`245bf180 : sqldk!SchedulerManager::ThreadEntryPoint+0x1d8
00000080`0194ff00 00007ff9`4f5754f4 : 00007ff9`4f2f13b0 00000000`00000000 00000000`00000000 00000000`00000000 : kernel32!BaseThreadInitThunk+0x22
00000080`0194ff30 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : ntdll!RtlUserThreadStart+0x34

THREAD_SHA1_HASH_MOD_FUNC:  feb32110b670587fc13057de8d7ebfe838958940

THREAD_SHA1_HASH_MOD_FUNC_OFFSET:  6aaf83029e4b6c46c389ee612fcb39920fcdcf5d

THREAD_SHA1_HASH_MOD:  f5856987294060b75593249d28208b1df5bb661e

FOLLOWUP_IP:
sqllang!SQLDumperLibraryInvoke+1f6
00007ff9`3de802c6 448bf8          mov     r15d,eax

FAULT_INSTR_CODE:  48f88b44

SYMBOL_STACK_INDEX:  2

SYMBOL_NAME:  sqllang!SQLDumperLibraryInvoke+1f6

FOLLOWUP_NAME:  MachineOwner

MODULE_NAME: sqllang

IMAGE_NAME:  sqllang.dll

DEBUG_FLR_IMAGE_TIMESTAMP:  581456b1

STACK_COMMAND:  ~50s ; .ecxr ; kb

BUCKET_ID:  APPLICATION_FAULT_sqllang!SQLDumperLibraryInvoke+1f6

FAILURE_EXCEPTION_CODE:  42ac

FAILURE_IMAGE_NAME:  sqllang.dll

BUCKET_ID_IMAGE_STR:  sqllang.dll

FAILURE_MODULE_NAME:  sqllang

BUCKET_ID_MODULE_STR:  sqllang

FAILURE_FUNCTION_NAME:  SQLDumperLibraryInvoke

BUCKET_ID_FUNCTION_STR:  SQLDumperLibraryInvoke

BUCKET_ID_OFFSET:  1f6

BUCKET_ID_MODTIMEDATESTAMP:  581456b1

BUCKET_ID_MODCHECKSUM:  258ccd4

BUCKET_ID_MODVER_STR:  2015.130.4001.0

BUCKET_ID_PREFIX_STR:  APPLICATION_FAULT_

FAILURE_PROBLEM_CLASS:  APPLICATION_FAULT

FAILURE_SYMBOL_NAME:  sqllang.dll!SQLDumperLibraryInvoke

FAILURE_BUCKET_ID:  APPLICATION_FAULT_42ac_sqllang.dll!SQLDumperLibraryInvoke

WATSON_STAGEONE_URL:  http://watson.microsoft.com/StageOne/sqlservr.exe/2015.130.4001.0/58145622/sqllang.dll/2015.130.4001.0/581456b1/42ac/005602c6.htm?Retriage=1

TARGET_TIME:  2018-06-15T03:15:56.000Z

OSBUILD:  9200

OSSERVICEPACK:  17415

SERVICEPACK_NUMBER: 0

OS_REVISION: 0

OSPLATFORM_TYPE:  x64

OSNAME:  Windows 8

OSEDITION:  Windows 8 Server TerminalServer SingleUserTS

USER_LCID:  0

OSBUILD_TIMESTAMP:  2014-10-28 19:45:30

BUILDDATESTAMP_STR:  141028-1500

BUILDLAB_STR:  winblue_r4

BUILDOSVER_STR:  6.3.9600.17415

ANALYSIS_SESSION_ELAPSED_TIME:  748d

ANALYSIS_SOURCE:  UM

FAILURE_ID_HASH_STRING:  um:application_fault_42ac_sqllang.dll!sqldumperlibraryinvoke

FAILURE_ID_HASH:  {ab1e43e2-da46-c388-f696-a374d74f9a5d}

Followup:     MachineOwner
---------

Explanation

  1. Exited during dump writing (open status NTSTATUS 0xC000000B)
    • problems experienced during database dumping ( backup )
    • NTSTATUS 0xC000000B

 

Summary

Issues encountered during backup.

Review database backup strategy and resource availability.

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s