results for shmoo package are crash

Hi!
I have a custom board using Tegra Tk1. Now i running shmoo package for this board but when i run runme_instead_TK1_Sanity.bat and check in results folder, every file contain following message

Version(“V1.0.0”);
CFGVersion(“NoCfgVersion”);
CFG(“extras\config_files\CFG_792MHz.cfg”);
DefName(“PLLM828##Rdv##c950i1300h1000”);
DefStartTime(“Tue Nov 06 11:01:06 2018”);
DefEndTime(“Tue Nov 06 11:01:07 2018”);
SetDimension(1);

DefAxis(0, “Rdv”, 24, DefValues([‘24’] ));

DefResult(FindState([0]), Crashed); # 1

I do the only chnage is param file. I created my own param file as i was using different DDR3L.
Do anyone have idea that what is the problem i am facing.
Here below is the prints appear in the window when i run runme_instead_TK1_Sanity.bat

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000000

Enter command:
Enter command:
Enter command:
Enter command:
Enter command:
Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000000

Enter command:
Enter command:
Enter command:
Enter command:
Enter command:
Enter command:
Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000100

Enter command: nvhost: *(7000D01C) = 0x00000000

Enter command: nvhost: *(7000D010) = 0x00000022

Enter command: target_stdout: enter NvTestMain V01
target_stdout: Processing argument 1: -fc
target_stdout: Processing argument 3: -vic
target_stdout: -vic 312
target_stdout: Processing argument 5: -reg
target_stdout: Processing argument 7: -log
target_stdout: Processing argument 9: -m
target_stdout: setting offset of the tested memory to 0xbf800000
target_stdout: Processing argument 11: -z
target_stdout: Processing argument 13: -s
target_stdout: Processing argument 15: -n
target_stdout: Processing argument 17: -b
target_stdout: The number of pattern: 16, box num 30
target_stdout: box width/height 2048 128 Surface width/height: 2048 3840
target_stdout: init sdram
target_stdout: Memory size = 0x00000400
target_stdout: SDRAM Subtest Start
target_stdout: Addr = 0x80000010, Value = 0x1599fd08, Gold = 0x0
target_stdout: SDRAM Subtest FAIL
target_stdout: SDRAM Subtest Start
target_stdout: Addr = 0x80000010, Value = 0x1599fd08, Gold = 0xaaaaaaaa
target_stdout: SDRAM Subtest FAIL
target_stdout: SDRAM Subtest Start
target_stdout: Addr = 0x80000010, Value = 0x1599fd08, Gold = 0x0
target_stdout: SDRAM Subtest FAIL
target_stdout: SDRAM Subtest Start
target_stdout: Addr = 0x80000010, Value = 0x1599fd08, Gold = 0x55555555
target_stdout: SDRAM Subtest FAIL
target_stdout: SDRAM test FAILED!!!
target_stdout: Breaking after sdram init…
Hit a Breakpoint. Use shrun to continue.
nvhost: OK

Enter command: target_stdout: Register Engine
target_stdout: Find Engine id: 0x5d
target_stdout: search id: 0x5e
target_stdout: search id: 0x5d
target_stdout: Engine ID: 0x5d found
target_stdout:
target_stdout:
target_stdout: -------Start: sanity in Register based mode
target_stdout: Board: E1186
target_stdout: top 0xfffffffe
target_stdout: initBLit
target_stdout: Init Vic Frequency Ctrl
target_stdout: Skipping pllc programming
target_stdout: SOURCE_VIC reg: 0xa0000000 VIC source: PLLC3_OUT0
target_stdout: ENB X reg: 0x01040000 vic clock: enable
target_stdout: ENB L reg: 0x90400130 host1x clock: enable
target_stdout: AllocSyncpt
target_stdout: channe base:0x50000000 sync base:0x2100, syncpt0 base:0xf80
target_stdout: prep surface
target_stdout: DRAM addr range: 0x80000000 - 0xfffffffe
target_stdout: DRAM footprint: 0xbf800000 - 0xc0700000 (wfblit)
target_stdout: DRAM used: 15.0MB (blit uses 15.0MB)
target_stdout: == Range 0 in 1: 0xbf800000 - 0xc06fffff
target_stdout: wfblitcore
target_stdout: Patterns loaded. starting blits.
target_stdout: PMC aperture space
target_stdout: PMC_PLLP_WB0_OVERRIDE reg: 0x00000422
target_stdout: PLLM_WB0_OVERRIDE_FREQ reg: 0x0000010c
target_stdout: PMC:PLLP: override: disable
target_stdout: PMC:PLLM: override: disable (12,1)
target_stdout:
target_stdout: CAR aperture space
target_stdout: PLLM: 972MHz(1,81,0), PLL_BASE: 0x4c005101,
target_stdout: PLLP: override: enable
target_stdout: PLLP: 432MHz(2,72,0), PLL_BASE: 0x58004802,
target_stdout: PLLC: 624MHz(1,104,1), PLL_BASE: 0x48106801,
target_stdout: EMC source clk: PLLM_UD, SOURCE_EMC: 0x80000000
target_stdout: (ref=12MHz)
target_stdout: EMC freq: 972MHz
target_stdout: start box. loops: 0x0 numbox: 30
target_stdout: end box
target_stdout: Programming done. Waiting test done.
target_stdout: ----------------------
target_stdout: T124 Memory Statistics
target_stdout: ----------------------
target_stdout: Stats (
target_stdout:
target_stdout: Channel 0:
target_stdout: DEV 0:
target_stdout: .RD (
target_stdout: .RD8 (
target_stdout: .WR (
target_stdout: .WR8 (
target_stdout: .ACT (
target_stdout: .REF (
target_stdout: .SREF (
target_stdout: .E1CA (
target_stdout: .E1SA (
target_stdout: .E0CA (
target_stdout: .E0SA (
target_stdout: .E1CN (
target_stdout: .E1SN (
target_stdout: .E0CN (
target_stdout: .E0SN (
target_stdout:
target_stdout: DEV 1:
target_stdout: .RD (
target_stdout: .RD8 (
target_stdout: .WR (
target_stdout: .WR8 (
target_stdout: .ACT (
target_stdout: .REF (
target_stdout: .SREF (
target_stdout: .E1CA (
target_stdout: .E1SA (
target_stdout: .E0CA (
target_stdout: .E0SA (
target_stdout: .E1CN (
target_stdout: .E1SN (
target_stdout: .E0CN (
target_stdout: .E0SN (
target_stdout:
target_stdout: Channel 0 Bandwidth(avg): 2573MB/s, or 33% (assuming static 972MH
z)
target_stdout: =====================
target_stdout: End Memory Statistics
target_stdout: =====================
target_stdout: Blit done. The blit took 0.0 seconds
target_stdout: Read back check. Mask = 0xffffffff
target_stdout:
target_stdout: index: 0x0 box/x/y: 0/0/0 Expected:0x1 Actual:0x1599fd08
target_stdout: Physaddr: 0xbf800000
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x1 box/x/y: 0/1/0 Expected:0x2 Actual:0x85c04a4d
target_stdout: Physaddr: 0xbf800004
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x2 box/x/y: 0/2/0 Expected:0x4 Actual:0x44a19e2e
target_stdout: Physaddr: 0xbf800008
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x3 box/x/y: 0/3/0 Expected:0x8 Actual:0x1c0a7020
target_stdout: Physaddr: 0xbf80000c
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x4 box/x/y: 0/4/0 Expected:0x10 Actual:0x1599fd08
target_stdout: Physaddr: 0xbf800010
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x5 box/x/y: 0/5/0 Expected:0x20 Actual:0x85c04a4d
target_stdout: Physaddr: 0xbf800014
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x6 box/x/y: 0/6/0 Expected:0x40 Actual:0x44a19e2e
target_stdout: Physaddr: 0xbf800018
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x7 box/x/y: 0/7/0 Expected:0x80 Actual:0x1c0a7020
target_stdout: Physaddr: 0xbf80001c
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x0, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x8 box/x/y: 0/8/0 Expected:0x100 Actual:0x0
target_stdout: Physaddr: 0xbf800020
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x1, channel(sp): 0x0
target_stdout:
target_stdout: index: 0x9 box/x/y: 0/9/0 Expected:0x200 Actual:0x0
target_stdout: Physaddr: 0xbf800024
target_stdout: Default Pattern. Init Pattern format: LongMats, pattern index: 0x
0.
target_stdout: Current Pattern format: WalkingOnes, pattern index: 0x1.
target_stdout: Physical Location. rank 0x1, channel(sp): 0x0
host_stderr: Error 00000005 (Timeout) at c:/workspace/src/t124-bringup/core-priv
ate/drivers/nvhost/nvhost.c:5712
host_stderr: Error 00000005 (Timeout) at c:/workspace/src/t124-bringup/core-priv
ate/drivers/nvhost/nvhost.c:5697
nvhost: QUIT
error: not completed in the expected time
Result: 0x1

Estimated End Time: Wed Nov 07 12:23:43 2018

===SHMOO COMPLETE===

Hi, it looks like your CFG is not generated correctly so that SDRAM Subtest FAIL. Please step by step follow the app note in shmoo package to generate CFG based on your DDR design. That should be no problem.

Hi!
Thanks for your reply, now I have passed the full shmoo also. can you help me with this problem

https://devtalk.nvidia.com/default/topic/1044037/jetson-tk1/custom-board-always-in-force-recovery-mode/post/5296903/#5296903