Environment : dnnsoftware.com copy / 2 instances version & fcn mode 9.1 FCN Mode single 9.1 FCN Mode disabled 9.1.1 FCN Mode single 9.1.1 FCN Mode disabled 9.1 Patched FCN Mode Disabled IIS Initialization On Startup Time = test 1 Startup Time = test 3 Startup Time = test 7 Startup Time = test 9 Startup Time = test 5 IIS Initialization Off Startup Time = test 2 Startup Time = test 4 Startup Time = test 8 Startup Time = test 10 Startup Time = test 6 Test 1 Application shut down 108 times in the 45 minute test, site never came online. Test 2 Application shut down 51 times in the 45 minute test, site never came online. Test 3 start up time 3:07, no restarts 2017-06-01 18:02:57,961 [RD00155DF7AEF1][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000052) 2017-06-01 18:03:03,006 [RD00155DF7AEF1][D:2][Thread:9][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-01 18:03:07,043 [RD00155DF7AEE6][D:2][Thread:14][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-01 18:03:07,651 [RD00155DF7AEF1][D:2][Thread:9][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-01 18:04:50,558 [RD00155DF7AEE6][D:2][Thread:14][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-01 18:04:52,550 [RD00155DF7AEF1][D:2][Thread:9][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-01 18:04:55,654 [RD00155DF7AEF1][D:2][Thread:9][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-01 18:04:59,885 [RD00155DF7AEE6][D:2][Thread:38][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-01 18:05:04,791 [RD00155DF7AEE6][D:2][Thread:38][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) Test 4 start up time 4:11, no restarts 2017-06-01 18:54:06,647 [RD00155DF7AEF1][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000042) 2017-06-01 18:54:07,210 [RD00155DF7AEE6][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000067) 2017-06-01 18:54:11,194 [RD00155DF7AEF1][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-01 18:54:11,335 [RD00155DF7AEE6][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-01 18:54:14,752 [RD00155DF7AEE6][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-01 18:54:14,720 [RD00155DF7AEF1][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-01 18:56:41,943 [RD00155DF7AEF1][D:2][Thread:47][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-01 18:58:17,664 [RD00155DF7AEF1][D:2][Thread:47][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) Test 5 start up time 3:10, but one node fails right away and never comes back online 2017-06-01 20:01:56,763 [RD00155DF7AEE6][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000034) 2017-06-01 20:01:56,964 [RD00155DF7AEF1][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000041) 2017-06-01 20:02:02,865 [RD00155DF7AEF1][D:2][Thread:9][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-01 20:02:08,923 [RD00155DF7AEE6][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-01 20:03:59,703 [RD00155DF7AEE6][D:2][Thread:6][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-01 20:03:59,826 [RD00155DF7AEF1][D:2][Thread:9][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-01 20:04:02,008 [RD00155DF7AEF1][D:2][Thread:36][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeShutdownOverload - Watcher Activity: Changed. Path: D:\home\site\wwwroot\Portals\_default\Logs (logs are flooded with these) 2017-06-01 20:04:06,265 [RD00155DF7AEF1][D:2][Thread:9][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-01 20:04:02,149 [RD00155DF7AEF1][D:2][Thread:22][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeShutdownOverload - Watcher Activity: N/A. Error: System.IO.InternalBufferOverflowException: Too many changes at once in directory:D:\home\site\wwwroot. (logs are flooded with these) 2017-06-01 20:04:12,978 [RD00155DF7AEF1][D:2][Thread:42][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-01 20:04:28,306 [RD00155DF7AEF1][D:2][Thread:42][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-01 20:05:26,863 [RD00155DF7AEF1][D:3][Thread:45][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000026) 2017-06-01 20:05:36,421 [RD00155DF7AEE6][D:2][Thread:48][DEBUG] DNN.Trace - PageBase.Render Start (TabId:150,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=150&language=en-US) 2017-06-01 20:05:36,574 [RD00155DF7AEF1][D:3][Thread:41][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-01 20:05:43,759 [RD00155DF7AEE6][D:2][Thread:48][DEBUG] DNN.Trace - PageBase.Render End (TabId:150,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=150&language=en-US) 2017-06-01 20:05:53,916 [RD00155DF7AEE6][D:3][Thread:11][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000029) 2017-06-01 20:05:57,712 [RD00155DF7AEE6][D:2][Thread:51][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeShutdownOverload - Watcher Activity: N/A. Error: System.IO.InternalBufferOverflowException: Too many changes at once in directory:D:\home\site\wwwroot. 2017-06-01 20:05:57,806 [RD00155DF7AEE6][D:3][Thread:45][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-01 20:06:03,385 [RD00155DF7AEE6][D:3][Thread:45][INFO] DotNetNuke.Common.Initialize - Application Initialized (at this point node [RD00155DF7AEE6] stops serving up requests and never comes back for the rest of the test) Test 6 start up time 4:08, no restarts 2017-06-02 15:16:43,434 [RD00155DF7AEE6][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000046) 2017-06-02 15:16:42,607 [RD00155DF7AEF1][D:2][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000041) 2017-06-02 15:16:47,315 [RD00155DF7AEF1][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-02 15:16:55,032 [RD00155DF7AEE6][D:2][Thread:9][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-02 15:16:54,382 [RD00155DF7AEF1][D:2][Thread:6][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-02 15:19:19,349 [RD00155DF7AEE6][D:2][Thread:47][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-02 15:19:27,404 [RD00155DF7AEF1][D:2][Thread:57][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-02 15:20:51,702 [RD00155DF7AEE6][D:2][Thread:47][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-02 15:21:24,435 [RD00155DF7AEF1][D:2][Thread:57][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) Test 7 Application started up 8 times but in the 45 minute test, site never came online, no pages rendered. Test 8 Application started up 10 times but in the 45 minute test, site never came online, no pages rendered. Test 9 start up time 2:24, 1 restart 2017-06-05 21:02:30,589 [RD00155DF7AD26][D:3][Thread:1][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000042) 2017-06-05 21:02:30,576 [RD00155DF7C208][D:3][Thread:10][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000054) 2017-06-05 21:02:32,340 [RD00155DF7C208][D:4][Thread:12][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000040) 2017-06-05 21:02:32,730 [RD00155DF7AD26][D:4][Thread:15][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000040) 2017-06-05 21:02:36,199 [RD00155DF7C208][D:3][Thread:22][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-05 21:02:37,105 [RD00155DF7AD26][D:3][Thread:23][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-05 21:02:40,538 [RD00155DF7AD26][D:4][Thread:28][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-05 21:02:42,880 [RD00155DF7C208][D:3][Thread:22][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-05 21:02:46,731 [RD00155DF7C208][D:4][Thread:29][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-05 21:04:34,622 [RD00155DF7C208][D:4][Thread:29][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:34,622 [RD00155DF7C208][D:3][Thread:22][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=2) 2017-06-05 21:04:34,622 [RD00155DF7C208][D:3][Thread:27][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:40,750 [RD00155DF7C208][D:4][Thread:29][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:43,136 [RD00155DF7AD26][D:4][Thread:28][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:43,136 [RD00155DF7AD26][D:3][Thread:26][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:43,136 [RD00155DF7AD26][D:3][Thread:23][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=2) 2017-06-05 21:04:43,015 [RD00155DF7C208][D:3][Thread:22][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=2) 2017-06-05 21:04:43,015 [RD00155DF7C208][D:3][Thread:27][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:46,340 [RD00155DF7C208][D:4][Thread:46][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=819&language=en-US) 2017-06-05 21:04:46,949 [RD00155DF7C208][D:4][Thread:35][DEBUG] DNN.Trace - PageBase.Render Start (TabId:819,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=819&language=en-US) 2017-06-05 21:04:50,026 [RD00155DF7AD26][D:4][Thread:28][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:52,782 [RD00155DF7AD26][D:3][Thread:26][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=1) 2017-06-05 21:04:52,782 [RD00155DF7AD26][D:3][Thread:23][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://dnnbeta.azurewebsites.net/Default.aspx?warmup=2) 2017-06-05 21:04:53,360 [RD00155DF7AD26][D:3][Thread:31][INFO] DotNetNuke.Common.Initialize - Application shutting down. Reason: The AppDomain shut down because of a change to the application level configuration. 2017-06-05 21:04:54,013 [RD00155DF7C208][D:4][Thread:35][DEBUG] DNN.Trace - PageBase.Render End (TabId:819,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=819&language=en-US) Test 10 start up time 4:33, no restarts (strange 20min throughput drop detected in load storm test) 2017-06-06 13:43:36,156 [RD00155DF7C208][D:3][Thread:16][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000032) 2017-06-06 13:43:40,925 [RD00155DF7C208][D:3][Thread:10][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-06 13:43:47,132 [RD00155DF7C208][D:3][Thread:10][INFO] DotNetNuke.Common.Initialize - Application Initialized 2017-06-06 13:43:48,296 [RD00155DF7AD26][D:3][Thread:16][INFO] DotNetNuke.Web.Common.Internal.DotNetNukeHttpApplication - Application Starting (00:00:00.0000041) 2017-06-06 13:43:52,468 [RD00155DF7AD26][D:3][Thread:14][INFO] DotNetNuke.Common.Initialize - Application Initializing 2017-06-06 13:46:14,593 [RD00155DF7C208][D:3][Thread:53][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-06 13:46:14,870 [RD00155DF7AD26][D:3][Thread:50][DEBUG] DNN.Trace - PageBase.Render Start (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-06 13:47:35,245 [RD00155DF7AD26][D:3][Thread:50][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US) 2017-06-06 13:48:09,758 [RD00155DF7C208][D:3][Thread:53][DEBUG] DNN.Trace - PageBase.Render End (TabId:496,http://azurebeta.dnnsoftware.com/Default.aspx?TabId=496&language=en-US)