Slow Login - Performance Tuning

[DanielN]

Hi Guys,

I've just installed vault in our infrastructure for our development team.

In testing, we have found the Admin tool takes approx 45 - 60 seconds to log in (ie, the time after entering the username / password until you are able to make changes). This was done locally (using localhost)

We also Tested a client both locally, and on a client pc over the network. It appears a delay there also.

Although, after you log in on the client, within 5 seconds, there is a "Connected" in the right hand side of the status bar, however, there is still a "connecting to server" on the left hand side. And it takes approx 45-60 seconds for the list of "repositories" to show.

We have enabled active directory based authentication, and change the user instance to allow this to function (works fine).

Turning the logging level up revealed this in the logs, indicating where our delay is..

--------8<--------

----29/05/2006 1:47:27 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled Beginning SQL transaction 410
----29/05/2006 1:47:28 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled SQL transaction 410 successfully committed.
----29/05/2006 1:47:28 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled Login
----29/05/2006 1:47:28 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetUserOptions returned: Success
----29/05/2006 1:47:28 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetUserList returned: Success
----29/05/2006 1:48:11 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetRepositories returned: Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled Getting repository Structure-> Rep ID: 3 Base: 9 Target: -1
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled TreeManager: Filling empty cache with current tree.
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:3 RepID:3 Base:9 Target:9 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetRepositoryStructure returned: Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled Getting list of checkout changes.
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetCheckOutListChanges returned: Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetUserEmailOptions returned Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 9
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled ListWatchers returned Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled ListCloakedObjects returned: Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetRepositoryOptions returned: Success
----29/05/2006 1:48:13 PM wkerr--127.0.0.1(127.0.0.1)--SSL Disabled GetRepositories returned: Success

--------8<--------

You can see the timestamp there is a delay of approx 45 seconds at the "Get Repositories returned:success" line

Log in locally into the admin tool showed similar results

----29/05/2006 1:49:58 PM admin--127.0.0.1(127.0.0.1)--SSL Disabled Login
----29/05/2006 1:49:58 PM admin--127.0.0.1(127.0.0.1)--SSL Disabled GetUserOptions returned: Success
----29/05/2006 1:50:40 PM admin--127.0.0.1(127.0.0.1)--SSL Disabled GetRepositories returned: Success
----29/05/2006 1:50:59 PM admin--127.0.0.1(127.0.0.1)--SSL Disabled Logout

I believe it may be a IIS6 performance tuning issue? although i have changed various timeouts as recommended by various other forum posts.

A little background on our setup.
We have established a number of "Virtual Servers" running VMware's ESX/GSX platforms. This allows us rapid application server deployment, with fail-over to other Virtual Server's we have.

The Sql Database is located on a different server(real), and the load is minimal, less than 5%

The Vault server is running in a VMware Virtual machine, Running windows2003sp1. Vault is version 3.1.8.

The Vault Virtual machine is running on our latest Virtual Server, and currently is the only Virtual Machine instance. (Server specs Dual Xeon, 8gb ram, 500gb Raid5 scsi and More SAN Attached storage). So at this stage, we dont believe the virtual machine is the cause of the slow down.

Thanks,

Daniel..

btw Linda / Dan, I have a Gold support license, however once this Vault server goes into production, our developers will be supporting this product. I didnt want to associate the license to my username, but rather allow them to associate it to theirs, Unless you allow for multiple usernames to have the same Gold Support license.

[DanielN]

Server Information
Vault Server Version: 3.1.8.3771
.Net Framework Version: 1.1.4322.2300
Operating System: Microsoft(R) Windows(R) Server 2003, Standard Edition
Service Pack: 1.0
OS Version: 5.2.3790
Timezone: (GMT+10:00) Canberra, Melbourne, Sydney
SQL Version: Microsoft SQL Server 2000 - 8.00.2039 (Intel X86)
May 3 2005 23:18:38
Copyright (c) 1988-2003 Microsoft Corporation
Standard Edition on Windows NT 5.2 (Build 3790: )

License Information
2 serial number(s):
1 of 2: 10 users, permanent
2 of 2: 10 users, permanent


Vault and IIS Services installed on Virtual Machine(Running Server2k3).
Currently its the only virtual machine installed on this new virtual server. Dual Xeon 3.2ghz, 8gb ram.

Sql installed on real machine, Dual Xeon 3.2ghz, 3gb Ram. Avg Load 2%.. Mainly idle however.

[kasti]

This is most likely the version check:

switch off (for each user) tools->options->general->check for latest vault version at startup

Then vault will not contact sourcegear for latest version.

Cheers,
Herbert.

[DanielN]

This is most likely the version check:

switch off (for each user) tools->options->general->check for latest vault version at startup

Then vault will not contact sourcegear for latest version.

Cheers,
Herbert.

Amazing, the Client now takes 2 seconds to login :>

However, the admin tool does not have such option..

Althought we can put up with the admin tool taking approx 60 seconds to log in. I'm assuming the Admintool is doing the same thing considering the approximate delay is the same (even at the same instance in the log file).

Thanks,

Daniel.

[dan]

This option should be respected in the Admin Tool as well. Note however that options are per-user. You may have logged in as a different user in the Admin Tool, and therefore would need to login as that user in the GUI client to change the setting.

[DanielN]

Thanks Dan,

Thats correct, the client's setting did effect the Admin tools setting. 2 users also have the admin tool installed on their pc, and noticed the instant transformation in speed.

However, logged in on the server's console as Administrator, this didn't happen.

But i assume this is because when using the client, i used the username wkerr, and when i used the admin tool, i used "admin".

Never the less, Our problem is now resolved. Thanks to you guys for your help.

Daniel.