timout errors uploading and downloading w/ remote cable/dsl

If you are having a problem using Vault, post a message here.

Moderator: SourceGear

Post Reply
jgrenadier
Posts: 12
Joined: Sat Apr 22, 2006 2:46 pm

timout errors uploading and downloading w/ remote cable/dsl

Post by jgrenadier » Mon Apr 24, 2006 8:44 am

Hi,

While vault works very well on all PCs in my local network,
my remote users (who access vault via cable modem and dsl)
have trouble with large file upload and downloads.

Small files work well. But if the remote user has a large
(say 50Megabyte) installkit or test dataset to upload or
download, they almost always get a timeout error.

The problem seems to have gotten much much worse
around the time when we upgraded to vault version 3.1.7
so we could use Visual Studio 2005.

Vault is running on a Windows Server 2003 system
with 1Gb of memory. I've tried adjusting most parameters
in the Vault Admin tool with no improvement. My general
idea is there might be a problem with the default application
thread pool. I am attaching screen dumps of these settings
for the thread pool. Please let me know if you see any
setting that could be a problem or any other ideas that
you all might have...

Here is a typical error message on the vault client..

-----start of vault client error msgs for download --------

4/24/2006 9:01:48 AM] Version Check: This Vault client is version 3.1.7.3719
[4/24/2006 9:01:49 AM] Version Check: Your Vault server is version 3.1.7.3719

[4/24/2006 9:01:59 AM] Getting latest version of $/InstallKits/Loggia/2006_04_10_1a

[4/24/2006 9:07:42 AM] An error occurred reading from the download stream ("The operation has timed-out."), retrying...

[4/24/2006 9:07:44 AM] Finished get latest of $/InstallKits/Loggia/2006_04_10_1a

[4/24/2006 9:07:44 AM] An exception was encountered during the get latest operation. Exception: 2100 : FailExistingDownload

----- end of vault client error messages for download

------ start of vault client error messages for upload


[4/24/2006 7:34:41 AM] Version Check: The most recent Vault release is version 3.1.8.3771

[4/24/2006 7:35:51 AM] Preparing data to begin transaction

[4/24/2006 7:35:51 AM] Beginning transaction

[4/24/2006 7:35:52 AM] Add $/InstallKits/Loggia/2006_04_20_1a/Loggia.msi

[4/24/2006 7:46:03 AM] Upload for item $/InstallKits/Loggia/2006_04_20_1a/Loggia.msi failed, retrying...

[4/24/2006 7:56:14 AM] Upload for item $/InstallKits/Loggia/2006_04_20_1a/Loggia.msi failed, retrying...

[4/24/2006 8:06:25 AM] Upload for item $/InstallKits/Loggia/2006_04_20_1a/Loggia.msi failed, retrying...

[4/24/2006 8:06:25 AM] Ending the transaction

[4/24/2006 8:06:25 AM] Upload for item $/InstallKits/Loggia/2006_04_20_1a/Loggia.msi failed too many times, aborting transaction.

Please verify your network settings using the Options dialog under the Tools menu in the Vault GUI Client.

The specific error was "The operation has timed-out."

An exception was encountered during the transaction. Exception: The operation has timed-out. at System.Net.HttpWebRequest.GetResponse()

at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)

at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)

[4/24/2006 8:06:26 AM] Transaction failed

[4/24/2006 8:06:29 AM] Transaction failed


--------- end of vault client error messages for upload

---------------------- start of vault server log ----------------------

# SourceGear Vault Server
----4/24/2006 7:19:30 AM sgvaultsystem--()--
System Started
Version 3.1.7.3719
Cache Level = 1
DataBase Buffer Size (KB) = 768
LogFile Path = C:\WINDOWS\Temp\sgvault
Log Level = Debug
Archive Log = Daily
ReverseDNS Lookup = False
Maximum HTTP Request Length = 204800
Overwrite Log on Startup = False
Session Timeout = 4320
Active Directory Domain =
SGVault Working Directory = C:\WINDOWS\Temp
SGVault Server URL =
Identity = NT AUTHORITY\NETWORK SERVICE
----4/24/2006 7:19:30 AM --()-- Beginning SQL transaction 280
----4/24/2006 7:19:30 AM --()-- SQL transaction 280 successfully committed.
----4/24/2006 7:19:30 AM --()-- Beginning SQL transaction 281
----4/24/2006 7:19:30 AM --()-- SQL transaction 281 successfully committed.
----4/24/2006 7:19:34 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled Beginning SQL transaction 503
----4/24/2006 7:19:34 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled SQL transaction 503 successfully committed.
----4/24/2006 7:19:34 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled Login
----4/24/2006 7:19:34 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled GetUserOptions returned: Success
----4/24/2006 7:19:36 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled GetRepositories returned: Success
----4/24/2006 7:34:24 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Beginning SQL transaction 151
----4/24/2006 7:34:24 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled SQL transaction 151 successfully committed.
----4/24/2006 7:34:24 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Login
----4/24/2006 7:34:24 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetUserList returned: Success
----4/24/2006 7:34:24 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetUserOptions returned: Success
----4/24/2006 7:34:28 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositories returned: Success
----4/24/2006 7:34:31 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 7:34:31 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: Filling empty cache with current tree.
----4/24/2006 7:34:32 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:5 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 7:34:32 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 7:34:39 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting list of checkout changes.
----4/24/2006 7:34:39 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:34:39 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetCheckoutListChanges() Status:0 UserID:5 RepID:2 FolderSecurity:False BaseList:0 Target List:2230 RefreshFlag:True
----4/24/2006 7:34:39 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 7:34:41 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetUserEmailOptions returned Success
----4/24/2006 7:34:46 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:34:46 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled ListWatchers returned Success
----4/24/2006 7:34:47 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled ListCloakedObjects returned: Success
----4/24/2006 7:34:48 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryOptions returned: Success
----4/24/2006 7:34:50 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositories returned: Success
----4/24/2006 7:35:37 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled BeginTx beginning transaction
----4/24/2006 7:35:37 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:35:37 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled (16f49e06-6cbc-41d3-aed9-81110e814f56) BeginTx returned: Success
----4/24/2006 7:35:37 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled (16f49e06-6cbc-41d3-aed9-81110e814f56) AddFile: $/InstallKits/Loggia/2006_04_20_1a/Loggia.msi returned: Success
----4/24/2006 7:35:57 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Receiving an uploaded file.
----4/24/2006 7:37:56 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Beginning SQL transaction 476
----4/24/2006 7:37:56 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled SQL transaction 476 successfully committed.
----4/24/2006 7:37:56 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Login
----4/24/2006 7:38:02 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:38:16 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:38:54 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:39:23 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:39:47 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:39:50 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:40:09 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 7:41:14 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled Logout
----4/24/2006 7:41:14 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled Beginning SQL transaction 514
----4/24/2006 7:41:14 AM admin--127.0.0.1(127.0.0.1)--SSL Disabled SQL transaction 514 successfully committed.
----4/24/2006 7:46:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Receiving an uploaded file.
----4/24/2006 7:56:16 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Receiving an uploaded file.
----4/24/2006 8:02:05 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Beginning SQL transaction 511
----4/24/2006 8:02:05 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled SQL transaction 511 successfully committed.
----4/24/2006 8:02:05 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Login
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:33 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:02:59 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:03:04 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:03:08 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:03:17 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:06:11 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Ending transaction
----4/24/2006 8:06:11 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled (16f49e06-6cbc-41d3-aed9-81110e814f56) EndTx (Revision - 0) returned: Success
----4/24/2006 8:06:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 8:06:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:06:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:5 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 8:06:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 8:06:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting list of checkout changes.
----4/24/2006 8:06:14 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 8:06:20 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 8:06:20 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:06:20 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:5 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 8:06:20 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 8:06:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting list of checkout changes.
----4/24/2006 8:06:21 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 8:14:26 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 8:14:26 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 8:14:26 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:5 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 8:14:26 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 8:14:26 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting list of checkout changes.
----4/24/2006 8:14:26 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 8:16:07 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Logout
----4/24/2006 8:16:07 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Beginning SQL transaction 319
----4/24/2006 8:16:07 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled SQL transaction 319 successfully committed.
----4/24/2006 9:01:52 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Beginning SQL transaction 298
----4/24/2006 9:01:52 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled SQL transaction 298 successfully committed.
----4/24/2006 9:01:52 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Login
----4/24/2006 9:01:52 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetUserOptions returned: Success
----4/24/2006 9:01:52 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetUserList returned: Success
----4/24/2006 9:01:53 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetRepositories returned: Success
----4/24/2006 9:01:55 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 9:01:55 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:01:55 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:2 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 9:01:55 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 9:01:55 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Getting list of checkout changes.
----4/24/2006 9:01:55 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 9:01:56 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetUserEmailOptions returned Success
----4/24/2006 9:01:56 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:01:56 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled ListWatchers returned Success
----4/24/2006 9:01:56 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled ListCloakedObjects returned: Success
----4/24/2006 9:01:56 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetRepositoryOptions returned: Success
----4/24/2006 9:01:56 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetRepositories returned: Success
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:2 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Getting list of checkout changes.
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Beginning file download
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled VaultLib.VaultRequestGetFile returned: SuccessRequireFileDownload
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled BeginDownloadFiles returned: Success
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled VaultFileDownload starting
----4/24/2006 9:02:03 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Downloading delta for $/InstallKits/Loggia/2006_04_10_1a/Loggia.msi from 0 to 38908
----4/24/2006 9:03:17 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled GetLatest wrote 29815132 bytes to the Response Stream
----4/24/2006 9:07:48 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Beginning file download
----4/24/2006 9:07:48 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled FailExistingDownload
----4/24/2006 9:10:55 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Beginning SQL transaction 679
----4/24/2006 9:10:55 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled SQL transaction 679 successfully committed.
----4/24/2006 9:10:55 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Login
----4/24/2006 9:10:55 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetUserList returned: Success
----4/24/2006 9:10:55 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetUserOptions returned: Success
----4/24/2006 9:10:56 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositories returned: Success
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting repository Structure-> Rep ID: 2 Base: 5956 Target: -1
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:5 RepID:2 Base:5956 Target:5956 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryStructure returned: Success
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled Getting list of checkout changes.
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled VaultServiceAPI::GetCheckoutListChanges() Status:0 UserID:5 RepID:2 FolderSecurity:False BaseList:0 Target List:2230 RefreshFlag:True
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetCheckOutListChanges returned: Success
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetUserEmailOptions returned Success
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 5956
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled ListWatchers returned Success
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled ListCloakedObjects returned: Success
----4/24/2006 9:11:00 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositoryOptions returned: Success
----4/24/2006 9:11:01 AM usert--66.93.216.xxx(66.93.216.xxx)--SSL Disabled GetRepositories returned: Success
----4/24/2006 9:11:15 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Logout
----4/24/2006 9:11:15 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled Beginning SQL transaction 11
----4/24/2006 9:11:15 AM usersu--66.69.138.yyy(66.69.138.yyy)--SSL Disabled SQL transaction 11 successfully committed.


------------------------------ end of vault server log ------------------------------

Regards,
Jim
Attachments
pool1.JPG
pool1.JPG (34.38 KiB) Viewed 4372 times
pool2.JPG
pool2.JPG (40.91 KiB) Viewed 4372 times
pool3.JPG
pool3.JPG (38.89 KiB) Viewed 4372 times
pool4.JPG
pool4.JPG (26.08 KiB) Viewed 4372 times
session.JPG
session.JPG (27.89 KiB) Viewed 4372 times

dan
Posts: 2448
Joined: Wed Dec 17, 2003 5:03 pm
Location: SourceGear
Contact:

Post by dan » Mon Apr 24, 2006 12:49 pm

If large files work fine for local users, but not for remote users, then the problem probably isn't IIS, but something between the remote users and IIS. If the problem were IIS, the local users should run into the same issues as remote users.

Do you have firewall or VPN software that has either a time limit or a data upload size limit?

jgrenadier
Posts: 12
Joined: Sat Apr 22, 2006 2:46 pm

Post by jgrenadier » Mon Apr 24, 2006 3:17 pm

I am using a Netgear WPN824 router.
I use port forwarding to allow remote access to vault.

The builtin firewall has only one option to "disable
spi firewall" which does stateful packet checking to reduce
the chance of a denial of service attack. I disabled this feature
and had my clients try again from a remote site. Same problem
occurred with downloading.

I dont see your logic as to why it could not be related to IIS.
If there is a timeout problem in IIS, the local fast access wouldnt
hit the problem and the remote users would hit the problem.

Anyway: Please let me know what other things to try.
I am at a loss as to how to proceed at this point.

dan
Posts: 2448
Joined: Wed Dec 17, 2003 5:03 pm
Location: SourceGear
Contact:

Post by dan » Mon Apr 24, 2006 3:47 pm

jgrenadier wrote: I dont see your logic as to why it could not be related to IIS.
If there is a timeout problem in IIS, the local fast access wouldnt
hit the problem and the remote users would hit the problem.
Yes, that's true.

Here are some more stabs in the dark on the IIS side: :)

1. Check the system event viewer, which I think IIS writes to if it stops a process due to timeouts.
2. Try creating a separate app pool for Vault, in case there is something wrong with the default app pool.
3. Set IIS into IIS 5.0 Isolation mode, which is less aggressive about timing out sessions.
4. Take a look at the web.config file in the VaultService folder for any timeout settings, and change them to be at least an hour (especially httpRuntime). Make sure you do an iisreset from a command prompt to make sure the change takes effect.

Also, is there a proxy involved on the remote clients? They may also have timeouts.

jgrenadier
Posts: 12
Joined: Sat Apr 22, 2006 2:46 pm

Post by jgrenadier » Tue Apr 25, 2006 9:37 am

Thanks for the tips. The problems not solved yet
but we may be closer.

1. I checked the event viewer and so no relevant messages.
I also checked the IIS activity log file and it wasnt helpful.

2. I created a new App pool specifically for vault.
I set the parameter settings to be the same as the old
default pool but..
a. set worker process limit for shutdown up to 120 minutes
b. disabled any request queue limit
3. I bumped up the session state timout to 40 minutes
4. I bumped up the ASP script timout to 180 seconds

The result was that the downloads still timed out but seemed to
get farther before stalling. Also, strangely enough, the vault server
log didnt show any errors on the timeout. The timeout errors were
now only on the client.

These results may just be because of network conditions this morning
but there may have been improvement.

Is there any hint in that the vault error log doesnt show errors but
there are timeouts and retries in the vault client log? Is there any
way to control the number of retries that are attempted?
What else should I try?

jeremy_sg
Posts: 1821
Joined: Thu Dec 18, 2003 11:39 am
Location: Sourcegear
Contact:

Post by jeremy_sg » Tue Apr 25, 2006 10:31 am

Thanks for all of the logs and screen shots.

It appears as though the installer wasn't run on this server. There are lots of IIS settings that get set during the install for the Vault App Pool. Since you will need to do this manually, try this:

1. Uncheck the "Shutdown worker process after being idle" checkbox.
2. Uncheck the "Recycle worker process" checkbox.
3. In the Properties dialog of the web site (probably Default Web Site), increase the number for the Connection timeout. Our installer sets it to 1800 seconds.

jgrenadier
Posts: 12
Joined: Sat Apr 22, 2006 2:46 pm

Post by jgrenadier » Tue May 02, 2006 3:11 pm

I made the changes you suggested without much improvement
for my users. However, I was also working in parallel to improve
their connectivity. I replaced a router and had my cable company
replace their cable modem. That solved the problem for one of
my remote users. The second user finally had success by
enabling chunked encoding.

So, I think I am ok for now. Thanks for the help.

I have the following suggestions...
I can see that other customer have similar problems as in
http://support.sourcegear.com/viewtopic ... 4217#24217

so, I think if a customer has less than a perfect connection,
they will have problem using vault effectively for remote users.

Therefore, I suggest you..
a. provide better feedback showing in detail the progress of
lengthy uploads and downloads including any recoverable errors.
b. Provide a way to immediatly cancel uploads and download.
My experience is that users get impatient and kill the entire vault
client,
c. While I dont know how you are implementing the file transfer,
my experience with using the builtin file transfer capability
of IIS (as in the vault web interface) is not reliable for large
files. I have implemented similar applications for online
photolabs using FTP controls at the client. Many other approaches
would be equally reasonable but the
technique used in the vault web interface
probably isnt. In any case, whatever upperlimit
you set for file transfers
in IIS, there will be somebody with a bigger file.
d. Add an option that automatically zips a directory of files
and then uploads them and saves them in vault as a single file.
The zip features of vault are great and this would leverage
these features further. A common workflow is that people
are uploading large files just so they can archive sets of data.
e. Allow the user to control the number of file upload and download
retries.

Thanks again,
Jim

jeremy_sg
Posts: 1821
Joined: Thu Dec 18, 2003 11:39 am
Location: Sourcegear
Contact:

Post by jeremy_sg » Tue May 02, 2006 3:55 pm

jgrenadier,

I'm glad that your network troubles were straightened out. There are lots of different problems that can cause upload failures. The post you linked to was a server error, and unrelated to the network connection.

Responding to your comments,

a. We do have a progress bar at the bottom right of the client that gives upload progress. Whenever an upload is retried, a warning message should be logged to the client's messages window.
b. I agree, our cancel mechanism is not nearly responsive enough.
c. I understand what you're saying with regards to the upper limit for uploading files. We've tried to ease this trouble. We provide a way of increasing this limit in the Vault Admin tool. We feel that the support burden of running into the occasional upload too large problem is better than the additional support load of installing upload mechanisms outside of web services.
d. Vault uses our own compression algorithm, which doesn't handle encapsulating multiple files into one compressed file.
e. That is a good point. I've logged a feature request for it.

Post Reply