The site database was upgraded in February to a quad processor 64 bit server running the lastest version of the database software (Microsoft SQL Server 2005) to improve it's performance. Unfortunately the upgrade to the new Microsoft SQL Server 2005 has caused the site to timeout it two ways:
1) 5/5/2006:RESOLVED with SQL SERver 2005 SP1
The new database is not correctly optimized due to a bug in SQL Server 2005's optimization wizard that causes it to crash on certain "database views". This causes general sporadic timeouts and slowness in the database. Microsoft has confirmed this as a bug and we are working with them to get a patch issued to us as quickly as possible. (3/16: Microsoft has created a fix, but testing it will take 3 weeks to make sure it doesnt break something else. We are anxiously awaiting this fix and will update you when it comes in).
2) 5/5/2006RESOLVED: Moving the backup to a seperate drive fixed this problem.
During the database backup between roughly 8:15 PM till a little after 9PM. This should not be happening as the database should allow a backup to occur with stopping access. A warning message has been added to the site during this time period and a 2nd ticket has been opened with Microsoft to resolve this bug. (3/16: We have updated the server with 15k SCSI drives (the fastest type for servers) to lessen the backup window. Microsoft has promised to see if they have any information on how a 24/7 site is supposed to do backups and best practices/etc.. We will update you when we know more. 4/5: No new info from Microsoft on ways to improve this yet...still pushing this issue with them. Also discovered memory issues with backups which has been referred to them.).