[18-8-2008 13:30:37] The line above was repeated 5 more times
[18-8-2008 13:30:37] Warning: Forced memory flush: 331 -> 2
[18-8-2008 13:30:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:31:08] The line above was repeated 7 more times
[18-8-2008 13:31:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:31:39] The line above was repeated 5 more times
[18-8-2008 13:31:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:32:09] The line above was repeated 6 more times
[18-8-2008 13:32:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:32:40] The line above was repeated 6 more times
[18-8-2008 13:32:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:33:10] The line above was repeated 5 more times
[18-8-2008 13:33:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:33:41] The line above was repeated 5 more times
[18-8-2008 13:33:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:34:12] The line above was repeated 7 more times
[18-8-2008 13:34:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:34:43] The line above was repeated 6 more times
[18-8-2008 13:34:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:35:14] The line above was repeated 6 more times
[18-8-2008 13:35:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:35:44] The line above was repeated 5 more times
[18-8-2008 13:35:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:36:14] The line above was repeated 5 more times
[18-8-2008 13:36:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:36:45] The line above was repeated 7 more times
[18-8-2008 13:36:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:37:15] The line above was repeated 5 more times
[18-8-2008 13:37:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:37:46] The line above was repeated 5 more times
[18-8-2008 13:37:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:38:16] The line above was repeated 7 more times
[18-8-2008 13:38:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:38:29] The line above was repeated 2 more times
[18-8-2008 13:38:29] Warning: Found bucket #43545 with all domains present in other buckets - marking it for unload!
[18-8-2008 13:38:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:39:03] The line above was repeated 5 more times
[18-8-2008 13:39:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:39:34] The line above was repeated 7 more times
[18-8-2008 13:39:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:40:05] The line above was repeated 5 more times
[18-8-2008 13:40:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:40:37] The line above was repeated 5 more times
[18-8-2008 13:40:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:41:07] The line above was repeated 5 more times
[18-8-2008 13:41:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:41:38] The line above was repeated 5 more times
[18-8-2008 13:41:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:42:09] The line above was repeated 9 more times
[18-8-2008 13:42:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:42:40] The line above was repeated 5 more times
[18-8-2008 13:42:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:43:12] The line above was repeated 7 more times
[18-8-2008 13:43:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:43:43] The line above was repeated 5 more times
[18-8-2008 13:43:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:44:15] The line above was repeated 5 more times
[18-8-2008 13:44:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:44:45] The line above was repeated 5 more times
[18-8-2008 13:44:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:45:16] The line above was repeated 7 more times
[18-8-2008 13:45:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:45:48] The line above was repeated 5 more times
[18-8-2008 13:45:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:46:01] The line above was repeated 2 more times
[18-8-2008 13:46:01] Warning: Forced memory flush: 322 -> 4
[18-8-2008 13:46:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:46:34] The line above was repeated 7 more times
[18-8-2008 13:46:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:47:04] The line above was repeated 5 more times
[18-8-2008 13:47:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:47:35] The line above was repeated 5 more times
[18-8-2008 13:47:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:48:06] The line above was repeated 7 more times
[18-8-2008 13:48:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:48:36] The line above was repeated 5 more times
[18-8-2008 13:48:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:49:07] The line above was repeated 5 more times
[18-8-2008 13:49:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:49:37] The line above was repeated 7 more times
[18-8-2008 13:49:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:50:08] The line above was repeated 5 more times
[18-8-2008 13:50:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:50:38] The line above was repeated 5 more times
[18-8-2008 13:50:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:51:09] The line above was repeated 6 more times
[18-8-2008 13:51:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:51:39] The line above was repeated 6 more times
[18-8-2008 13:51:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:52:10] The line above was repeated 5 more times
[18-8-2008 13:52:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:52:40] The line above was repeated 5 more times
[18-8-2008 13:52:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:53:11] The line above was repeated 7 more times
[18-8-2008 13:53:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:53:42] The line above was repeated 5 more times
[18-8-2008 13:53:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:54:12] The line above was repeated 5 more times
[18-8-2008 13:54:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:54:42] The line above was repeated 5 more times
[18-8-2008 13:54:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:55:13] The line above was repeated 7 more times
[18-8-2008 13:55:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:55:44] The line above was repeated 5 more times
[18-8-2008 13:55:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:56:15] The line above was repeated 5 more times
[18-8-2008 13:56:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:56:45] The line above was repeated 6 more times
[18-8-2008 13:56:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:57:16] The line above was repeated 6 more times
[18-8-2008 13:57:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:57:46] The line above was repeated 5 more times
[18-8-2008 13:57:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:58:17] The line above was repeated 6 more times
[18-8-2008 13:58:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:58:47] The line above was repeated 6 more times
[18-8-2008 13:58:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:59:18] The line above was repeated 6 more times
[18-8-2008 13:59:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 13:59:49] The line above was repeated 6 more times
[18-8-2008 13:59:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:00:20] The line above was repeated 5 more times
[18-8-2008 14:00:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:00:50] The line above was repeated 5 more times
[18-8-2008 14:00:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:01:21] The line above was repeated 5 more times
[18-8-2008 14:01:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:01:23] Warning: Forced memory flush: 345 -> 5
[18-8-2008 14:01:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:01:57] The line above was repeated 9 more times
[18-8-2008 14:01:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:02:28] The line above was repeated 5 more times
[18-8-2008 14:02:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:02:58] The line above was repeated 7 more times
[18-8-2008 14:02:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:03:29] The line above was repeated 5 more times
[18-8-2008 14:03:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:03:59] The line above was repeated 5 more times
[18-8-2008 14:03:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:04:30] The line above was repeated 5 more times
[18-8-2008 14:04:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:05:00] The line above was repeated 5 more times
[18-8-2008 14:05:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:05:31] The line above was repeated 7 more times
[18-8-2008 14:05:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:06:01] The line above was repeated 5 more times
[18-8-2008 14:06:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:06:32] The line above was repeated 5 more times
[18-8-2008 14:06:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:07:02] The line above was repeated 7 more times
[18-8-2008 14:07:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:07:33] The line above was repeated 5 more times
[18-8-2008 14:07:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:08:04] The line above was repeated 5 more times
[18-8-2008 14:08:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:08:34] The line above was repeated 5 more times
[18-8-2008 14:08:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:09:01] The line above was repeated 7 more times
[18-8-2008 14:09:01] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 14:09:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:09:36] The line above was repeated 6 more times
[18-8-2008 14:09:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:10:08] The line above was repeated 5 more times
[18-8-2008 14:10:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:10:38] The line above was repeated 5 more times
[18-8-2008 14:10:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:11:09] The line above was repeated 5 more times
[18-8-2008 14:11:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:11:40] The line above was repeated 7 more times
[18-8-2008 14:11:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:12:11] The line above was repeated 5 more times
[18-8-2008 14:12:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:12:42] The line above was repeated 5 more times
[18-8-2008 14:12:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:13:12] The line above was repeated 5 more times
[18-8-2008 14:13:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:13:43] The line above was repeated 7 more times
[18-8-2008 14:13:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:14:13] The line above was repeated 5 more times
[18-8-2008 14:14:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:14:45] The line above was repeated 5 more times
[18-8-2008 14:14:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:15:19] The line above was repeated 6 more times
[18-8-2008 14:15:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:15:50] The line above was repeated 7 more times
[18-8-2008 14:15:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:16:21] The line above was repeated 5 more times
[18-8-2008 14:16:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:16:53] The line above was repeated 5 more times
[18-8-2008 14:16:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:17:25] The line above was repeated 5 more times
[18-8-2008 14:17:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:17:34] The line above was repeated 1 more time
[18-8-2008 14:17:34] Warning: Forced memory flush: 348 -> 6
[18-8-2008 14:17:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:18:06] The line above was repeated 7 more times
[18-8-2008 14:18:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:18:37] The line above was repeated 5 more times
[18-8-2008 14:18:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:19:08] The line above was repeated 5 more times
[18-8-2008 14:19:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:19:38] The line above was repeated 7 more times
[18-8-2008 14:19:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:20:10] The line above was repeated 5 more times
[18-8-2008 14:20:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:20:40] The line above was repeated 5 more times
[18-8-2008 14:20:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:21:11] The line above was repeated 5 more times
[18-8-2008 14:21:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:21:42] The line above was repeated 7 more times
[18-8-2008 14:21:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:22:13] The line above was repeated 5 more times
[18-8-2008 14:22:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:22:43] The line above was repeated 5 more times
[18-8-2008 14:22:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:23:14] The line above was repeated 5 more times
[18-8-2008 14:23:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:23:45] The line above was repeated 5 more times
[18-8-2008 14:23:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:24:15] The line above was repeated 7 more times
[18-8-2008 14:24:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:24:46] The line above was repeated 5 more times
[18-8-2008 14:24:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:25:16] The line above was repeated 6 more times
[18-8-2008 14:25:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:25:47] The line above was repeated 6 more times
[18-8-2008 14:25:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:26:17] The line above was repeated 5 more times
[18-8-2008 14:26:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:26:48] The line above was repeated 6 more times
[18-8-2008 14:26:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:27:20] The line above was repeated 6 more times
[18-8-2008 14:27:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:27:54] The line above was repeated 6 more times
[18-8-2008 14:27:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:28:25] The line above was repeated 7 more times
[18-8-2008 14:28:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:28:56] The line above was repeated 5 more times
[18-8-2008 14:28:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:29:27] The line above was repeated 5 more times
[18-8-2008 14:29:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:29:58] The line above was repeated 5 more times
[18-8-2008 14:29:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:30:29] The line above was repeated 7 more times
[18-8-2008 14:30:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:30:59] The line above was repeated 5 more times
[18-8-2008 14:30:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:31:29] The line above was repeated 7 more times
[18-8-2008 14:31:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:32:00] The line above was repeated 5 more times
[18-8-2008 14:32:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:32:30] The line above was repeated 5 more times
[18-8-2008 14:32:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:32:48] The line above was repeated 3 more times
[18-8-2008 14:32:48] Warning: Forced memory flush: 366 -> 4
[18-8-2008 14:32:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:33:21] The line above was repeated 7 more times
[18-8-2008 14:33:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:33:52] The line above was repeated 5 more times
[18-8-2008 14:33:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:34:23] The line above was repeated 5 more times
[18-8-2008 14:34:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:34:53] The line above was repeated 5 more times
[18-8-2008 14:34:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:35:25] The line above was repeated 7 more times
[18-8-2008 14:35:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:35:56] The line above was repeated 5 more times
[18-8-2008 14:35:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:36:27] The line above was repeated 5 more times
[18-8-2008 14:36:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:36:58] The line above was repeated 5 more times
[18-8-2008 14:36:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:37:28] The line above was repeated 7 more times
[18-8-2008 14:37:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:37:59] The line above was repeated 5 more times
[18-8-2008 14:37:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:38:30] The line above was repeated 6 more times
[18-8-2008 14:38:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:39:02] The line above was repeated 6 more times
[18-8-2008 14:39:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:39:36] The line above was repeated 6 more times
[18-8-2008 14:39:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:40:07] The line above was repeated 5 more times
[18-8-2008 14:40:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:40:38] The line above was repeated 5 more times
[18-8-2008 14:40:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:41:09] The line above was repeated 5 more times
[18-8-2008 14:41:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:41:39] The line above was repeated 6 more times
[18-8-2008 14:41:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:42:10] The line above was repeated 6 more times
[18-8-2008 14:42:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:42:41] The line above was repeated 7 more times
[18-8-2008 14:42:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:43:12] The line above was repeated 5 more times
[18-8-2008 14:43:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:43:43] The line above was repeated 5 more times
[18-8-2008 14:43:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:44:13] The line above was repeated 5 more times
[18-8-2008 14:44:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:44:44] The line above was repeated 5 more times
[18-8-2008 14:44:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:45:15] The line above was repeated 7 more times
[18-8-2008 14:45:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:45:45] The line above was repeated 5 more times
[18-8-2008 14:45:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:46:16] The line above was repeated 5 more times
[18-8-2008 14:46:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:46:46] The line above was repeated 5 more times
[18-8-2008 14:46:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:47:12] The line above was repeated 7 more times
[18-8-2008 14:47:12] Warning: Could not flush data for bucket: System.InvalidOperationException: Collection was modified; enumeration operation may not execute.
   at System.Collections.Hashtable.HashtableEnumerator.MoveNext()
   at Majestic12.WebCrawler.FlushCaches(Boolean bFinalFlush)
[18-8-2008 14:47:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:47:48] The line above was repeated 8 more times
[18-8-2008 14:47:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:48:19] The line above was repeated 5 more times
[18-8-2008 14:48:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:48:44] The line above was repeated 4 more times
[18-8-2008 14:48:44] Warning: Forced memory flush: 407 -> 5
[18-8-2008 14:48:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:49:16] The line above was repeated 7 more times
[18-8-2008 14:49:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:49:46] The line above was repeated 5 more times
[18-8-2008 14:49:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:50:17] The line above was repeated 5 more times
[18-8-2008 14:50:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:50:48] The line above was repeated 7 more times
[18-8-2008 14:50:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:51:18] The line above was repeated 5 more times
[18-8-2008 14:51:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:51:49] The line above was repeated 5 more times
[18-8-2008 14:51:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:52:20] The line above was repeated 5 more times
[18-8-2008 14:52:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:52:50] The line above was repeated 5 more times
[18-8-2008 14:52:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:53:21] The line above was repeated 7 more times
[18-8-2008 14:53:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:53:51] The line above was repeated 5 more times
[18-8-2008 14:53:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:54:22] The line above was repeated 5 more times
[18-8-2008 14:54:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:54:52] The line above was repeated 7 more times
[18-8-2008 14:54:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:55:23] The line above was repeated 5 more times
[18-8-2008 14:55:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:55:53] The line above was repeated 5 more times
[18-8-2008 14:55:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:56:25] The line above was repeated 7 more times
[18-8-2008 14:56:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:56:56] The line above was repeated 5 more times
[18-8-2008 14:56:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:57:27] The line above was repeated 5 more times
[18-8-2008 14:57:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:57:57] The line above was repeated 5 more times
[18-8-2008 14:57:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:58:28] The line above was repeated 5 more times
[18-8-2008 14:58:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:58:58] The line above was repeated 7 more times
[18-8-2008 14:58:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 14:59:29] The line above was repeated 5 more times
[18-8-2008 14:59:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:00:01] The line above was repeated 5 more times
[18-8-2008 15:00:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:00:31] The line above was repeated 5 more times
[18-8-2008 15:00:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:01:02] The line above was repeated 5 more times
[18-8-2008 15:01:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:01:34] The line above was repeated 5 more times
[18-8-2008 15:01:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:02:04] The line above was repeated 7 more times
[18-8-2008 15:02:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:02:35] The line above was repeated 5 more times
[18-8-2008 15:02:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:03:05] The line above was repeated 5 more times
[18-8-2008 15:03:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:03:35] The line above was repeated 5 more times
[18-8-2008 15:03:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:04:06] The line above was repeated 5 more times
[18-8-2008 15:04:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:04:17] The line above was repeated 2 more times
[18-8-2008 15:04:17] Warning: Forced memory flush: 386 -> 5
[18-8-2008 15:04:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:04:52] The line above was repeated 7 more times
[18-8-2008 15:04:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:05:22] The line above was repeated 5 more times
[18-8-2008 15:05:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:05:55] The line above was repeated 5 more times
[18-8-2008 15:05:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:06:25] The line above was repeated 5 more times
[18-8-2008 15:06:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:06:56] The line above was repeated 5 more times
[18-8-2008 15:06:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:07:27] The line above was repeated 7 more times
[18-8-2008 15:07:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:07:58] The line above was repeated 5 more times
[18-8-2008 15:07:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:08:29] The line above was repeated 5 more times
[18-8-2008 15:08:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:08:29] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 15:08:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:09:05] The line above was repeated 6 more times
[18-8-2008 15:09:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:09:35] The line above was repeated 7 more times
[18-8-2008 15:09:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:10:06] The line above was repeated 5 more times
[18-8-2008 15:10:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:10:36] The line above was repeated 5 more times
[18-8-2008 15:10:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:11:07] The line above was repeated 5 more times
[18-8-2008 15:11:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:11:38] The line above was repeated 5 more times
[18-8-2008 15:11:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:12:10] The line above was repeated 7 more times
[18-8-2008 15:12:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:12:40] The line above was repeated 5 more times
[18-8-2008 15:12:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:13:13] The line above was repeated 5 more times
[18-8-2008 15:13:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:13:44] The line above was repeated 7 more times
[18-8-2008 15:13:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:14:14] The line above was repeated 5 more times
[18-8-2008 15:14:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:14:45] The line above was repeated 5 more times
[18-8-2008 15:14:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:15:16] The line above was repeated 5 more times
[18-8-2008 15:15:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:15:48] The line above was repeated 7 more times
[18-8-2008 15:15:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:16:18] The line above was repeated 5 more times
[18-8-2008 15:16:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:16:48] The line above was repeated 5 more times
[18-8-2008 15:16:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:17:19] The line above was repeated 7 more times
[18-8-2008 15:17:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:17:50] The line above was repeated 5 more times
[18-8-2008 15:17:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:18:21] The line above was repeated 7 more times
[18-8-2008 15:18:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:18:52] The line above was repeated 5 more times
[18-8-2008 15:18:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:19:18] The line above was repeated 5 more times
[18-8-2008 15:19:18] Warning: Forced memory flush: 391 -> 4
[18-8-2008 15:19:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:19:53] The line above was repeated 7 more times
[18-8-2008 15:19:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:20:23] The line above was repeated 5 more times
[18-8-2008 15:20:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:20:54] The line above was repeated 7 more times
[18-8-2008 15:20:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:21:24] The line above was repeated 5 more times
[18-8-2008 15:21:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:21:55] The line above was repeated 5 more times
[18-8-2008 15:21:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:22:26] The line above was repeated 7 more times
[18-8-2008 15:22:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:22:56] The line above was repeated 5 more times
[18-8-2008 15:22:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:23:27] The line above was repeated 5 more times
[18-8-2008 15:23:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:23:58] The line above was repeated 7 more times
[18-8-2008 15:23:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:24:29] The line above was repeated 5 more times
[18-8-2008 15:24:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:25:01] The line above was repeated 5 more times
[18-8-2008 15:25:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:25:31] The line above was repeated 7 more times
[18-8-2008 15:25:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:26:02] The line above was repeated 5 more times
[18-8-2008 15:26:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:26:33] The line above was repeated 5 more times
[18-8-2008 15:26:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:27:03] The line above was repeated 5 more times
[18-8-2008 15:27:03] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:27:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:27:35] The line above was repeated 6 more times
[18-8-2008 15:27:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:28:06] The line above was repeated 5 more times
[18-8-2008 15:28:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:28:37] The line above was repeated 5 more times
[18-8-2008 15:28:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:29:08] The line above was repeated 7 more times
[18-8-2008 15:29:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:29:38] The line above was repeated 5 more times
[18-8-2008 15:29:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:30:09] The line above was repeated 5 more times
[18-8-2008 15:30:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:30:39] The line above was repeated 7 more times
[18-8-2008 15:30:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:31:10] The line above was repeated 5 more times
[18-8-2008 15:31:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:31:40] The line above was repeated 5 more times
[18-8-2008 15:31:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:32:11] The line above was repeated 5 more times
[18-8-2008 15:32:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:32:41] The line above was repeated 9 more times
[18-8-2008 15:32:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:33:12] The line above was repeated 5 more times
[18-8-2008 15:33:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:33:43] The line above was repeated 5 more times
[18-8-2008 15:33:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:34:14] The line above was repeated 5 more times
[18-8-2008 15:34:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:34:22] The line above was repeated 1 more time
[18-8-2008 15:34:22] Warning: Forced memory flush: 461 -> 32
[18-8-2008 15:34:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:34:57] The line above was repeated 7 more times
[18-8-2008 15:34:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:35:27] The line above was repeated 5 more times
[18-8-2008 15:35:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:35:58] The line above was repeated 5 more times
[18-8-2008 15:35:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:36:29] The line above was repeated 7 more times
[18-8-2008 15:36:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:37:00] The line above was repeated 5 more times
[18-8-2008 15:37:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:37:31] The line above was repeated 5 more times
[18-8-2008 15:37:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:38:01] The line above was repeated 5 more times
[18-8-2008 15:38:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:38:34] The line above was repeated 7 more times
[18-8-2008 15:38:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:39:05] The line above was repeated 5 more times
[18-8-2008 15:39:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:39:36] The line above was repeated 5 more times
[18-8-2008 15:39:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:40:06] The line above was repeated 5 more times
[18-8-2008 15:40:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:40:37] The line above was repeated 7 more times
[18-8-2008 15:40:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:41:08] The line above was repeated 5 more times
[18-8-2008 15:41:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:41:38] The line above was repeated 5 more times
[18-8-2008 15:41:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:42:09] The line above was repeated 7 more times
[18-8-2008 15:42:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:42:31] The line above was repeated 4 more times
[18-8-2008 15:42:31] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 15:42:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:43:06] The line above was repeated 6 more times
[18-8-2008 15:43:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:43:41] The line above was repeated 6 more times
[18-8-2008 15:43:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:44:04] The line above was repeated 4 more times
[18-8-2008 15:44:04] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:44:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:44:39] The line above was repeated 6 more times
[18-8-2008 15:44:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:45:10] The line above was repeated 5 more times
[18-8-2008 15:45:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:45:41] The line above was repeated 5 more times
[18-8-2008 15:45:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:46:12] The line above was repeated 5 more times
[18-8-2008 15:46:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:46:43] The line above was repeated 7 more times
[18-8-2008 15:46:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:47:13] The line above was repeated 5 more times
[18-8-2008 15:47:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:47:44] The line above was repeated 5 more times
[18-8-2008 15:47:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:48:15] The line above was repeated 5 more times
[18-8-2008 15:48:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:48:46] The line above was repeated 7 more times
[18-8-2008 15:48:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:49:16] The line above was repeated 5 more times
[18-8-2008 15:49:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:49:49] The line above was repeated 5 more times
[18-8-2008 15:49:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:50:10] The line above was repeated 4 more times
[18-8-2008 15:50:10] Warning: Forced memory flush: 454 -> 5
[18-8-2008 15:50:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:50:45] The line above was repeated 7 more times
[18-8-2008 15:50:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:51:16] The line above was repeated 5 more times
[18-8-2008 15:51:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:51:46] The line above was repeated 7 more times
[18-8-2008 15:51:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:52:17] The line above was repeated 5 more times
[18-8-2008 15:52:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:52:48] The line above was repeated 7 more times
[18-8-2008 15:52:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:53:19] The line above was repeated 5 more times
[18-8-2008 15:53:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:53:51] The line above was repeated 5 more times
[18-8-2008 15:53:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:54:21] The line above was repeated 7 more times
[18-8-2008 15:54:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:54:52] The line above was repeated 5 more times
[18-8-2008 15:54:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:55:22] The line above was repeated 5 more times
[18-8-2008 15:55:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:55:53] The line above was repeated 5 more times
[18-8-2008 15:55:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:56:25] The line above was repeated 7 more times
[18-8-2008 15:56:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:56:55] The line above was repeated 5 more times
[18-8-2008 15:56:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:57:26] The line above was repeated 7 more times
[18-8-2008 15:57:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:57:56] The line above was repeated 5 more times
[18-8-2008 15:57:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:58:27] The line above was repeated 5 more times
[18-8-2008 15:58:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:58:59] The line above was repeated 7 more times
[18-8-2008 15:58:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 15:59:30] The line above was repeated 5 more times
[18-8-2008 15:59:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:00:01] The line above was repeated 6 more times
[18-8-2008 16:00:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:00:32] The line above was repeated 6 more times
[18-8-2008 16:00:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:01:05] The line above was repeated 5 more times
[18-8-2008 16:01:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:01:36] The line above was repeated 5 more times
[18-8-2008 16:01:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:02:08] The line above was repeated 7 more times
[18-8-2008 16:02:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:02:39] The line above was repeated 5 more times
[18-8-2008 16:02:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:03:10] The line above was repeated 5 more times
[18-8-2008 16:03:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:03:41] The line above was repeated 5 more times
[18-8-2008 16:03:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:04:16] The line above was repeated 8 more times
[18-8-2008 16:04:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:04:47] The line above was repeated 5 more times
[18-8-2008 16:04:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:05:13] The line above was repeated 5 more times
[18-8-2008 16:05:13] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:05:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:05:48] The line above was repeated 6 more times
[18-8-2008 16:05:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:06:21] The line above was repeated 5 more times
[18-8-2008 16:06:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:06:51] The line above was repeated 5 more times
[18-8-2008 16:06:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:07:20] The line above was repeated 5 more times
[18-8-2008 16:07:20] Warning: Forced memory flush: 458 -> 47
[18-8-2008 16:07:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:07:53] The line above was repeated 7 more times
[18-8-2008 16:07:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:08:24] The line above was repeated 5 more times
[18-8-2008 16:08:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:08:54] The line above was repeated 7 more times
[18-8-2008 16:08:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:09:25] The line above was repeated 5 more times
[18-8-2008 16:09:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:09:56] The line above was repeated 5 more times
[18-8-2008 16:09:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:10:27] The line above was repeated 7 more times
[18-8-2008 16:10:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:10:57] The line above was repeated 5 more times
[18-8-2008 16:10:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:11:32] The line above was repeated 5 more times
[18-8-2008 16:11:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:12:03] The line above was repeated 5 more times
[18-8-2008 16:12:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:12:33] The line above was repeated 7 more times
[18-8-2008 16:12:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:13:04] The line above was repeated 5 more times
[18-8-2008 16:13:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:13:35] The line above was repeated 5 more times
[18-8-2008 16:13:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:14:06] The line above was repeated 5 more times
[18-8-2008 16:14:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:14:36] The line above was repeated 7 more times
[18-8-2008 16:14:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:15:09] The line above was repeated 5 more times
[18-8-2008 16:15:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:15:40] The line above was repeated 5 more times
[18-8-2008 16:15:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:16:10] The line above was repeated 5 more times
[18-8-2008 16:16:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:16:41] The line above was repeated 7 more times
[18-8-2008 16:16:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:17:12] The line above was repeated 5 more times
[18-8-2008 16:17:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:17:43] The line above was repeated 5 more times
[18-8-2008 16:17:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:18:13] The line above was repeated 4 more times
[18-8-2008 16:18:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:18:43] The line above was repeated 7 more times
[18-8-2008 16:18:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:19:14] The line above was repeated 5 more times
[18-8-2008 16:19:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:19:46] The line above was repeated 7 more times
[18-8-2008 16:19:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:20:17] The line above was repeated 5 more times
[18-8-2008 16:20:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:20:48] The line above was repeated 5 more times
[18-8-2008 16:20:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:21:19] The line above was repeated 5 more times
[18-8-2008 16:21:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:21:49] The line above was repeated 5 more times
[18-8-2008 16:21:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:22:20] The line above was repeated 7 more times
[18-8-2008 16:22:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:22:50] The line above was repeated 5 more times
[18-8-2008 16:22:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:23:21] The line above was repeated 5 more times
[18-8-2008 16:23:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:23:25] Warning: Forced memory flush: 438 -> 5
[18-8-2008 16:23:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:23:58] The line above was repeated 7 more times
[18-8-2008 16:23:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:24:29] The line above was repeated 5 more times
[18-8-2008 16:24:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:25:00] The line above was repeated 5 more times
[18-8-2008 16:25:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:25:31] The line above was repeated 7 more times
[18-8-2008 16:25:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:26:01] The line above was repeated 5 more times
[18-8-2008 16:26:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:26:32] The line above was repeated 5 more times
[18-8-2008 16:26:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:27:04] The line above was repeated 7 more times
[18-8-2008 16:27:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:27:34] The line above was repeated 5 more times
[18-8-2008 16:27:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:28:05] The line above was repeated 5 more times
[18-8-2008 16:28:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:28:36] The line above was repeated 6 more times
[18-8-2008 16:28:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:29:06] The line above was repeated 5 more times
[18-8-2008 16:29:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:29:37] The line above was repeated 5 more times
[18-8-2008 16:29:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:30:08] The line above was repeated 5 more times
[18-8-2008 16:30:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:30:38] The line above was repeated 7 more times
[18-8-2008 16:30:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:31:09] The line above was repeated 5 more times
[18-8-2008 16:31:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:31:17] The line above was repeated 1 more time
[18-8-2008 16:31:17] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 16:31:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:31:50] The line above was repeated 6 more times
[18-8-2008 16:31:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:32:21] The line above was repeated 5 more times
[18-8-2008 16:32:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:32:52] The line above was repeated 5 more times
[18-8-2008 16:32:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:33:23] The line above was repeated 6 more times
[18-8-2008 16:33:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:33:54] The line above was repeated 6 more times
[18-8-2008 16:33:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:34:26] The line above was repeated 5 more times
[18-8-2008 16:34:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:34:57] The line above was repeated 5 more times
[18-8-2008 16:34:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:35:28] The line above was repeated 7 more times
[18-8-2008 16:35:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:35:59] The line above was repeated 5 more times
[18-8-2008 16:35:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:36:30] The line above was repeated 5 more times
[18-8-2008 16:36:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:37:01] The line above was repeated 7 more times
[18-8-2008 16:37:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:37:31] The line above was repeated 5 more times
[18-8-2008 16:37:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:38:03] The line above was repeated 5 more times
[18-8-2008 16:38:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:38:34] The line above was repeated 5 more times
[18-8-2008 16:38:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:39:04] The line above was repeated 7 more times
[18-8-2008 16:39:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:39:35] The line above was repeated 5 more times
[18-8-2008 16:39:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:39:59] The line above was repeated 4 more times
[18-8-2008 16:39:59] Warning: Forced memory flush: 418 -> 40
[18-8-2008 16:39:59] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:40:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:40:32] The line above was repeated 6 more times
[18-8-2008 16:40:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:41:03] The line above was repeated 5 more times
[18-8-2008 16:41:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:41:34] The line above was repeated 6 more times
[18-8-2008 16:41:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:42:05] The line above was repeated 6 more times
[18-8-2008 16:42:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:42:35] The line above was repeated 5 more times
[18-8-2008 16:42:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:43:05] The line above was repeated 5 more times
[18-8-2008 16:43:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:43:36] The line above was repeated 6 more times
[18-8-2008 16:43:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:44:06] The line above was repeated 6 more times
[18-8-2008 16:44:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:44:37] The line above was repeated 5 more times
[18-8-2008 16:44:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:45:09] The line above was repeated 5 more times
[18-8-2008 16:45:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:45:39] The line above was repeated 7 more times
[18-8-2008 16:45:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:46:11] The line above was repeated 5 more times
[18-8-2008 16:46:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:46:41] The line above was repeated 5 more times
[18-8-2008 16:46:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:47:12] The line above was repeated 7 more times
[18-8-2008 16:47:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:47:43] The line above was repeated 5 more times
[18-8-2008 16:47:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:48:15] The line above was repeated 5 more times
[18-8-2008 16:48:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:48:46] The line above was repeated 5 more times
[18-8-2008 16:48:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:49:17] The line above was repeated 7 more times
[18-8-2008 16:49:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:49:47] The line above was repeated 5 more times
[18-8-2008 16:49:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:50:20] The line above was repeated 5 more times
[18-8-2008 16:50:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:50:51] The line above was repeated 7 more times
[18-8-2008 16:50:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:51:22] The line above was repeated 5 more times
[18-8-2008 16:51:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:51:52] The line above was repeated 5 more times
[18-8-2008 16:51:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:52:23] The line above was repeated 7 more times
[18-8-2008 16:52:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:52:54] The line above was repeated 5 more times
[18-8-2008 16:52:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:53:25] The line above was repeated 7 more times
[18-8-2008 16:53:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:53:56] The line above was repeated 5 more times
[18-8-2008 16:53:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:54:27] The line above was repeated 7 more times
[18-8-2008 16:54:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:54:58] The line above was repeated 5 more times
[18-8-2008 16:54:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:55:29] The line above was repeated 5 more times
[18-8-2008 16:55:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:55:39] The line above was repeated 1 more time
[18-8-2008 16:55:39] Warning: Forced memory flush: 418 -> 3
[18-8-2008 16:55:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:56:11] The line above was repeated 7 more times
[18-8-2008 16:56:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:56:41] The line above was repeated 5 more times
[18-8-2008 16:56:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:57:12] The line above was repeated 5 more times
[18-8-2008 16:57:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:57:42] The line above was repeated 7 more times
[18-8-2008 16:57:42] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 16:57:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:57:48] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:57:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:58:20] The line above was repeated 5 more times
[18-8-2008 16:58:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:58:52] The line above was repeated 5 more times
[18-8-2008 16:58:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:59:24] The line above was repeated 7 more times
[18-8-2008 16:59:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 16:59:55] The line above was repeated 5 more times
[18-8-2008 16:59:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:00:25] The line above was repeated 5 more times
[18-8-2008 17:00:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:00:56] The line above was repeated 6 more times
[18-8-2008 17:00:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:01:27] The line above was repeated 6 more times
[18-8-2008 17:01:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:01:57] The line above was repeated 5 more times
[18-8-2008 17:01:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:02:28] The line above was repeated 7 more times
[18-8-2008 17:02:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:02:58] The line above was repeated 5 more times
[18-8-2008 17:02:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:03:29] The line above was repeated 5 more times
[18-8-2008 17:03:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:04:02] The line above was repeated 7 more times
[18-8-2008 17:04:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:04:35] The line above was repeated 5 more times
[18-8-2008 17:04:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:05:08] The line above was repeated 5 more times
[18-8-2008 17:05:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:05:39] The line above was repeated 7 more times
[18-8-2008 17:05:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:06:10] The line above was repeated 5 more times
[18-8-2008 17:06:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:06:41] The line above was repeated 5 more times
[18-8-2008 17:06:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:07:12] The line above was repeated 6 more times
[18-8-2008 17:07:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:07:42] The line above was repeated 6 more times
[18-8-2008 17:07:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:08:17] The line above was repeated 5 more times
[18-8-2008 17:08:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:08:48] The line above was repeated 7 more times
[18-8-2008 17:08:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:09:18] The line above was repeated 5 more times
[18-8-2008 17:09:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:09:49] The line above was repeated 7 more times
[18-8-2008 17:09:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:10:19] The line above was repeated 5 more times
[18-8-2008 17:10:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:10:48] The line above was repeated 5 more times
[18-8-2008 17:10:48] Warning: Forced memory flush: 375 -> 2
[18-8-2008 17:10:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:11:21] The line above was repeated 7 more times
[18-8-2008 17:11:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:11:52] The line above was repeated 5 more times
[18-8-2008 17:11:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:12:23] The line above was repeated 7 more times
[18-8-2008 17:12:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:12:53] The line above was repeated 5 more times
[18-8-2008 17:12:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:13:23] The line above was repeated 5 more times
[18-8-2008 17:13:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:13:55] The line above was repeated 5 more times
[18-8-2008 17:13:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:14:26] The line above was repeated 7 more times
[18-8-2008 17:14:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:14:57] The line above was repeated 5 more times
[18-8-2008 17:14:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:15:27] The line above was repeated 5 more times
[18-8-2008 17:15:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:15:57] The line above was repeated 5 more times
[18-8-2008 17:15:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:16:28] The line above was repeated 5 more times
[18-8-2008 17:16:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:16:59] The line above was repeated 5 more times
[18-8-2008 17:16:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:17:29] The line above was repeated 5 more times
[18-8-2008 17:17:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:18:03] The line above was repeated 5 more times
[18-8-2008 17:18:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:18:33] The line above was repeated 7 more times
[18-8-2008 17:18:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:19:04] The line above was repeated 6 more times
[18-8-2008 17:19:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:19:34] The line above was repeated 6 more times
[18-8-2008 17:19:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:20:08] The line above was repeated 5 more times
[18-8-2008 17:20:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:20:39] The line above was repeated 5 more times
[18-8-2008 17:20:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:21:10] The line above was repeated 7 more times
[18-8-2008 17:21:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:21:41] The line above was repeated 5 more times
[18-8-2008 17:21:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:22:11] The line above was repeated 7 more times
[18-8-2008 17:22:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:22:42] The line above was repeated 5 more times
[18-8-2008 17:22:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:23:13] The line above was repeated 5 more times
[18-8-2008 17:23:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:23:48] The line above was repeated 7 more times
[18-8-2008 17:23:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:24:18] The line above was repeated 5 more times
[18-8-2008 17:24:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:24:49] The line above was repeated 5 more times
[18-8-2008 17:24:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:25:19] The line above was repeated 7 more times
[18-8-2008 17:25:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:25:52] The line above was repeated 5 more times
[18-8-2008 17:25:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:26:23] The line above was repeated 5 more times
[18-8-2008 17:26:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:26:50] The line above was repeated 5 more times
[18-8-2008 17:26:50] Warning: Forced memory flush: 383 -> 5
[18-8-2008 17:26:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:27:26] The line above was repeated 6 more times
[18-8-2008 17:27:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:28:01] The line above was repeated 6 more times
[18-8-2008 17:28:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:28:32] The line above was repeated 6 more times
[18-8-2008 17:28:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:29:04] The line above was repeated 5 more times
[18-8-2008 17:29:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:29:34] The line above was repeated 5 more times
[18-8-2008 17:29:34] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:30:05] The line above was repeated 5 more times
[18-8-2008 17:30:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:30:36] The line above was repeated 7 more times
[18-8-2008 17:30:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:31:09] The line above was repeated 5 more times
[18-8-2008 17:31:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:31:40] The line above was repeated 5 more times
[18-8-2008 17:31:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:32:13] The line above was repeated 5 more times
[18-8-2008 17:32:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:32:43] The line above was repeated 6 more times
[18-8-2008 17:32:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:33:14] The line above was repeated 5 more times
[18-8-2008 17:33:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:33:45] The line above was repeated 5 more times
[18-8-2008 17:33:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:34:16] The line above was repeated 6 more times
[18-8-2008 17:34:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:34:46] The line above was repeated 5 more times
[18-8-2008 17:34:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:35:17] The line above was repeated 5 more times
[18-8-2008 17:35:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:35:48] The line above was repeated 7 more times
[18-8-2008 17:35:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:36:18] The line above was repeated 5 more times
[18-8-2008 17:36:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:36:49] The line above was repeated 5 more times
[18-8-2008 17:36:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:37:22] The line above was repeated 7 more times
[18-8-2008 17:37:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:37:53] The line above was repeated 5 more times
[18-8-2008 17:37:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:38:24] The line above was repeated 5 more times
[18-8-2008 17:38:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:38:55] The line above was repeated 7 more times
[18-8-2008 17:38:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:39:25] The line above was repeated 5 more times
[18-8-2008 17:39:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:39:57] The line above was repeated 5 more times
[18-8-2008 17:39:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:40:28] The line above was repeated 6 more times
[18-8-2008 17:40:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:40:58] The line above was repeated 6 more times
[18-8-2008 17:40:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:41:29] The line above was repeated 5 more times
[18-8-2008 17:41:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:42:01] The line above was repeated 5 more times
[18-8-2008 17:42:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:42:03] Warning: Forced memory flush: 393 -> 6
[18-8-2008 17:42:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:42:36] The line above was repeated 7 more times
[18-8-2008 17:42:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:43:07] The line above was repeated 5 more times
[18-8-2008 17:43:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:43:38] The line above was repeated 7 more times
[18-8-2008 17:43:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:44:09] The line above was repeated 5 more times
[18-8-2008 17:44:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:44:39] The line above was repeated 5 more times
[18-8-2008 17:44:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:45:10] The line above was repeated 7 more times
[18-8-2008 17:45:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:45:41] The line above was repeated 5 more times
[18-8-2008 17:45:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:46:11] The line above was repeated 5 more times
[18-8-2008 17:46:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:46:43] The line above was repeated 5 more times
[18-8-2008 17:46:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:47:16] The line above was repeated 6 more times
[18-8-2008 17:47:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:47:47] The line above was repeated 6 more times
[18-8-2008 17:47:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:48:17] The line above was repeated 5 more times
[18-8-2008 17:48:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:48:48] The line above was repeated 5 more times
[18-8-2008 17:48:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:49:18] The line above was repeated 6 more times
[18-8-2008 17:49:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:49:49] The line above was repeated 5 more times
[18-8-2008 17:49:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:50:20] The line above was repeated 5 more times
[18-8-2008 17:50:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:50:51] The line above was repeated 5 more times
[18-8-2008 17:50:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:51:23] The line above was repeated 5 more times
[18-8-2008 17:51:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:51:57] The line above was repeated 7 more times
[18-8-2008 17:51:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:52:28] The line above was repeated 5 more times
[18-8-2008 17:52:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:52:58] The line above was repeated 6 more times
[18-8-2008 17:52:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:53:28] The line above was repeated 5 more times
[18-8-2008 17:53:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:53:59] The line above was repeated 5 more times
[18-8-2008 17:53:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:54:19] The line above was repeated 3 more times
[18-8-2008 17:54:19] Warning: Found bucket #43688 with all domains present in other buckets - marking it for unload!
[18-8-2008 17:54:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:54:50] The line above was repeated 5 more times
[18-8-2008 17:54:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:55:21] The line above was repeated 6 more times
[18-8-2008 17:55:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:55:52] The line above was repeated 5 more times
[18-8-2008 17:55:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:56:26] The line above was repeated 5 more times
[18-8-2008 17:56:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:56:57] The line above was repeated 6 more times
[18-8-2008 17:56:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:57:28] The line above was repeated 5 more times
[18-8-2008 17:57:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:57:59] The line above was repeated 5 more times
[18-8-2008 17:57:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:58:33] The line above was repeated 5 more times
[18-8-2008 17:58:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:58:59] The line above was repeated 5 more times
[18-8-2008 17:58:59] Warning: Forced memory flush: 381 -> 4
[18-8-2008 17:59:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 17:59:32] The line above was repeated 7 more times
[18-8-2008 17:59:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:00:03] The line above was repeated 5 more times
[18-8-2008 18:00:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:00:27] The line above was repeated 6 more times
[18-8-2008 18:00:27] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 18:00:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:00:53] The line above was repeated 5 more times
[18-8-2008 18:00:53] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:00:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:01:29] The line above was repeated 5 more times
[18-8-2008 18:01:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:02:00] The line above was repeated 7 more times
[18-8-2008 18:02:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:02:31] The line above was repeated 5 more times
[18-8-2008 18:02:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:03:02] The line above was repeated 5 more times
[18-8-2008 18:03:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:03:33] The line above was repeated 5 more times
[18-8-2008 18:03:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:04:04] The line above was repeated 5 more times
[18-8-2008 18:04:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:04:36] The line above was repeated 6 more times
[18-8-2008 18:04:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:05:07] The line above was repeated 5 more times
[18-8-2008 18:05:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:05:38] The line above was repeated 5 more times
[18-8-2008 18:05:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:06:09] The line above was repeated 7 more times
[18-8-2008 18:06:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:06:40] The line above was repeated 5 more times
[18-8-2008 18:06:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:06:44] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:06:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:07:22] The line above was repeated 7 more times
[18-8-2008 18:07:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:07:53] The line above was repeated 5 more times
[18-8-2008 18:07:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:08:24] The line above was repeated 5 more times
[18-8-2008 18:08:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:08:29] The line above was repeated 2 more times
[18-8-2008 18:08:29] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:08:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:09:05] The line above was repeated 5 more times
[18-8-2008 18:09:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:09:35] The line above was repeated 5 more times
[18-8-2008 18:09:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:10:06] The line above was repeated 5 more times
[18-8-2008 18:10:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:10:37] The line above was repeated 7 more times
[18-8-2008 18:10:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:10:47] The line above was repeated 1 more time
[18-8-2008 18:10:47] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:10:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:11:23] The line above was repeated 5 more times
[18-8-2008 18:11:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:11:54] The line above was repeated 5 more times
[18-8-2008 18:11:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:12:26] The line above was repeated 7 more times
[18-8-2008 18:12:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:13:00] The line above was repeated 6 more times
[18-8-2008 18:13:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:13:31] The line above was repeated 5 more times
[18-8-2008 18:13:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:14:02] The line above was repeated 7 more times
[18-8-2008 18:14:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:14:11] The line above was repeated 1 more time
[18-8-2008 18:14:11] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:14:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:14:48] The line above was repeated 5 more times
[18-8-2008 18:14:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:15:20] The line above was repeated 4 more times
[18-8-2008 18:15:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:15:51] The line above was repeated 5 more times
[18-8-2008 18:15:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:16:22] The line above was repeated 5 more times
[18-8-2008 18:16:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:16:41] The line above was repeated 3 more times
[18-8-2008 18:16:41] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:16:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:17:12] The line above was repeated 4 more times
[18-8-2008 18:17:12] Warning: Forced memory flush: 357 -> 6
[18-8-2008 18:17:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:17:54] The line above was repeated 7 more times
[18-8-2008 18:17:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:18:25] The line above was repeated 5 more times
[18-8-2008 18:18:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:18:55] The line above was repeated 5 more times
[18-8-2008 18:18:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:19:05] The line above was repeated 3 more times
[18-8-2008 18:19:05] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:19:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:19:42] The line above was repeated 7 more times
[18-8-2008 18:19:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:20:13] The line above was repeated 5 more times
[18-8-2008 18:20:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:20:46] The line above was repeated 4 more times
[18-8-2008 18:20:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:21:17] The line above was repeated 5 more times
[18-8-2008 18:21:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:21:48] The line above was repeated 7 more times
[18-8-2008 18:21:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:22:20] The line above was repeated 5 more times
[18-8-2008 18:22:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:22:48] The line above was repeated 5 more times
[18-8-2008 18:22:48] Warning: Barrel archiving in external process failed due to: It appears that external archiving process was terminated prematurely, will have to retry archiving
[18-8-2008 18:22:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:22:55] The line above was repeated 1 more time
[18-8-2008 18:22:55] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:23:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:23:31] The line above was repeated 5 more times
[18-8-2008 18:23:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:24:02] The line above was repeated 5 more times
[18-8-2008 18:24:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:24:33] The line above was repeated 5 more times
[18-8-2008 18:24:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:25:03] The line above was repeated 7 more times
[18-8-2008 18:25:03] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:25:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:25:40] The line above was repeated 5 more times
[18-8-2008 18:25:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:26:10] The line above was repeated 5 more times
[18-8-2008 18:26:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:26:42] The line above was repeated 7 more times
[18-8-2008 18:26:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:27:13] The line above was repeated 5 more times
[18-8-2008 18:27:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:27:47] The line above was repeated 5 more times
[18-8-2008 18:27:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:28:17] The line above was repeated 7 more times
[18-8-2008 18:28:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:28:48] The line above was repeated 5 more times
[18-8-2008 18:28:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:29:20] The line above was repeated 5 more times
[18-8-2008 18:29:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:29:27] The line above was repeated 1 more time
[18-8-2008 18:29:27] Could not fetch robots.txt for bucket #43726 and domain=www.detech-shop.de due to: System.Exception: Can't execute query 'pn_select_robotstxt_for_domain': Exception of type 'System.OutOfMemoryException' was thrown. -   - SQL: 
   at Majestic12.EasyDB.intExecQuery(String sQueryName, ArrayList oQueries, Object[] asParams)
   at Majestic12.EasyDB.intExecQuery(String sQueryName, ArrayList oQueries, String sTranID, Object[] asParams)
[18-8-2008 18:29:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:30:04] The line above was repeated 6 more times
[18-8-2008 18:30:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:30:25] The line above was repeated 4 more times
[18-8-2008 18:30:25] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:30:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:30:51] The line above was repeated 3 more times
[18-8-2008 18:30:51] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:30:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:31:08] The line above was repeated 1 more time
[18-8-2008 18:31:08] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:31:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:31:36] The line above was repeated 5 more times
[18-8-2008 18:31:36] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:31:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:31:50] The line above was repeated 1 more time
[18-8-2008 18:31:50] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:31:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:06] The line above was repeated 1 more time
[18-8-2008 18:32:06] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:20] The line above was repeated 1 more time
[18-8-2008 18:32:20] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:35] The line above was repeated 1 more time
[18-8-2008 18:32:35] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:50] The line above was repeated 1 more time
[18-8-2008 18:32:50] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:32:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:33:06] The line above was repeated 1 more time
[18-8-2008 18:33:06] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:33:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:33:22] The line above was repeated 1 more time
[18-8-2008 18:33:22] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:33:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:33:36] The line above was repeated 1 more time
[18-8-2008 18:33:36] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:33:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:13] The line above was repeated 5 more times
[18-8-2008 18:34:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:18] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:23] Warning: Forced memory flush: 356 -> 4
[18-8-2008 18:34:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:26] The line above was repeated 1 more time
[18-8-2008 18:34:26] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:40] The line above was repeated 1 more time
[18-8-2008 18:34:40] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:34:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:35:12] The line above was repeated 4 more times
[18-8-2008 18:35:12] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:35:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:35:34] The line above was repeated 2 more times
[18-8-2008 18:35:34] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:35:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:35:50] The line above was repeated 1 more time
[18-8-2008 18:35:50] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:35:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:36:16] The line above was repeated 3 more times
[18-8-2008 18:36:16] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:36:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:36:22] The line above was repeated 1 more time
[18-8-2008 18:36:22] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:36:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:36:36] The line above was repeated 1 more time
[18-8-2008 18:36:36] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:36:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:37:12] The line above was repeated 5 more times
[18-8-2008 18:37:12] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:37:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:37:49] The line above was repeated 5 more times
[18-8-2008 18:37:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:38:03] The line above was repeated 4 more times
[18-8-2008 18:38:03] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:38:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:38:24] The line above was repeated 2 more times
[18-8-2008 18:38:24] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:38:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:38:59] The line above was repeated 5 more times
[18-8-2008 18:38:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:39:30] The line above was repeated 5 more times
[18-8-2008 18:39:30] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:39:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:39:46] The line above was repeated 1 more time
[18-8-2008 18:39:46] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:39:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:40:22] The line above was repeated 5 more times
[18-8-2008 18:40:22] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:40:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:40:48] The line above was repeated 3 more times
[18-8-2008 18:40:48] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:40:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:41:24] The line above was repeated 5 more times
[18-8-2008 18:41:24] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:41:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:41:36] The line above was repeated 1 more time
[18-8-2008 18:41:36] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:41:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:41:49] The line above was repeated 2 more times
[18-8-2008 18:41:49] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:41:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:42:10] The line above was repeated 2 more times
[18-8-2008 18:42:10] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:42:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:42:30] The line above was repeated 2 more times
[18-8-2008 18:42:30] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:42:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:42:50] The line above was repeated 2 more times
[18-8-2008 18:42:50] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:42:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:43:09] The line above was repeated 2 more times
[18-8-2008 18:43:09] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:43:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:43:32] The line above was repeated 4 more times
[18-8-2008 18:43:32] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:43:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:43:53] The line above was repeated 2 more times
[18-8-2008 18:43:53] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:43:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:44:29] The line above was repeated 5 more times
[18-8-2008 18:44:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:01] The line above was repeated 5 more times
[18-8-2008 18:45:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:10] The line above was repeated 1 more time
[18-8-2008 18:45:10] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:30] The line above was repeated 2 more times
[18-8-2008 18:45:30] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:45] The line above was repeated 1 more time
[18-8-2008 18:45:45] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:45:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:01] The line above was repeated 1 more time
[18-8-2008 18:46:01] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:06] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:17] The line above was repeated 1 more time
[18-8-2008 18:46:17] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:27] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:47] The line above was repeated 2 more times
[18-8-2008 18:46:47] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:46:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:47:23] The line above was repeated 5 more times
[18-8-2008 18:47:23] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:47:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:47:38] The line above was repeated 1 more time
[18-8-2008 18:47:38] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:47:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:48:00] The line above was repeated 4 more times
[18-8-2008 18:48:00] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:48:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:48:39] The line above was repeated 5 more times
[18-8-2008 18:48:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:49:11] The line above was repeated 6 more times
[18-8-2008 18:49:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:49:22] The line above was repeated 2 more times
[18-8-2008 18:49:22] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:49:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:49:43] The line above was repeated 3 more times
[18-8-2008 18:49:43] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:49:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:50:21] The line above was repeated 5 more times
[18-8-2008 18:50:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:50:52] The line above was repeated 5 more times
[18-8-2008 18:50:52] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:50:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:51:25] The line above was repeated 6 more times
[18-8-2008 18:51:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:51:58] The line above was repeated 5 more times
[18-8-2008 18:51:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:52:07] The line above was repeated 1 more time
[18-8-2008 18:52:07] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:52:10] The line above was repeated 2 more times
[18-8-2008 18:52:10] Warning: Forced memory flush: 450 -> 3
[18-8-2008 18:52:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:52:39] The line above was repeated 4 more times
[18-8-2008 18:52:39] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:52:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:53:10] The line above was repeated 4 more times
[18-8-2008 18:53:10] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:53:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:53:45] The line above was repeated 4 more times
[18-8-2008 18:53:45] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:53:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:54:16] The line above was repeated 5 more times
[18-8-2008 18:54:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:54:41] The line above was repeated 5 more times
[18-8-2008 18:54:41] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:54:46] The line above was repeated 1 more time
[18-8-2008 18:54:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:55:19] The line above was repeated 5 more times
[18-8-2008 18:55:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:55:51] The line above was repeated 5 more times
[18-8-2008 18:55:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:56:24] The line above was repeated 6 more times
[18-8-2008 18:56:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:56:55] The line above was repeated 7 more times
[18-8-2008 18:56:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:57:26] The line above was repeated 5 more times
[18-8-2008 18:57:26] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:57:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:58:03] The line above was repeated 6 more times
[18-8-2008 18:58:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:58:23] The line above was repeated 4 more times
[18-8-2008 18:58:23] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:58:29] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:00] The line above was repeated 5 more times
[18-8-2008 18:59:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:04] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:41] The line above was repeated 5 more times
[18-8-2008 18:59:41] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:45] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 18:59:52] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:00:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:00:35] The line above was repeated 6 more times
[18-8-2008 19:00:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:01:06] The line above was repeated 5 more times
[18-8-2008 19:01:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:01:36] The line above was repeated 5 more times
[18-8-2008 19:01:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:02:07] The line above was repeated 7 more times
[18-8-2008 19:02:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:02:32] The line above was repeated 4 more times
[18-8-2008 19:02:32] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:02:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:03:09] The line above was repeated 5 more times
[18-8-2008 19:03:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:03:13] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:03:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:03:53] The line above was repeated 5 more times
[18-8-2008 19:03:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:04:14] The line above was repeated 4 more times
[18-8-2008 19:04:14] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:04:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:04:50] The line above was repeated 5 more times
[18-8-2008 19:04:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:05:21] The line above was repeated 7 more times
[18-8-2008 19:05:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:05:53] The line above was repeated 5 more times
[18-8-2008 19:05:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:06:27] The line above was repeated 6 more times
[18-8-2008 19:06:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:06:37] The line above was repeated 2 more times
[18-8-2008 19:06:37] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:06:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:07:13] The line above was repeated 5 more times
[18-8-2008 19:07:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:07:23] The line above was repeated 1 more time
[18-8-2008 19:07:23] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:07:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:07:59] The line above was repeated 5 more times
[18-8-2008 19:07:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:08:14] The line above was repeated 1 more time
[18-8-2008 19:08:14] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:08:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:08:23] The line above was repeated 1 more time
[18-8-2008 19:08:23] Warning: Forced memory flush: 499 -> 76
[18-8-2008 19:08:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:08:56] The line above was repeated 7 more times
[18-8-2008 19:08:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:09:27] The line above was repeated 5 more times
[18-8-2008 19:09:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:09:36] The line above was repeated 1 more time
[18-8-2008 19:09:36] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:09:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:10:17] The line above was repeated 5 more times
[18-8-2008 19:10:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:10:48] The line above was repeated 5 more times
[18-8-2008 19:10:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:11:19] The line above was repeated 7 more times
[18-8-2008 19:11:19] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:11:49] The line above was repeated 5 more times
[18-8-2008 19:11:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:12:20] The line above was repeated 5 more times
[18-8-2008 19:12:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:12:40] The line above was repeated 3 more times
[18-8-2008 19:12:40] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:12:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:13:20] The line above was repeated 7 more times
[18-8-2008 19:13:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:13:53] The line above was repeated 5 more times
[18-8-2008 19:13:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:14:23] The line above was repeated 4 more times
[18-8-2008 19:14:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:14:51] The line above was repeated 4 more times
[18-8-2008 19:14:51] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:14:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:15:22] The line above was repeated 6 more times
[18-8-2008 19:15:22] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:15:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:15:58] The line above was repeated 5 more times
[18-8-2008 19:15:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:16:03] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:16:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:16:40] The line above was repeated 7 more times
[18-8-2008 19:16:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:17:05] The line above was repeated 4 more times
[18-8-2008 19:17:05] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:17:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:17:41] The line above was repeated 5 more times
[18-8-2008 19:17:41] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:17:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:18:17] The line above was repeated 5 more times
[18-8-2008 19:18:17] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:18:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:18:53] The line above was repeated 5 more times
[18-8-2008 19:18:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:19:17] The line above was repeated 5 more times
[18-8-2008 19:19:17] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:19:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:19:52] The line above was repeated 5 more times
[18-8-2008 19:19:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:20:23] The line above was repeated 5 more times
[18-8-2008 19:20:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:20:54] The line above was repeated 7 more times
[18-8-2008 19:20:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:21:03] The line above was repeated 1 more time
[18-8-2008 19:21:03] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:21:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:21:40] The line above was repeated 5 more times
[18-8-2008 19:21:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:22:11] The line above was repeated 7 more times
[18-8-2008 19:22:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:22:42] The line above was repeated 5 more times
[18-8-2008 19:22:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:23:13] The line above was repeated 5 more times
[18-8-2008 19:23:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:23:43] The line above was repeated 5 more times
[18-8-2008 19:23:43] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:23:55] The line above was repeated 1 more time
[18-8-2008 19:23:55] Warning: Forced memory flush: 442 -> 5
[18-8-2008 19:23:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:24:27] The line above was repeated 7 more times
[18-8-2008 19:24:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:24:58] The line above was repeated 5 more times
[18-8-2008 19:24:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:25:03] The line above was repeated 1 more time
[18-8-2008 19:25:03] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:25:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:25:39] The line above was repeated 6 more times
[18-8-2008 19:25:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:25:49] The line above was repeated 1 more time
[18-8-2008 19:25:49] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:25:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:26:25] The line above was repeated 5 more times
[18-8-2008 19:26:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:26:57] The line above was repeated 7 more times
[18-8-2008 19:26:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:27:30] The line above was repeated 5 more times
[18-8-2008 19:27:30] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:28:01] The line above was repeated 5 more times
[18-8-2008 19:28:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:28:32] The line above was repeated 5 more times
[18-8-2008 19:28:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:28:41] The line above was repeated 2 more times
[18-8-2008 19:28:41] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:28:49] The line above was repeated 1 more time
[18-8-2008 19:28:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:29:24] The line above was repeated 6 more times
[18-8-2008 19:29:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:29:54] The line above was repeated 5 more times
[18-8-2008 19:29:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:30:11] The line above was repeated 4 more times
[18-8-2008 19:30:11] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:30:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:30:46] The line above was repeated 5 more times
[18-8-2008 19:30:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:31:21] The line above was repeated 5 more times
[18-8-2008 19:31:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:31:51] The line above was repeated 5 more times
[18-8-2008 19:31:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:32:21] The line above was repeated 5 more times
[18-8-2008 19:32:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:32:54] The line above was repeated 7 more times
[18-8-2008 19:32:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:33:25] The line above was repeated 5 more times
[18-8-2008 19:33:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:33:55] The line above was repeated 5 more times
[18-8-2008 19:33:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:34:27] The line above was repeated 5 more times
[18-8-2008 19:34:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:34:58] The line above was repeated 5 more times
[18-8-2008 19:34:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:35:17] The line above was repeated 3 more times
[18-8-2008 19:35:17] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:35:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:35:47] The line above was repeated 5 more times
[18-8-2008 19:35:47] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:35:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:36:23] The line above was repeated 5 more times
[18-8-2008 19:36:23] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:36:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:36:58] The line above was repeated 6 more times
[18-8-2008 19:36:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:37:28] The line above was repeated 5 more times
[18-8-2008 19:37:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:37:39] The line above was repeated 2 more times
[18-8-2008 19:37:39] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:37:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:38:16] The line above was repeated 5 more times
[18-8-2008 19:38:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:38:46] The line above was repeated 5 more times
[18-8-2008 19:38:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:39:02] The line above was repeated 2 more times
[18-8-2008 19:39:02] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:39:08] Warning: Forced memory flush: 441 -> 5
[18-8-2008 19:39:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:39:40] The line above was repeated 6 more times
[18-8-2008 19:39:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:40:06] The line above was repeated 5 more times
[18-8-2008 19:40:06] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:40:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:40:42] The line above was repeated 5 more times
[18-8-2008 19:40:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:41:15] The line above was repeated 5 more times
[18-8-2008 19:41:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:41:45] The line above was repeated 5 more times
[18-8-2008 19:41:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:41:50] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:41:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:41:56] Could not save cached URL! System.ArgumentException: Destination array is not long enough to copy all the items in the collection. Check array index and length.
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:42:01] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:42:15] The line above was repeated 3 more times
[18-8-2008 19:42:15] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:42:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:42:52] The line above was repeated 5 more times
[18-8-2008 19:42:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:42:56] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:43:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:43:34] The line above was repeated 6 more times
[18-8-2008 19:43:34] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:43:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:44:07] The line above was repeated 6 more times
[18-8-2008 19:44:07] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:44:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:44:44] The line above was repeated 5 more times
[18-8-2008 19:44:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:45:16] The line above was repeated 5 more times
[18-8-2008 19:45:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:45:52] The line above was repeated 6 more times
[18-8-2008 19:45:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:46:27] The line above was repeated 8 more times
[18-8-2008 19:46:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:46:56] The line above was repeated 5 more times
[18-8-2008 19:46:56] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:47:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:47:33] The line above was repeated 5 more times
[18-8-2008 19:47:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:48:03] The line above was repeated 6 more times
[18-8-2008 19:48:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:48:18] The line above was repeated 2 more times
[18-8-2008 19:48:18] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:48:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:48:57] The line above was repeated 5 more times
[18-8-2008 19:48:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:49:22] The line above was repeated 4 more times
[18-8-2008 19:49:22] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:49:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:49:53] The line above was repeated 5 more times
[18-8-2008 19:49:53] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:49:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:50:31] The line above was repeated 5 more times
[18-8-2008 19:50:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:51:00] The line above was repeated 5 more times
[18-8-2008 19:51:00] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:51:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:51:27] The line above was repeated 5 more times
[18-8-2008 19:51:27] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:51:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:52:02] The line above was repeated 5 more times
[18-8-2008 19:52:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:52:35] The line above was repeated 5 more times
[18-8-2008 19:52:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:53:05] The line above was repeated 5 more times
[18-8-2008 19:53:05] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:53:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:53:43] The line above was repeated 5 more times
[18-8-2008 19:53:43] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:53:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:54:18] The line above was repeated 7 more times
[18-8-2008 19:54:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:54:51] The line above was repeated 5 more times
[18-8-2008 19:54:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:55:16] The line above was repeated 4 more times
[18-8-2008 19:55:16] Could not save cached URL! System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:55:21] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:55:26] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:55:28] The line above was repeated 11 more times
[18-8-2008 19:55:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:55:31] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:56:02] The line above was repeated 28 more times
[18-8-2008 19:56:02] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:56:05] The line above was repeated 2 more times
[18-8-2008 19:56:05] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:56:05] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:56:36] The line above was repeated 24 more times
[18-8-2008 19:56:36] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:56:31] The line above was repeated 2 more times
[18-8-2008 19:56:39] 18-8-2008 19:56:31 Crawler appears to be hanging, current worker: 159 with status: WaitingForResponse, URL: http://www.gr-forum.de/forum/viewtopic.php?p=1852. TimeOutAbortMark: False FlushMark: False Will attempt to abort that worker.
[18-8-2008 19:56:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:57:06] The line above was repeated 29 more times
[18-8-2008 19:57:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:57:08] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:57:18] The line above was repeated 9 more times
[18-8-2008 19:57:18] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:57:21] The line above was repeated 2 more times
[18-8-2008 19:57:21] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:57:51] The line above was repeated 33 more times
[18-8-2008 19:57:51] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:58:22] The line above was repeated 31 more times
[18-8-2008 19:58:22] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:58:23] 18-8-2008 19:58:23 Crawler appears to be hanging, current worker: 141 with status: Finished, URL: http://www.igmetall-offenbach.de/index2.php?option=com_events&Itemid=34&task=view_month&month=02&year=2009&pop=1&catids=27. TimeOutAbortMark: False FlushMark: False Will attempt to abort that worker.
[18-8-2008 19:58:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:58:55] The line above was repeated 31 more times
[18-8-2008 19:58:55] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:58:57] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:59:20] The line above was repeated 21 more times
[18-8-2008 19:59:20] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 19:59:23] The line above was repeated 2 more times
[18-8-2008 19:59:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 19:59:53] The line above was repeated 27 more times
[18-8-2008 19:59:53] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:00:12] The line above was repeated 19 more times
[18-8-2008 20:00:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:00:13] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:00:44] The line above was repeated 33 more times
[18-8-2008 20:00:44] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:01:02] The line above was repeated 16 more times
[18-8-2008 20:01:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:01:03] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:01:33] The line above was repeated 31 more times
[18-8-2008 20:01:33] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:01:42] The line above was repeated 8 more times
[18-8-2008 20:01:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:01:42] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:01:57] The line above was repeated 9 more times
[18-8-2008 20:01:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:01:58] The line above was repeated 1 more time
[18-8-2008 20:01:58] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:02:29] The line above was repeated 32 more times
[18-8-2008 20:02:29] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:02:42] The line above was repeated 12 more times
[18-8-2008 20:02:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:02:43] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:02:49] The line above was repeated 99 more times
[18-8-2008 20:02:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:02:53] The line above was repeated 2 more times
[18-8-2008 20:02:53] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:03:06] The line above was repeated 126 more times
[18-8-2008 20:03:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:03:07] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:03:32] The line above was repeated 26 more times
[18-8-2008 20:03:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:03:33] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:04:00] The line above was repeated 66 more times
[18-8-2008 20:04:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:04:02] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:04:32] The line above was repeated 25 more times
[18-8-2008 20:04:32] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:04:57] The line above was repeated 25 more times
[18-8-2008 20:04:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:04:58] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:05:28] The line above was repeated 30 more times
[18-8-2008 20:05:28] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:05:46] The line above was repeated 17 more times
[18-8-2008 20:05:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:05:48] The line above was repeated 1 more time
[18-8-2008 20:05:48] Warning: Forced memory flush: 427 -> 2
[18-8-2008 20:05:49] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:06:16] The line above was repeated 46 more times
[18-8-2008 20:06:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:06:18] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:06:40] The line above was repeated 44 more times
[18-8-2008 20:06:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:06:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:06:51] The line above was repeated 235 more times
[18-8-2008 20:06:51] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:06:52] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:07:23] The line above was repeated 35 more times
[18-8-2008 20:07:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:07:53] The line above was repeated 43 more times
[18-8-2008 20:07:53] 18-8-2008 20:07:53 Crawler appears to be hanging, current worker: 133 with status: Finished, URL: http://govinda-natur-gmbh.de/shop/pfefferminzbl%C3%83%C2%A4tter-fein-geschnitten-p-680.html?phsid=b50b9eeb7c3a0e5c3a41fb0f31e00e97. TimeOutAbortMark: False FlushMark: False Will attempt to abort that worker.
[18-8-2008 20:07:55] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:08:24] The line above was repeated 49 more times
[18-8-2008 20:08:24] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:08:54] The line above was repeated 32 more times
[18-8-2008 20:08:54] 18-8-2008 20:08:54 Crawler appears to be hanging, current worker: 248 with status: Finished, URL: http://www.handyass.de/index.php?action=details&artikel_id=10641&tarif_id=73. TimeOutAbortMark: False FlushMark: False Will attempt to abort that worker.
[18-8-2008 20:08:57] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:08:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:08:58] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:09:03] The line above was repeated 73 more times
[18-8-2008 20:09:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:09:03] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:09:34] The line above was repeated 208 more times
[18-8-2008 20:09:34] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:09:45] The line above was repeated 16 more times
[18-8-2008 20:09:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:09:45] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:10:16] The line above was repeated 41 more times
[18-8-2008 20:10:16] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:10:48] The line above was repeated 52 more times
[18-8-2008 20:10:48] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:10:50] The line above was repeated 5 more times
[18-8-2008 20:10:50] 18-8-2008 20:10:50 Crawler appears to be hanging, current worker: 190 with status: Finished, URL: http://www.wanlipontheweb.co.uk/shopping/subcateccessory. TimeOutAbortMark: False FlushMark: False Will attempt to abort that worker.
[18-8-2008 20:10:50] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:10:53] The line above was repeated 6 more times
[18-8-2008 20:10:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:10:53] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:11:23] The line above was repeated 51 more times
[18-8-2008 20:11:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:11:25] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:11:52] The line above was repeated 40 more times
[18-8-2008 20:11:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:11:54] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:12:25] The line above was repeated 47 more times
[18-8-2008 20:12:25] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:12:25] The line above was repeated 1 more time
[18-8-2008 20:12:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:12:26] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:12:49] The line above was repeated 40 more times
[18-8-2008 20:12:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:12:49] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:13:21] The line above was repeated 37 more times
[18-8-2008 20:13:21] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:13:31] The line above was repeated 8 more times
[18-8-2008 20:13:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:13:32] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:14:02] The line above was repeated 35 more times
[18-8-2008 20:14:02] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:14:09] The line above was repeated 8 more times
[18-8-2008 20:14:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:14:11] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:14:31] The line above was repeated 46 more times
[18-8-2008 20:14:31] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:14:32] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:15:02] The line above was repeated 34 more times
[18-8-2008 20:15:02] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:15:07] The line above was repeated 11 more times
[18-8-2008 20:15:07] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:15:08] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:15:32] The line above was repeated 41 more times
[18-8-2008 20:15:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:15:32] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:16:03] The line above was repeated 43 more times
[18-8-2008 20:16:03] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:16:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:16:05] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:16:36] The line above was repeated 33 more times
[18-8-2008 20:16:36] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:16:44] The line above was repeated 10 more times
[18-8-2008 20:16:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:16:50] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:17:16] The line above was repeated 48 more times
[18-8-2008 20:17:16] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:17:17] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:17:42] The line above was repeated 46 more times
[18-8-2008 20:17:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:17:43] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:18:09] The line above was repeated 47 more times
[18-8-2008 20:18:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:18:09] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:18:39] The line above was repeated 40 more times
[18-8-2008 20:18:39] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:18:39] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:19:10] The line above was repeated 44 more times
[18-8-2008 20:19:10] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:19:10] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:19:40] The line above was repeated 31 more times
[18-8-2008 20:19:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:19:54] The line above was repeated 15 more times
[18-8-2008 20:19:54] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:19:55] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:20:22] The line above was repeated 41 more times
[18-8-2008 20:20:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:20:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:20:52] The line above was repeated 46 more times
[18-8-2008 20:20:52] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:20:54] Warning: Forced memory flush: 333 -> 2
[18-8-2008 20:20:57] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:21:23] The line above was repeated 41 more times
[18-8-2008 20:21:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:21:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:21:50] The line above was repeated 44 more times
[18-8-2008 20:21:50] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:21:51] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:22:21] The line above was repeated 31 more times
[18-8-2008 20:22:21] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:22:35] The line above was repeated 15 more times
[18-8-2008 20:22:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:22:37] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:23:02] The line above was repeated 40 more times
[18-8-2008 20:23:02] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:23:03] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:23:28] The line above was repeated 45 more times
[18-8-2008 20:23:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:23:30] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:23:56] The line above was repeated 49 more times
[18-8-2008 20:23:56] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:23:57] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:24:26] The line above was repeated 41 more times
[18-8-2008 20:24:26] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:24:26] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:24:49] The line above was repeated 43 more times
[18-8-2008 20:24:49] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:24:49] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:24:59] The line above was repeated 17 more times
[18-8-2008 20:24:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:24:59] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:25:11] The line above was repeated 27 more times
[18-8-2008 20:25:11] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:25:12] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:25:28] The line above was repeated 41 more times
[18-8-2008 20:25:28] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:25:29] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:25:57] The line above was repeated 40 more times
[18-8-2008 20:25:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:25:58] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:26:28] The line above was repeated 28 more times
[18-8-2008 20:26:28] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:26:38] The line above was repeated 10 more times
[18-8-2008 20:26:38] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:26:40] The line above was repeated 1 more time
[18-8-2008 20:26:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:27:10] The line above was repeated 32 more times
[18-8-2008 20:27:10] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:27:32] The line above was repeated 24 more times
[18-8-2008 20:27:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:27:33] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:28:03] The line above was repeated 31 more times
[18-8-2008 20:28:03] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:28:12] The line above was repeated 10 more times
[18-8-2008 20:28:12] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:28:13] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:28:43] The line above was repeated 34 more times
[18-8-2008 20:28:43] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:28:53] The line above was repeated 9 more times
[18-8-2008 20:28:53] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:28:54] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:29:25] The line above was repeated 34 more times
[18-8-2008 20:29:25] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:29:32] The line above was repeated 8 more times
[18-8-2008 20:29:32] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:29:33] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:29:58] The line above was repeated 47 more times
[18-8-2008 20:29:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:29:59] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:30:25] The line above was repeated 41 more times
[18-8-2008 20:30:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:30:25] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:30:56] The line above was repeated 43 more times
[18-8-2008 20:30:56] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:30:59] The line above was repeated 2 more times
[18-8-2008 20:30:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:30:59] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:31:27] The line above was repeated 44 more times
[18-8-2008 20:31:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:31:28] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:31:57] The line above was repeated 43 more times
[18-8-2008 20:31:57] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:31:57] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:32:22] The line above was repeated 45 more times
[18-8-2008 20:32:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:32:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:32:40] The line above was repeated 41 more times
[18-8-2008 20:32:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:32:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:33:09] The line above was repeated 41 more times
[18-8-2008 20:33:09] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:33:10] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:33:40] The line above was repeated 32 more times
[18-8-2008 20:33:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:33:48] The line above was repeated 7 more times
[18-8-2008 20:33:48] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:33:49] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:34:19] The line above was repeated 32 more times
[18-8-2008 20:34:19] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:34:37] The line above was repeated 17 more times
[18-8-2008 20:34:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:34:37] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:35:08] The line above was repeated 41 more times
[18-8-2008 20:35:08] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:35:13] The line above was repeated 5 more times
[18-8-2008 20:35:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:35:13] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:35:43] The line above was repeated 40 more times
[18-8-2008 20:35:43] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:35:45] The line above was repeated 4 more times
[18-8-2008 20:35:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:35:46] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:36:06] The line above was repeated 44 more times
[18-8-2008 20:36:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:36:09] Warning: Forced memory flush: 320 -> 2
[18-8-2008 20:36:10] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:36:33] The line above was repeated 43 more times
[18-8-2008 20:36:33] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:36:35] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:37:00] The line above was repeated 39 more times
[18-8-2008 20:37:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:37:00] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:37:22] The line above was repeated 48 more times
[18-8-2008 20:37:22] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:37:23] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:37:54] The line above was repeated 41 more times
[18-8-2008 20:37:54] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:38:00] The line above was repeated 5 more times
[18-8-2008 20:38:00] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:38:01] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:38:15] The line above was repeated 40 more times
[18-8-2008 20:38:15] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:38:17] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:38:40] The line above was repeated 47 more times
[18-8-2008 20:38:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:38:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:39:08] The line above was repeated 44 more times
[18-8-2008 20:39:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:39:09] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:39:40] The line above was repeated 35 more times
[18-8-2008 20:39:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:39:45] The line above was repeated 8 more times
[18-8-2008 20:39:45] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:39:45] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:39:58] The line above was repeated 23 more times
[18-8-2008 20:39:58] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:39:59] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:40:23] The line above was repeated 23 more times
[18-8-2008 20:40:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:40:24] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:40:54] The line above was repeated 32 more times
[18-8-2008 20:40:54] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:41:03] The line above was repeated 8 more times
[18-8-2008 20:41:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:41:04] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:41:34] The line above was repeated 35 more times
[18-8-2008 20:41:34] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:41:44] The line above was repeated 12 more times
[18-8-2008 20:41:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:41:46] The line above was repeated 1 more time
[18-8-2008 20:41:46] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:42:17] The line above was repeated 32 more times
[18-8-2008 20:42:17] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:42:27] The line above was repeated 10 more times
[18-8-2008 20:42:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:42:28] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:43:04] The line above was repeated 35 more times
[18-8-2008 20:43:04] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:43:08] The line above was repeated 9 more times
[18-8-2008 20:43:08] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:43:11] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:43:35] The line above was repeated 47 more times
[18-8-2008 20:43:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:43:36] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:44:06] The line above was repeated 43 more times
[18-8-2008 20:44:06] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:44:06] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:44:36] The line above was repeated 42 more times
[18-8-2008 20:44:36] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:44:37] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:44:39] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:45:11] The line above was repeated 32 more times
[18-8-2008 20:45:11] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:45:25] The line above was repeated 14 more times
[18-8-2008 20:45:25] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:45:26] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:45:56] The line above was repeated 34 more times
[18-8-2008 20:45:56] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:46:04] The line above was repeated 8 more times
[18-8-2008 20:46:04] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:46:05] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:46:37] The line above was repeated 30 more times
[18-8-2008 20:46:37] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:46:46] The line above was repeated 15 more times
[18-8-2008 20:46:46] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:46:46] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:47:14] The line above was repeated 46 more times
[18-8-2008 20:47:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:47:14] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:47:35] The line above was repeated 44 more times
[18-8-2008 20:47:35] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:47:35] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:47:59] The line above was repeated 43 more times
[18-8-2008 20:47:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:48:00] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:48:23] The line above was repeated 39 more times
[18-8-2008 20:48:23] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:48:24] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:48:55] The line above was repeated 49 more times
[18-8-2008 20:48:55] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:48:59] The line above was repeated 3 more times
[18-8-2008 20:48:59] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:49:00] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:49:30] The line above was repeated 32 more times
[18-8-2008 20:49:30] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:49:42] The line above was repeated 12 more times
[18-8-2008 20:49:42] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:49:43] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:50:14] The line above was repeated 28 more times
[18-8-2008 20:50:14] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:50:27] The line above was repeated 16 more times
[18-8-2008 20:50:27] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:50:27] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:50:47] The line above was repeated 46 more times
[18-8-2008 20:50:47] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:50:47] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:51:13] The line above was repeated 42 more times
[18-8-2008 20:51:13] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:51:15] Warning: Forced memory flush: 325 -> 2
[18-8-2008 20:51:15] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:51:40] The line above was repeated 46 more times
[18-8-2008 20:51:40] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:51:40] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:52:11] The line above was repeated 39 more times
[18-8-2008 20:52:11] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:52:14] The line above was repeated 5 more times
[18-8-2008 20:52:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:52:14] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:52:36] The line above was repeated 46 more times
[18-8-2008 20:52:36] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:52:36] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:53:03] The line above was repeated 43 more times
[18-8-2008 20:53:03] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:53:04] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:53:24] The line above was repeated 44 more times
[18-8-2008 20:53:24] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:53:24] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:53:44] The line above was repeated 45 more times
[18-8-2008 20:53:44] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:53:46] Could not mark worker as processed due to: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
   at System.Collections.Hashtable.rehash(Int32 newsize)
   at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
   at System.Collections.Hashtable.set_Item(Object key, Object value)
   at Majestic12.WebCrawler.CacheRetrievedURL(Int32 iBucketID, String sURL, Int32 iDataLength, Int32 iResultCode, Int32 iWebResultCode, Int32 iWorkTime, Boolean bUseCache)
   at Majestic12.WebCrawler.MarkAsProcessed(WebCrawlerWorker oWorker, Boolean bUseCache)
   at Majestic12.WebCrawler.CrawlHandleStatus_Finished(WebCrawlerWorker oWorker)
[18-8-2008 20:54:14] The line above was repeated 45 more times
[18-8-2008 20:54:14] WebCrawler: grace shutdown requested...
[18-8-2008 20:54:14] WebCrawler: shutting down.
[18-8-2008 20:54:14] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:54:14] Waiting for 1 active transfer(s) to end...
[18-8-2008 20:54:15] Aborted requests in 60 worker(s)
[18-8-2008 20:54:17] Could not save cached URL! System.IndexOutOfRangeException: Index was outside the bounds of the array.
   at System.Array.InternalGetReference(Void* elemRef, Int32 rank, Int32* pIndices)
   at System.Array.SetValue(Object value, Int32 index)
   at System.Collections.Hashtable.CopyKeys(Array array, Int32 arrayIndex)
   at System.Collections.Hashtable.KeyCollection.CopyTo(Array array, Int32 arrayIndex)
   at Majestic12.WebCrawler.FlushCachedRetrievedURLs(Int32 iThreshold, Int32 iBucketID)
[18-8-2008 20:54:20] Killing thread oURLManager (Alive=False) with state: Stopped 
[18-8-2008 20:54:20] Killing thread oCrawl (Alive=False) with state: Stopped 
[18-8-2008 20:54:20] Shutting down...
[18-8-2008 20:54:20] Timer cleared
[18-8-2008 20:54:20] WebServer: shutting down.
[18-8-2008 20:54:22] MJ12node v1.6.6 (.NET 2.0) starting up
[18-8-2008 20:54:22] Loading webserver config from: C:\Program Files\Majestic-12\MJ12node\webserver.xml
[18-8-2008 20:54:28] Node will use built-in .NET HTTP library for crawling
[18-8-2008 20:54:28] Data clean up run with results: Total url buckets in the database: 45

*** URL BUCKETS ***
Number of known buckets: 45
Number of NOT known buckets: 0
Number of known buckets to be deleted: 4

*** DATA BARRELS ***
Number of known data barrels: 40
Number of NOT known data barrels: 1
Number of known data barrels to be deleted: 0

CONCLUSION: 
Files that can be deleted: 4
Size that can be freed (KB): 135

Note: if you have a high number of NOT known items
then please report it on forum (see Help -> Forum)

[18-8-2008 20:54:28] Mozilla/5.0 (compatible; MJ12bot/v1.2.2; http://www.majestic12.co.uk/bot.php?+) started with 250 worker(s)