Web Scraper and Web Macros FAQs
Navigation
Home
All Pages
Categories
Quick Search
Advanced Search »
Back
History
I need SPEED!!
Several things can increase your speed, try these! *First and foremost, saving to Excel goes slower and slower with the more rows that are added. Try saving to the SQL instance, Access, or a MySQL instance. *[http://forums.velocityscape.com/Default.aspx?g=posts&t=588|Removing script tags and using little or no optional fields] *[http://forums.velocityscape.com/Default.aspx?g=posts&t=818|Pre-cleansing html] *Purge those logs! Are your packages taking forever to start! **Go to Tools -> **Options -> **Maintenance Tab -> **Purge Log (Make sure no packages are running, doing this will screw them up!) *[http://forums.velocityscape.com/Default.aspx?g=posts&t=596|Managing large scrapes ~10,000 or more records] *Create this index if you're fiending for faster packages. {{{{USE [ProvidusDB] GO CREATE NONCLUSTERED INDEX [Idx_doc_id_entity_id] ON [dbo].[task_inst_doc_results_by_ent] ( [doc_id] ASC, [entity_id] ASC )WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, SORT_IN_TEMPDB = OFF, IGNORE_DUP_KEY = OFF, DROP_EXISTING = OFF, ONLINE = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = OFF) ON [PRIMARY]}}}} <!--*Also, there's an old wives tale that keeping the Web Scraper Console open makes downloads go faster. Try it!-->
Create a Page
|
Administration
|
File Management
|
Login/Logout
|
Language Selection
|
Your Profile
|
Create Account