In order to fill your Related Content and Content Library with content from your site, Shareaholic retrieves and caches information from your webpage - things like title, thumbnail, and excerpts for all your posts and pages.
This is all done by Shareaholic's indexing bot named "Steve". Indexing is the process in which Steve discovers new and updated pages to be added to your Content Library (all the content associated with your page). New pages, changes to existing pages, and dead links are all noted by Steve and used to update the Shareaholic content index for your site.
We do very aggressive caching so you shouldn't see Steve Bot in your logs more than once every few weeks for any one URL. Our goal is to index relevant information from as many web pages from your site as we can on each visit without overwhelming your server's bandwidth. We do not like waste either, and are clever at not wasting bandwidth – yours or ours.
Shareaholic has sophisticated algorithms that determine how much to visit each site. If Steve is indexing content too often and slowing down your server, you can control the index rate for your site in your Shareaholic site settings.
Note: The use of this setting is not always needed, nor is it generally recommended. If you have concerns about Steve slowing down your site, you can also contact us (and include any relevant server logs that you think may help).
Customizing Steve's Site Index Rate
- Login to your Shareaholic.com account
- Select a Site Profile from the "My Sites" list
- Click on "Settings" from the sidebar
- Select "Limit Shareaholic's Index Rate" from the dropdown
- Use the slider to change the Index Rate
- Click "Save Changes"