PHP Classes

Spider Class: Crawl a site following and retrieving linked pages

Recommend this page to a friend!
     
  Info   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStar 45%Total: 6,131 All time: 367 This week: 488Down
Version License Categories
spiderclass 1.0.0GNU General Publi...HTML, PHP 5, Searching
Description 

Author

This class can retrieve Web pages and parse them to extract the list of their links to continue crawling all linked pages.

The pages may be retrieved iteratively until it is reached a given limit of pages or link depth.

It is possible to set regular expressions for both link definitions and content matches, changeable at every depth.

Picture of greg jackson
Name: greg jackson <contact>
Classes: 1 package by
Country: United Kingdom
Age: ???
All time rank: 46324 in United Kingdom
Week rank: 216 Up13 in United Kingdom Up

  Files folder image Files (3)  
File Role Description
Accessible without login Plain text file overview.txt Doc. Overview for spiderClass.php
Plain text file spiderClass.php Class spiderClass source file
Accessible without login Plain text file spiderExamp.php Example Example usage - NOTE: BE KIND TO THE BBC AND DO NOT RUN THIS WITHOUT CHANGING THE PARAMETERS

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
 Version Control Unique User Downloads Download Rankings  
 0%
Total:6,131
This week:0
All time:367
This week:488Down
User Ratings User Comments (1)
 All time
Utility:59%StarStarStar
Consistency:65%StarStarStarStar
Documentation:46%StarStarStar
Examples:43%StarStarStar
Tests:-
Videos:-
Overall:45%StarStarStar
Rank:3345