Project Description
Photo Spider is used to crawl the web for free high-pixel photos. This tool is free and written in C#4.0, it is run on the .NET4.0 platform.


Features
  • Download high pixel photos freely (>= 800*600, and also you can configurate this pixel).
  • Filter the photos those name, size and content are the same.
  • Can specify the key words to search.
  • Supports multi-thread, and can be started as multi-process.
  • Supports regular expressions, can be defined by youself. And we used the LINQ to XML technology.
  • Supports MSI deployment.

How to check in/out the source code
Subversion http://spider.codeplex.com/SourceControl/ListDownloadableCommits.aspx#
Visual Studio Team Explorer http://spider.codeplex.com/SourceControl/ListDownloadableCommits.aspx#
Teamprise Explorer http://spider.codeplex.com/SourceControl/ListDownloadableCommits.aspx#
CodePlex Client http://spider.codeplex.com/SourceControl/ListDownloadableCommits.aspx#

How to configurate zspider.exe.config

Just do like this:
<?xml version="1.0" encoding="utf-8" ?>
<configuration>
  <configSections>
    <section name="Log" type="Zivsoft.Log.Handler,Zivsoft.Log"/>
  </configSections>
  <appSettings>
    <add key="ServerMapping"  value="Zivsoft.Services.Principle.dll"/>
  </appSettings>
  <Log level="DEBUG">
    <LogFile enabled="true">log.log</LogFile>
    <Console len="max">false</Console>
    <XmlLog enabled="true">log.xml</XmlLog>
  </Log>
</configuration>

How to configurate ServerList.DAT

The following is the example for you.
<?xml version="1.0" encoding="utf-8" ?>
<Servers>
 <Server Url="http://www.zivsoft.com">
   <Expressions>
     <Expression Folder="zivsoft_photo_crawl">href="/spider/([^"]*?).html"</Expression>
   </Expressions>
 </Server>
 <Server Url="http://lihua.club.officelive.com/">
   <Expressions>
     <Expression Folder="computer">href="/csharp/([^"]*?).html"</Expression>
     <Expression Folder="ajax">href="/spider/([^"]*?).html"</Expression>
     <Expression Folder="lihua">href="/laozhou/([^"]*?).html"</Expression>
     <Expression Folder="apple">href="/loveyou/([^"]*?).html"</Expression>
   </Expressions>
 </Server>
</Servers> 

Download the .NET Framework 4.0

If you did not install the Microsoft .NET Framework 4.0, you can download it here http://www.cnblogs.com/architect/archive/2009/05/21/1485967.html
As the software ZSpider.NET runs on platform .NET4.0, you must install this framework first. If you run the setup package, and you did not install the .net4.0, it will help install it automatically.

The latest build downloads
http://cid-35d7be189926747a.skydrive.live.com/self.aspx/.Public/ZSpider.zip

Donations
We are now accepting donations to help support ZSpider.NET and accelerate development on it.
https://www.paypal.com/c2/cmd=_prq&id=1Xg8EALQe2u4Q6xhN1ryaUYWDoyMkjTknpam-A

Related Links
http://www.theziv.com
http://www.zivsoft.com
http://www.cnblogs.com/architect/archive/2009/07/24/1530347.html

Last edited Sep 23, 2009 at 4:10 AM by lihuaz, version 17