ImageMagick^® is a software suite to create, edit, and compose bitmap images. It can read, convert and write images in a variety of formats (over 100) including DPX, EXR, GIF, JPEG, JPEG-2000, PDF, PhotoCD, PNG, Postscript, SVG, and TIFF. Use ImageMagick to translate, flip, mirror, rotate, scale, shear and transform images, adjust image colors, apply various special effects, or draw text, lines, polygons, ellipses and Bézier curves.

It is very powerful and supports all platforms with tons of different languages and implementations. Because my hosting solutions did not suppot it (many of them dont do as well) I always used awesome GD library to process images on my projects. Well now my hosting does support and I am going to use it so I needed to install it to my development environment which is windows. I am going to install and use Imagick also because using IM from native PHP is much more faster than using it from console via exec.

Well first of all ImageMagick on windows with PHP is a really pain in the ass, if you have the commitment and time go for it otherwise use it from console. Here are the steps and todo's to install for PHP 5.2.x, ( I dont know if it works with PHP 5.3.x or below, you will need to test for yourself. I am a happy camper for now ).

UPDATE

Just to make things clear, all the PHP dll files (librarires) are 32 bit, so if your system is 64 bit and you will still need to download and operate 32 bit ImageMagick, Apache, etc.

1 Download ImageMagick

Go to http://imagemagick.org/script/binary-releases.php#windows to download the latest version, which is ImageMagick-6.5.4-2-Q16-windows-dll.exe

Now the beauty, static versions are suppose to work with every platform but they act really funny so you should download a dynamic version. If you system/pc supports go for 16 bit Q16. The difference is explained on the link very well.

Now in my case, the latest version did not work so I had to go through old versions and ImageMagick-6.4.2-7-Q16-windows-dll version worked like charm for me. My system is Windows XP SP2, 32 Bit, Intel Centrino 1.76GHZ. You can download the older versions from here.

I suggest you to download and try the latest one, complete all steps, if it doesnt work try with a lower version and so on.

2 Install ImageMagick

Install the IM on a path like C:\imagemagick\ with no spaces and simple location. Do not go for c:\program files\etc

Do not forget to click on the "Add to system path" checkbox. You can ignore the rest of the checkboxes

3 Testing the Installation

Open the command prompt (Run->"CMD"->ENTER) and type in convert and press enter. You should see the help parameters of convert. If so go to step 4.

if it says its failed or unknown function or type in a parameter to convert ( which is a default function in Windows XP to convert HDD from FAT32 to NTFS or vice varsa ) you need to add path to environment by yourself.

My Computer -> Right Click -> Properties -> Advanced (Tab) -> Environment Variables (at the bottom) -> System Variables (Section) -> Scroll to Find "Path" -> Select it and click Edit -> Add your installation directory to there.

4 Downloading the php_Imagick.dll

Again the version problem, well if you are using PHP 5.2.x this is where you will get your dll.

dyn = dynamic, st = static, q16 = 16 bit, q8= 8 bit. This should match your downloaded version of course. If you downloaded q16 dynamic library, your file will be php_imagick_dyn-Q16.dll

If you are using PHP 5.3.x, this is your location to download.

5 Find and Place the dll in your extension folder

Rename the downloaded dll to php_imagick.dll for easy usage and place it under your extension folder. It is usually php/ext/. Go to Step 6.

If it is not, then you can find it in your php.ini file with the extension_dir param.
; Directory in which the loadable extensions (modules) reside.
extension_dir = "Something something"

6 Edit PHP.ini

Uncomment if it exists or add if it doesnt exist this line
extension=php_imagick.dll

7 Restart

This is the important part, I spent good half an hour trying to make it work.. grrrr.. You need to restart your PC to libraries take effect.

If you do not restart and start your apache you will see an error like. So please do restart your PC.

Unable to find CORE_RL_Wand.dll something something.

8 Start Apache and check

Start your apache, and check with the phpinfo() , if you see imagick library and its values thats it you are set. go to step 9.

If not you have picked up the wrong dll file for PHP. Browse through the directory and try another dlls, if they dont work try to lower your ImageMagick installation version. Dont give up, it will work.

9 Test with some code

Put a nice big picture named a.jpg along side with your test.php script, run the test and check the directory to see a_thumnail.jpg. Here is the script, simple and fast

<?
$im = new imagick( 'a.jpg' );
// resize by 200 width and keep the ratio
$im->thumbnailImage( 200, 0);
// write to disk
$im->writeImage( 'a_thumbnail.jpg' );
?>

10 Manual, Learning and Playing Around

To use it from php all you need is  PHP functions and manual including some examples as well.

If you want to go further and mess around here is the command line ( exec() ) parameters, manuals and examples

Finally

So this is it, I hope you get it to work at the first trial now and drop a comment if you have any useful information or experience any error, we will try to help you out.

No related posts.

First Intention:

1. Good ones
   1. Intentionally good and result is efficient: Like google and yahoo. They scan your website and return visitors via search queries in exchange. They leech away your resources but give something in return.
   2. intentionally good but result is inefficient : Like cuil or yandex or other wanna look good but index selling companies.  Leeching your resources and nothing in return. This is the place where you want to decide, if a bot leeches away 5% of your bandwith and return 5 visitors in a month or none. You should list that one as bad also.
2. Bad ones : Ones that scans your website and links in order to harvest emails, content, links and weak security measures and sell them to other people, businesses and other sources. Leeching from your back in other words. They are all bad and should not be allowed to view your contents.

Second Identification and Obeying your Rules:

1. Who identifies and obeys : Usually who identifies themselves as some robot or spider, they obey the robots.txt rules.  Sometimes they do not.
2. Who doesnt: Usually harmfull bots identify themselves as normal web users and they do not care about robots.txt

Method

1st Good and Obeying ones

Tag and ban bad ones

This should be the old method. There used to be maybe 10 bots around the internet that can leech and scan important amounts due to low resources but now home-grown spiders are around everyday and minute with large resources. So specifying who is bad in a 95% bad ratio world is not smart.

Tag and Allow only good ones

This should be the appropriate solution for the problem now. Only allow good ones via robots.txt. In my case they are only big and useful search engines for me. Sample robots.txt that allows the ones with specified identification and disallows the rest.

User-agent: Googlebot
User-agent: Slurp
User-agent: msnbot
User-agent: Mediapartners-Google*
User-agent: Googlebot-Image
User-agent: Yahoo-MMCrawler
Disallow: 

User-agent: *
Disallow: /

so we got rid of the intentionally good, or bad but useless and rule obeying ones. How to get rid of disobeying ones?

2nd Bad and disobedient ones

If you are using apache (and you should use apache!) you can ban them via user agent or user ip. So why are we banning via agent? They can use any IP adress and many bots have IP ranges like xx.xx.xx.10-100 but some of them gets a new IP adress whenever they want or as a backend crawler so you can miss them. User agent allows to get them whatever the IP is.

Ban via user agent

Create your .htaccess file or modify existing one and add the bots user agents with respecting values. Sample:

RewriteCond %{HTTP_USER_AGENT} .*Rapidmorebot.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Gigabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Yanga.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Baiduspider.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^AISearchBot.*
RewriteRule ^.* - [F]

What we did is we told the apache web server that if any request's user agent parameter matches the given values, redirect them to an access denied page.

.*etc*. shortly means, if includes the etc string in any position

^etc.* means if it begins with etc and goes with anything

[OR] means OR.  Note : If you leave the OR parameter, it will act as an AND and will not block any bots.

You can use regular expressions in Rewrite cond and rules. Search on the internet for more information. You can add or remove as many lines/bots as you desire

Ban via IP address

If they do not identify themselves or fake it, we are going to ban them via IP adresses.  You can specify single IP or IP ranges in them. Again create or modify your .htaccess. Insert your bot's IP into necessary fields and repeat them until you are all done.

order allow,deny
deny from 127.0.0.1 # only ban ip from #dddd
deny from 127.0.0.1/17 # ban through 1 to 17
allow from all # and allow the rest

You can edit these settings from your hosting cpanel management also.

Identifying Bots

We are not bulletproof althout we only let selected good ones, ban the ones we caught. There will be always new bots and updates to existing ones that can make ur settings and rules become invalid. We need to be upto date also. So how do we identify them?

1st General Knowledge

Of course you are not the only one facing this problem. People started to make lists and publish them because these bots annoyed them too much and they wanna help other people like you also. So here is some databases of known bots/spiders. Note : These databases are not upto date and they do not include all spiders, just the generally known ones. You should try to catch your manually and then consult these dbs to check your result.

http://www.robotstxt.org/db.html

http://www.iplists.com/

2nd via Hosting logs | Some stats analyzer

You can manually analyze your hosting logs, bandwith usage, pages to get most hit from singular ips or you can use an application like awstats or commercial solutions like weblogexpert to analyze your logs for you and create reports for you.

Awstats spider/bot list

Awstats identifies them by hits on robots.txt and user agent string. You can have the user agent but you are unprotected against unknown and IP values.

You can detect if any bots leeching on your website in easy analysis.

1. Did "time spent on webpage" decreased suddenly? Bots get a page and exit, so they stay less then 2-3 seconds in your page. Humans will be able to load the page in this time only. So if these ratio goes higher it means you have a spider inside. You can track it down by finding request IPs with short "spent time" values.
2. Did hits on a pages  increased suddenly? In general rules, you will attract visitors slowly, your hits wont be 10 one day and 1000 other day if everything working ok. You have a spider inside.
3. Did your bandwith increased suddenly? You have a spider leeching on u.

All these rules applies to awstats Hosts section, you can have their IP and their agents via spider db I gave previously. So lets analyze one of my Host sectiona and find bots manually via their IP. Lets analyze the IPs and area in red drawing.

Awstats Host section

1. line is a bot or a service (dns, ping, etc) no way a human being can hit that many pages in one day and spend 20mb bandwith. We download a page with its all attachments (images, scripts, styles) like a size of 400kb in my condition (pages are huge). But bots only download the text content, so its relatively small compared to the original size (7-8Kb). (cache is not included because i know it is a dynamic image page )
2. line is definitely a bot and pretty bad one (zoozle.net you should ban it!) wasted 1.5gb in one day! I hope you see the importance of eliminating bots on your system health now!
3. and so on.. they are all spiders - services crawling - pinging  the website.

3rd Setup a Bot Trap

Even your analyze can overlook some small but in time big trouble creator bots. What we can do is to setup a bot trap for them to fall in.  What we are going to do is to create a trap link which records visitors details. Publish that link on your website via invisible properties and then tell the good and obeying bots to not to go over forbidden zone. So whoever do not listen to what we say will be get tagged.  Method depends on if you want them in a database or in a logfile or via email.

1st Create a weird link in your web site like www.example.com/this-is-trap-dont-click-it/index.php and add

2nd contents of the .php file is

$ip 		= $_SERVER['REMOTE_ADDR'];
$host		= $_SERVER['HTTP_HOST'];
$agent 		= $_SERVER['HTTP_USER_AGENT'];
$referer	= $_SERVER['HTTP_REFERER'];
$time		= date("d.m.Y H:i");
// mail, write in log file or insert into db depending on your choice

3rd Put in your footer a link to that weird link and make the link same color as background color, or put an 1X1 transparent gif into the link. ie

<!-- Trap for bots. Human visitors please do not visit this adress -->
<a href="this-is-trap-dont-click-it/index.php"><img src="1_by_1pixel.gif" border="0"
alt="Please do not visit, its a trap for bots" width="1" height="1"/></a>

4th add these lines to your robots.txt. Which will tell good and obedient bots not to follow the link and get in trouble.

User-agent: *
Disallow: /this-is-trap-dont-click-it

So here our bot trap is set and finished finally. Analyze your trap logs and ban them via your criteries (leeching - new visitors ) and their behaviour.

Thats it, hope you enjoyed the post.