Test 20: Find name of director of movie from wikipedia website

Test:

Given a wikipedia page for any movie. Find the name of director of movie.

Learning: 

use of Mojo::DOM to read text of any tag
use /regex/s to consider space also, like /By director/ wont work but /By director/s will work

---

Solution:

use WWW::Mechanize;
use WWW::Mechanize::Link;
use Mojo::DOM;

my $m = WWW::Mechanize->new();
$m->get("http://en.wikipedia.org/wiki/Kal_Ho_Naa_Ho");


$c=$m->content();

(my $a) = $c =~ /Directed by(.*?\/a>)/s;

my $dom = Mojo::DOM->new($a);
print $dom->at('a')->text;

---

output snapshot:

Test 19: Enter a keyword(product name) in google and find the company which offers that product at minimum cost in google result

Test:

Take a keyword(Product name) from STDIN and find the prices and companies name displayed by google result. print the minimum price and company. If item not found, print - no shoppable item

Learning: 

get content and use regex. 

---

Solution:

use WWW::Mechanize;
use WWW::Mechanize::Link;
print "Enter the keyword\n";
chomp($key=<STDIN>);

my $m = WWW::Mechanize->new();
$m->get("http://www.google.com");

$m->submit_form(
      form_number => 1,
      fields    => { q  => $key},
  );

$m->click_button(name=>"btnG");
$c=$m->content();

print ABC $c;

if($c !~ /Shop for .*? on Google/)
{
print "no shoppable item\n";
exit;
}

(@links)=$c =~ /(Rs\.\s.*?)<.*?wrap\">(.*?)<\/cite>/g;


$len=@links;
@price=();
for($i=0;$i<$len;$i++)
{

$links[$i] =~ s/Rs\..*?(\d)/Rs\.$1/;
print "$links[$i] $links[$i+1]" ;
$links[$i] =~ s/Rs\.//;
$links[$i] =~ s/,//;
push(@price,$links[$i]);
$i++;
print "\n";
}
@price=sort{$a<=>$b}@price;
$min=$price[0];
print "\nLowest price is $min by ";
for($i=0;$i<$len;$i++)
{
if($links[$i] =~ /$min/)
{
print "$links[$i+1]\n";
exit;
}
$i++;
}

---

output snapshot:

Test 18: Put a keyword to google and find top 5 results

Test:

Take a keyword from STDIN and print top 5 google result for that keyword

Learning: 

get content and use regex. Google uses <b> for keywords

---

Solution:

use WWW::Mechanize;
use WWW::Mechanize::Link;
print "Enter the keyword\n";
chomp($key=<STDIN>);


my $m = WWW::Mechanize->new();
$m->get("http://www.google.com");

$m->submit_form(
      form_number => 1,
      fields    => { q  => $key},
  );

$m->click_button(name=>"btnG");
$c=$m->content();


(@links)=$c =~ /href.*?>(.*?)<\/a>/g;

$count=1;
foreach(@links)
{
if($_ =~ /<b>/)
{
$count++;
$_ =~ s/<b>//g;
$_ =~ s/<\/b>//g;
print $_;
print "\n\n";
if($count>5)
{
exit;
}
}
}

---

output snapshot:

Test 17: Print ALT text and URL of all images in a page

Test:

Get all images of a page and print ALT text and URL

Learning: 

$m->images() is used for images

---

Solution:

use WWW::Mechanize;

my $m = WWW::Mechanize->new();
$m->get("http://vienna.yapceurope.org/ye2007/search");
@arr=$m->images();
$count=1;
foreach(@arr)
{
print "Image $count \n";
$tmp=$_->alt;
print "ALT is $tmp\n";
$tmp=$_->url;
print "URL is $tmp\n\n";
$count++;
}

---

output snapshot:

Test 16: show various direct methods with Mech

Test:

Use the methods which can be directly used with $m->

Learning: 

Various direct methods with $m->

---

Solution:

use strict;
use warnings;

use WWW::Mechanize;

my $m = WWW::Mechanize->new();
$m->get("http://www.rediff.com");

print "URL is- ".$m->uri()."\n";

print "Status code is- ".$m->status()."\n";

print "Content type is- ".$m->content_type()."\n";

print "Base URI is- ".$m->base()."\n";

print "is content HTML- ".$m->is_html()."\n";

print "title is- ".$m->title()."\n";

---

output snapshot:

Test 15 :Set up new user agent and verify the request is sent via that user agent

Test:

Set up new user agent and verify the request is sent via that user agent

Learning: 

$mech->agent_alias( 'Windows IE 6' ); is used to set user agent.

possible UA can be:

• Windows IE 6
• Windows Mozilla
• Mac Safari
• Mac Mozilla
• Linux Mozilla
• Linux Konqueror

---

Solution:

use WWW::Mechanize;

my $mech = WWW::Mechanize->new();
$mech->agent_alias( 'Windows IE 6' );
$mech->get('http://whatsmyuseragent.com/');
my $data = $mech->content;

(my $ua)= $data =~ /<h2 class="info">(.*)<\/h2>/;

print $ua;

---

output snapshot:

Test 14: Print values of form fields, update them and print new values

Test:

Get values of all fields of a form, update the values and then print new values

Learning: 

$form->value used to get values

---

Solution:

use strict;
use warnings;

use WWW::Mechanize;

my $m = WWW::Mechanize->new();
$m->get("http://vienna.yapceurope.org/ye2007/search");

my $count = 1;
for my $form ($m->forms) 
{
    print "form $count fields are:\n";
    $count++;
    for ($form->param) 
{
        printf "%s - %s\n", $_, $form->value($_);
    }
    print "\n";
}

$m->submit_form(
    form_number => 1,
    fields    => { name  => 'honey', town => 'Delhi', country =>

'india', pm_group => 'Cam.pm'},
);

$count = 1;
print "After filling data to form\n";
for my $form ($m->forms) 
{
    print "form $count fields are:\n";
    $count++;
    for ($form->param)
{
        printf "%s - %s\n", $_, $form->value($_);
    }
    print "\n";
}

---

output snapshot:

Test 13: Check if requested is redirected to other url

Test:

Request for a URL and check if same URL was opened or it is redirected to some other URL

Learning: 

$response->request->uri; is used to get uri. It should be used with use LWP::UserAgent

---

Solution:

use LWP::UserAgent qw();

my $ua = LWP::UserAgent->new;
my $response = $ua->get('http://www.google.com');
$tmp=$response->request->uri;
if($tmp eq 'http://www.google.com')
{
print "no redirection\n";
}
else
{
print "redirected to $tmp\n";
}

---

output snapshot:

Test 12: Enter a keyword in search box, submit the form and check title of result page

Test:

Enter a value in a form of a page, submit the form and check title of resulting page

Learning: 

submit_form is used to submit a form

---

Solution:

use WWW::Mechanize;
use LWP::UserAgent;
my $m = WWW::Mechanize->new();
$m->get( "http://en.wikipedia.org/wiki/Main_Page" );
$m->submit_form(
    form_number => 1,
    fields    => { search  => 'honey', },
    button    => 'go'
);
$tmp=$m->title;
print "$tmp\n";

---

output snapshot:

Test 11: Find fields of all forms in a page

Test:

Find fields of all forms in a page

Learning: 

 param is used to get fields of a form

---

Solution:

use WWW::Mechanize;
use LWP::UserAgent;
my $m = WWW::Mechanize->new();
$m->get( "http://www.rediff.com/" );
@arr=$m->forms;
$count=1;
foreach (@arr)
{
my @inputfields = $_->param;
print "form $count fields are:\n";
$count++;
foreach(@inputfields)
{
print "$_\n";
}
  print "\n";      
  }

---

output snapshot:

Test 10: Find a url in webpage by keyword

Test:

Given a keyword, find all url having that keyword

Learning: 

 $m->find_all_links(
    tag => "a", text_regex => qr/keyword/i ); used to find keyword in url

---

Solution:

use WWW::Mechanize;
my $m = WWW::Mechanize->new();
$m->get( "http://www.google.com/" );

my @links = $m->find_all_links(
    tag => "a", text_regex => qr/history/i );


foreach(@links)
{
$tmp=$_->text;
print "$tmp\n";
$tmp=$_->url;
print "$tmp\n";
}

---

output snapshot:

Test 9: Check that all links of webpage can be accessed successfully

Test:

Check that all links of webpage can be accessed successfully

Learning: 

get( $link->url ) will take care of relative URL also

---

Solution:

#!/usr/bin/perl
use Test::More;
use LWP::Simple;
use WWW::Mechanize;

#define number of planned test cases
plan tests => 700; 

my $m = WWW::Mechanize->new();
$m->get( "http://www.google.com/" );

ok( $m->success, 'Fetched OK' );

for my $link ( $m->links )
{
$m->get( $link->url );
print $link->text."\n".$link->url."\n";
ok( $m->success);
$m->back();
ok( $m->success, "Back successful");
print "\n";
}

---

output snapshot:

Test 8: Follow link by different methods

Test:

Follow links by different methods and check if correct link is opened

Learning: 

Use WWW::Mechanize

$m->follow_link to follow links of a page.
We will open google.com, then images link, then back and repeat few times.

---

Solution:

use Test::More;
use WWW::Mechanize;

#define number of planned test cases
plan tests => 8; 

my $m = WWW::Mechanize->new();
$m->get( "http://www.google.com/" );

#Calling a link by text
$m->follow_link(text=>'Images');
ok($m->title eq "Google Images", "pass");
$m->back();
ok($m->title eq "Google", "pass");

#Calling a link by number
$m->follow_link(n=>1);
ok($m->title eq "Google Images", "pass");
$m->back();
ok($m->title eq "Google", "pass");

#Calling a link by text regex
$m->follow_link(text_regex=>qr/Ima/);
ok($m->title eq "Google Images", "pass");
$m->back();
ok($m->title eq "Google", "pass");

#Calling a link by url regex
$m->follow_link(url_regex=>qr/img/);
ok($m->title eq "Google Images", "pass");
$m->back();
ok($m->title eq "Google", "pass");

---

output snapshot:

Test 7: Get all links from a page and display their text and url addresses

Test:

Get all links from a page and display their text and url addresses

Learning: 

Use WWW::Mechanize

$m->links to get all links of a page

---

Solution:

use WWW::Mechanize;
my $m = WWW::Mechanize->new();
$m->get( "http://www.google.com/" );
@arr=$m->links;
$count=1;
foreach (@arr)
{
print "link $count--";
$count++;
print $_->text."\n\t".$_->url."\n\n" ;
}

---

output snapshot:

Test 6: Get title using Mechanize

Test:

Get title of a webpage using Mechanize

Learning: 

Use WWW::Mechanize
Mechanize->new() with get to get content of a page

---

Solution:

use WWW::Mechanize;
my $m = WWW::Mechanize->new();
$m->get( "http://www.google.com/" );
print $m->title, "\n";

---

output snapshot:

Test 5: Print meaning of status code received from server

Test:

Check http response code received from network for a webpage and display its meaning like 200 means OK

Learning: 

Use LWP::Simple

getmirror($url, $file) returns data received from network followed by response code. Data is saved to file.

is_success($variable) is used for success cases.
is_error($variable) is used for error cases
status_message($variable) is used to get meaning of error code

Code received by network can be:

RC_CONTINUE
   RC_SWITCHING_PROTOCOLS
   RC_OK
   RC_CREATED
   RC_ACCEPTED
   RC_NON_AUTHORITATIVE_INFORMATION
   RC_NO_CONTENT
   RC_RESET_CONTENT
   RC_PARTIAL_CONTENT
   RC_MULTIPLE_CHOICES
   RC_MOVED_PERMANENTLY
   RC_MOVED_TEMPORARILY
   RC_SEE_OTHER
   RC_NOT_MODIFIED
   RC_USE_PROXY
   RC_BAD_REQUEST
   RC_UNAUTHORIZED
   RC_PAYMENT_REQUIRED
   RC_FORBIDDEN
   RC_NOT_FOUND
   RC_METHOD_NOT_ALLOWED
   RC_NOT_ACCEPTABLE
   RC_PROXY_AUTHENTICATION_REQUIRED
   RC_REQUEST_TIMEOUT
   RC_CONFLICT
   RC_GONE
   RC_LENGTH_REQUIRED
   RC_PRECONDITION_FAILED
   RC_REQUEST_ENTITY_TOO_LARGE
   RC_REQUEST_URI_TOO_LARGE
   RC_UNSUPPORTED_MEDIA_TYPE
   RC_INTERNAL_SERVER_ERROR
   RC_NOT_IMPLEMENTED
   RC_BAD_GATEWAY
   RC_SERVICE_UNAVAILABLE
   RC_GATEWAY_TIMEOUT
   RC_HTTP_VERSION_NOT_SUPPORTED

---

Solution:

#!/usr/bin/perl

use Test::More;
use LWP::Simple;
use HTTP::Status;

#define number of planned test cases
plan tests => 2; 

#URL under test
my @url = qw("http://www.google.com" "http://www.iamperl.com");

for($i=0;$i<@url;$i++)
{
my $content = mirror($url[$i],abc); 
$a = status_message($content);
if($content == 200)
{
ok(is_success($content), "Http response code is $content which 

means $a");
}
else
{
ok(is_error($content), "Http response code is $content which 

means $a");
}
}

---

output snapshot:

Test 4: Continue to test if response code is 200, otherwise exit test

Test:

Check http response code received from network for a webpage and continue furthur test case only if response code is 200

Learning: 

Use LWP::Simple
getstore($url, $file) returns data received from network followed by response code. Data is saved to file.
For sucess cases, http response code should be 200.

---

Solution:

#!/usr/bin/perl

use Test::More;
use LWP::Simple;

#define number of planned test cases
plan tests => 1; 

#URL under test
my $url = "http://www.google.com";

#getting content of webpage with http response code and store in file abc
my $content = getstore($url,abc); 

#get response code
(my $response)= $content =~ /(\d*)/;

if($response ne "200")
{
ok($response eq "200", "Http response code is not 200 showed 

$response");
exit;
}
ok($response eq "200", "Http response code is 200..we can continue of test");

#if below line is printed means 200 was received as response code and we are 

running next test case now
print "test case 2\n";

---

output snapshot:

Test 3: Check the http response code from network

Test:

Check http response code received from network for a webpage and display result

Learning: 

Use LWP::Simple
getprint($url) returns data received from network followed by response code.
For sucess cases, http response code should be 200.

We will test 2 cases, one with error code 200 taking a valid website and other with error code 500 taking invalid website.

---

Solution:

#!/usr/bin/perl

use Test::More;
use LWP::Simple;

#define number of planned test cases
plan tests => 2; 

#URL under test
my $url1 = "http://www.google.com";
my $url2 = "http://www.iamperl.com";

#getting content of webpage with http response code
my $content1 = getprint($url1); 
my $content2 = getprint($url2); 

#get response code
(my $response1)= $content1 =~ /(\d*)/;
(my $response2)= $content2 =~ /(\d*)/;

ok($response1 eq "200", "Http response code showed $response1");
ok($response2 eq "200", "Http response code showed $response2");

---

output snapshot:

Test 2: Check content type and charset of webpage

Test:

Check content type and charset of webpage and display result

Learning: 

Use LWP::Simple
Use head($url) to get document headers. Returns the following 5 values if successful: ($content_type, $document_length, $modified_time, $expires, $server)

---

Solution:

#!/usr/bin/perl

use Test::More;
use LWP::Simple;

#define number of planned test cases
plan tests => 2; 

#URL under test
my $url = "http://www.google.com";

#getting header of webpage
my @content = head($url); 

#get content type
(my $content_type)= $content[0] =~ /(.*)\;/;

ok($content_type eq "text/html", "Content type showed $content_type");

#get charset
(my $charset)= $content[0] =~ /charset=(.*)/;

ok($charset eq "ISO-8859-1", "Charset showed $charset");

---

output snapshot:

Test 1: Check the title of webpage

Test:

Check the title of webpage and display result

Learning: 

Use LWP::Simple
It allows you to get content of any webpage by a simple code- get($url)

---

Solution:

#!/usr/bin/perl

use Test::More;
use LWP::Simple;

#define number of planned test cases
plan tests => 1; 

#URL under test
my $url = "http://www.google.com";

#getting source code of webpage
my $content = get($url); 

#Search string between <title> and</title>
(my $str)= $content =~ /<title>(.*)<\/title>/;

ok($str eq "Google", "Title of $url showed $str");

---

output snapshot: