[sharif_aly]

Do you know the idea of fetch data from Html by PHP and save it to database ?

[End User]

Originally Posted by sharif_aly

Do you know the idea of fetch data from Html by PHP and save it to database ?

Yes, I know that idea quite well. It's a great idea and I highly recommend it.

[Keith]

All these years, why haven't I thought of that?!

[sharif_aly]

why you say that ??

what i really mean is there is a website i want fetch data from it by some how like yahoo movies and i want fetch information about a movie to add it somehow to mysql data base i just want to know the idea of fetching data so i can do it on any kind of website to get data like wikipedia or any other site .

[End User]

Originally Posted by Keith

All these years, why haven't I thought of that?!

It was just so bloody obvious, we missed it. And all this time I've been calling the sysadmin and asking him what was on the screen...

[End User]

Originally Posted by sharif_aly

why you say that ??

We were just being funny. In theory, anyway. At least it should have been funny to anyone who didn't have their humor gland shot off in the war.

Originally Posted by sharif_aly

what i really mean is there is a website i want fetch data from it by some how like yahoo movies and i want fetch information about a movie to add it somehow to mysql data base i just want to know the idea of fetching data so i can do it on any kind of website to get data like wikipedia or any other site .

You could use cURL to retrieve the data, then do some post-processing on the result and then stick it in the database. That's the way I've always done it. I'd recommend grabbing the entire raw page and storing that, then you can do the post-processing at your leisure without hammering the target site to death.

[sharif_aly]

End User : can you make an example please.

[End User]

Originally Posted by sharif_aly

End User : can you make an example please.

I thought I just did. (??) Or are you asking for some sample code?

This assumes you have an array of URLs in "$URL" and a table named "savedpages" with a column named "thepage".

PHP Code:

// make a mysql connection here, etc etc



start retrieving pages.....

foreach($URL as $myurl){



// get the page....

$ch = curl_init();

curl_setopt($ch, CURLOPT_URL, 'http://www.example.com');

curl_setopt($ch, CURLOPT_HEADER, 1);

curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);

$data = curl_exec();  // page data is in $data

curl_close($ch);



// do some processing of the data here if you want...

$data = my_cool_function($data);



// Then insert the information into the table "savedpages"

$query = "INSERT INTO savedpages (thepage) VALUES ('$data')";  



$result = mysql_query($query) or die(mysql_error());



} // end foreach 

[sharif_aly]

Thank you for the code

but why this way why not HTML parser ?

[Keith]

my_cool_function() in the above example would be where you'd handle the parsing.