PHP - Automatically Generated Sitemap

Hello,

I have found the following code which creates a sitemap from the home directory of files. Please could you point me in the right direction for changing this so that it looks up from my sql database and for each name within the database creates an entry in the sitemap (e.g. www.mysite.com/[NAME]).

Thanks for your help,

Stu


Code: [Select]
<?php
/******************************************************************************\
 * Author : Binny V Abraham                                                   *
 * Website: http://www.bin-co.com/                                            *
 * E-Mail : binnyva at gmail                                                  *
 * Get more PHP scripts from http://www.bin-co.com/php/                       *
 ******************************************************************************
 * Name    : PHP Google Search Sitemap Generator                              *
 * Version : 1.00.A                                                           *
 * Date    : Friday 17 November 2006                                          *
 * Page    : http://www.bin-co.com/php/programs/sitemap_generator/   *
 *                                                                            *
 * You can use this script to create the sitemap for your site automatically. *
 *  The script will recursively visit all files on your site and create a *
 *  sitemap XML file in the format needed by Google.   *
 *                                                                            *
 * Get more PHP scripts from http://www.bin-co.com/php/                       *
\******************************************************************************/

// Please edit these values before running your script.
//////////////////////////////////// Options ////////////////////////////////////
$url = "http://www.WEBSITE_NAME.com/"; //The Url of the site - the last '/' is needed

$root_dir = ''; //Where the root of the site is with relation to this file.

$file_mask = '*.php'; //Or *.html or whatever - Any pattern that can be used in the glob() php function can be used here.

//The file to which the result is written to - must be writable. The file name is relative from root.
$sitemap_file = 'sitemap.xml'; 

// Stuff to be ignored...
//Ignore the file/folder if these words appear in the name
$always_ignore = array(
'local_common.php','images'
);

//These files will not be linked in the sitemap.
$ignore_files = array(
'404.php','error.php','configuration.php','include.inc'
);

//The script will not enter these folders
$ignore_folders = array(
'Waste','php_uploads','images','includes','lib','js','css','styles','system','stats','CVS','.svn'
);

//The default priority for all pages - the priority of all pages will increase/decrease with respect to this.
$starting_priority = ($_REQUEST['starting_priority']) ? $_REQUEST['starting_priority'] : 70;

/////////////////////////// Stop editing now - Configurations are over ////////////////////////////


///////////////////////////////////////////////////////////////////////////////////////////////////
function generateSiteMap() {
global $url, $file_mask, $root_dir, $sitemap_file, $starting_priority;
global $always_ignore, $ignore_files, $ignore_folders;
global $total_file_count,$average, $lowest_priority_page, $lowest_priority;

/////////////////////////////////////// Code ////////////////////////////////////
chdir($root_dir);
$all_pages = getFiles('');

$xml_string = '<?xml version="1.0" encoding="UTF-8"?>
<urlset
  xmlns="http://www.google.com/schemas/sitemap/0.84"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://www.google.com/schemas/sitemap/0.84
                      http://www.google.com/schemas/sitemap/0.84/sitemap.xsd">

<?php
# ';


$modified_priority = array();
for ($i=30;$i>0;$i--) array_push($modified_priority,$i);

$lowest_priority = 100;
$lowest_priority_page = "";
//Process the files
foreach ($all_pages as $link) {
//Find the modified time.
$handle = fopen($link,'r');
$info = fstat($handle);
fclose($handle);
$modified_at = date('Y-m-d\Th:i:s\Z',$info['mtime']);
$modified_before = ceil((time() - $info['mtime']) / (60 * 60 * 24));

$priority = $starting_priority; //Starting priority

//If the file was modified recently, increase the importance
if($modified_before < 30) {
$priority += $modified_priority[$modified_before];
}

if(preg_match('/index\.\w{3,4}$/',$link)) {
$link = preg_replace('/index\.\w{3,4}$/',"",$link);
$priority += 20;
}

//These priority detectors should be different for different sites :TODO:
if(strpos($link,'example')) $priority -= 30; //If the page is an example page
elseif(strpos($link,'demo')) $priority -= 30;
if(strpos($link,'tuorial')) $priority += 10;
if(strpos($link,'script')) $priority += 5;
if(strpos($link,'other') !== false) $priority -= 20;

//Priority based on depth
$depth = substr_count($link,'/');
if($depth < 2) $priority += 10; // Yes, I know this is flawed.
if($depth > 2) $priority += $depth * 5; // But the results are better.

if($priority > 100) $priority = 100;
$loc = $url . $link;
if(substr($loc,-1,1) == '/') $loc = substr($loc,0,-1);//Remove the last '/' char.


$total_priority += $priority;
if($lowest_priority > $priority) {
$lowest_priority = $priority;//Find the file with the lowest priority.
$lowest_priority_page = $loc;
}

$priority = $priority / 100; //The priority is given in decimals

$xml_string .= " <url>
  <loc>$loc</loc>
  <lastmod>$modified_at</lastmod>
  <priority>$priority</priority>
 </url>\n";
}

$xml_string .= "</urlset>";
if(!$hndl = fopen($sitemap_file,'w')) {
//header("Content-type:text/plain");
print "Can't open sitemap file - '$sitemap_file'.\nDumping result to screen...\n<br /><br /><br />\n\n\n";
print '<textarea rows="25" cols="70" style="width:100%">'.$xml_string.'</textarea>';
} else {
print '<p>Sitemap was written to <a href="' . $url.$sitemap_file .'">'. $url.$sitemap_file .'></a></p>';

fputs($hndl,$xml_string);
fclose($hndl);
}

$total_file_count = count($all_pages);
$average = round(($total_priority/$total_file_count),2);
}

///////////////////////////////////////// Functions /////////////////////////////////
// File finding function.
function getFiles($cd) {
$links = array();
$directory = ($cd) ? $cd . '/' : '';//Add the slash only if we are in a valid folder

$files = glob($directory . $GLOBALS['file_mask']);
foreach($files as $link) {
//Use this only if it is NOT on our ignore lists
if(in_array($link,$GLOBALS['ignore_files'])) continue; 
if(in_array(basename($link),$GLOBALS['always_ignore'])) continue;
array_push($links, $link);
}
//asort($links);//Sort 'em - to get the index at top.

//Get All folders.
$folders = glob($directory . '*',GLOB_ONLYDIR);//GLOB_ONLYDIR not avalilabe on windows.
foreach($folders as $dir) {
//Use this only if it is NOT on our ignore lists
$name = basename($dir);
if(in_array($name,$GLOBALS['always_ignore'])) continue;
if(in_array($dir,$GLOBALS['ignore_folders'])) continue; 

$more_pages = getFiles($dir); // :RECURSION: 
if(count($more_pages)) $links = array_merge($links,$more_pages);//We need all thing in 1 single dimentional array.
}

return $links;
}

//////////////////////////////// Display /////////////////////////////


?>
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.1 Transitional//EN">
<html>
<head>
<title>Sitemap Generation Using PHP</title>
<style type="text/css">
a {color:blue;text-decoration:none;}
a:hover {color:red;}
</style>
</head>
<body>
<h1>PHP Google Search Sitemap Generator Script</h1>

<?php
if($_POST['action'] == 'Create Sitemap') {
generateSiteMap();
?>
<h2>Sitemap Created...</h2>

<h2>Statastics</h2>

<p><strong><?php echo $total_file_count; ?></strong> files were found and indexed.<br />
Lowest priority of <strong><?php echo $lowest_priority; ?></strong> was
given to <a href='<?php echo $lowest_priority_page; ?>'><?php echo $lowest_priority_page; ?></a></p>

Average Priority : <strong><?php echo $average; ?></strong><br />

<h2>Redo</h2>
<?php } else { ?>

<p>You can use this script to create the sitemap for your site automatically. The script will recursively visit all files on your site and create a sitemap XML file in the format needed by Google. </p>

<p>You can customize the result by changing the starting priorities.</p>
 
<h2>Set Starting Priority</h2>
<?php } ?>

<form action="create_sitemap.php" method="post">
Starting Priority : <input type="text" name="starting_priority" size="3" value="<?php echo $starting_priority; ?>" />
<input type="submit" name="action" value="Create Sitemap" />
</form>

</body>
</html>

I have a simple php script that updates my sitemap automatically. However, when you click the link to the sitemap at www.bomstudies.com/sitemap-xml.php - the last mod date is showing 1969. The php script works for files that are not in sub folders. such as /talks or /commentary. I just need to know what snippet of code i should add, change, or delete to the sitemap php side of it to show the correct last mod date for my xml sitemap. I greatly appreciate your help.    Thanks -    Here is some of my code:   The Config Code: posted as config.php <?php

I wish to create a sitemap for a shopping cart and so far it seem this needs to be in XML format? is this true ?

If so are there any templates that I can use to base my sitemap on.

From my experience, using Google's sitemap generator to generate a sitemap is not that good. It creates page that you do not want to show up.  I am wondering what the best method is for creating a sitemap of a website so that only certain pages of the website show up on Google?

For the last 2 months I have purchased software and utilized free software to attempt to create a sitemap fro my websites   www.negroartist.com www.africanafrican.com   all of them fail and do not look at all links. i.e. look at a photo album with all the htm in the photo album.   Most of the windows based software do not work and often crash. I want it to index ALL of my site (except images, pdf etc)   Is there any php code, program etc. out there to help me through my dilemna that has instructions for configurabillity? I can also try anything that uses apache etc.   i am at my whits end with this. please help.   has anyone used bing sitemap plugin? how do you install this baby?   my links will total in the hundreds of thousands.   thanks :-)

So a project I have simply to learn how it is done is to make an auto updating sitemap with a auto submitter. I have been doing a little research on sitemaps but haven't found much in the way of a tutorial or white paper or similar, anyway I was wondering if I am on the right track or not.

What I was thinking for the auto-updating sitemap is since site maps are XML, when an article is published using my custom CMS/Blogging system, I make it rewrite the sitemap appending the new URL that will be generated.

Then for the auto-submit, I can either make it a cron job or just manual press, but it would go though a for list of URLs, replacing the end part with my site map url. I think that is how it would be done.

If you have a better idea, or can point out an article so I can understand a lot more with sitemaps, I will appreciate it, I am trying to learn as much as possible, I have gone to the offical website (sitemaps.org) but it doesn't have what I am looking for.

Thanks,

James

On a website currently under development the URL does not change when navigating around on the page. It always displays the root URL.

This is the script that should generate the links:

$URLvars=substr($_SERVER["PHP_SELF"], strrpos($_SERVER["PHP_SELF"],"/")+1);
$vatLink=$URLvars;
$thisPageURL=$_SERVER["PHP_SELF"];
if(strpos($thisPageURL, "secure/locktech/")!==false)$thisPageURL=substr($_SERVER["PHP_SELF"], 16);
$prodLink="http://www.lock-tech.co.uk".$thisPageURL;

It used to. However, the server has changed and it does not any more.

Is it maybe because the 2 paths (http://www.lock-tech.co.uk and secure/locktech/) must be changed according to the new server?

Does anyone know what exactly do these paths stand for? I understand that one of them is the root path but what does the path in the line Code: [Select]
if(strpos($thisPageURL, "secure/locktech/")!==false)$thisPageURL=substr($_SERVER["PHP_SELF"], 16);

stand for?

I'm trying to generate RSS by using PHP and MySQL but I keep getting an error message that I don't know how to solve.

Here's the error message:
<b>Deprecated</b>:  Function mysql_db_query() is deprecated in <b>G:\xampp\htdocs\xampp\dsa\class_rss.php</b> on line <b>32

Here's line 32:
Code: [Select]
$result = mysql_db_query (DB_NAME, $query, LINK);

Here's the entire code from the class:
Code: [Select]
<?
// code followed from http://www.webreference.com/authoring/languages/xml/rss/custom_feeds/
// images sourced: http://www.inyourbasket.com/search/usb-flash-drives/09A?cm_mmc_o=7BBTkw*Vzbp+mwzygt*JmP+4wFByY+mfbgLl*JmP+4wFByY+mfbgL+C+7wEwybg&gclid=CKuGh8DwyKcCFYFB4QodyGRvBg
class RSS
{
// function to include the file which holds global variables.
public function RSS()
{
require_once ('connectvars.php');
}

// function derived from both private functions.
public function GetFeed()
{
return $this->getDetails() . $this->getItems();
}

// function to connect to the database
private function dbConnect()
{
DEFINE ('LINK', mysql_connect (DB_HOST, DB_USER, DB_PASSWORD));
}

// function to retreive data from the table, and insert between set xml tags which loops through the rows in the table.
private function getDetails()
{
$stick = "stick,";
$location = "location,";
$identification = "identification";
$this->dbConnect($stick, $location, $identification);
$query = "SELECT * FROM ". $stick . $location . $identification;
$result = mysql_db_query (DB_NAME, $query, LINK);

while($row = mysql_fetch_array($result))
{
$details = '<?xml version="1.0" encoding="ISO-8859-1" ?>
<rss version="2.0">
<channel>
<title>'. $row['stick.make'] .'</title>
<description>'. $row['stick.colour'] . $row['location.street'] . $row['location.town'] . $row['location.city'] .'</description>
<image>
<url>'. $row['identification.image_url'] .'</url>
<width>'. $row['identification.image_width'] .'</width>
<height>'. $row['identification.image_height'] .'</height>
</image>';
}
return $details;
}

// function to iterate through the table, retreiving data each time and outputting an end result of an RSS structured page.
private function getItems()
{
$stick = "stick,";
$location = "location,";
$identification = "identification";
$this->dbConnect($stick, $location, $identification);
$query = "SELECT * FROM ". $stick . $location . $identification;
$result = mysql_db_query (DB_NAME, $query, LINK);
$items = '';
while($row = mysql_fetch_array($result))
{
$items .= '<item>
<title>'. $row["stick.make"] .'</title>
<description><![CDATA['. $row["stick.colour"] .']]></description>
</item>';
}
$items .= '</channel>
</rss>';
return $items;
}

}

?>
Could anyone help me out here?
Thanks

I have something like this on one of my pages:
$name = 'Bob';

Code: [Select]
if ((isset($_POST['name'])) || ($_POST['name'] == ''))
  {
  $name = $_POST['name'];
  //update database
  }

echo '<form action='' method='POST'>';
echo '<table><tr><td width="125">Name: </td><td><input type="text" name="signature" style="width: 270px;" value="' . $name . '" /></td></tr></table>';
echo '</form>';
Here's the problem:
Initially, because the form data has not been sent the input box says: 'Bob'.  If I remove the name Bob from the input box by manually clicking in it and deleting the name, and I submit the form, it keeps showing 'Bob', whereas I would like it to be empty.  What am I doing wrong?

My PHP code is generating XML with a blank first line before the  <?xml version="1.0" ?>

see http://urbanbees.co.uk/maps/phpsqlajax_genxml3.php

I have been told this is the reason why my map is not showing the markers in chrome and FF but it is OK in IE8. see http://urbanbees.co.uk/maps/map_of_hive_locations_update.htm  You'll either see markers or not depending on your broswer.

How do I change the code to not generate this first blank line.

Here is the php code.
<?php
require("phpsqlajax_dbinfo.php");
// Start XML file, create parent node
$dom = new DOMDocument("1.0");
$node = $dom->createElement("markers");
$parnode = $dom->appendChild($node);
// Opens a connection to a MySQL server
$connection=mysql_connect (localhost, $username, $password);
if (!$connection) {  die('Not connected : ' . mysql_error());}
// Set the active MySQL database
$db_selected = mysql_select_db($database, $connection);
if (!$db_selected) {
  die ('Can\'t use db : ' . mysql_error());
}
// Select all the rows in the markers table
$query = "SELECT * FROM markers WHERE 1";
$result = mysql_query($query);
if (!$result) {   
  die('Invalid query: ' . mysql_error());
} 
header("Content-type: text/xml"); 
// Iterate through the rows, adding XML nodes for each
while ($row = @mysql_fetch_assoc($result)){   
  // ADD TO XML DOCUMENT NODE   
  $node = $dom->createElement("marker");   
  $newnode = $parnode->appendChild($node);   
  $newnode->setAttribute("name",$row['name']);
  $newnode->setAttribute("address", $row['address']);   
  $newnode->setAttribute("lat", $row['lat']);   
  $newnode->setAttribute("lng", $row['lng']);   
  $newnode->setAttribute("type", $row['type']);
} 
echo $dom->saveXML();
?>

Hi.

I have a rating site where users fill in a name of what they are rating, comments about it and a rating and submit it to my database. I then have another page which shows all of these entries but only the name and overall rating using php.

What I want is for users to click on the name and it take them to a separate page which displays all the comments and ratings for that item. As users can add items to rate I cant set up a page for each manually so was wondering how to do it dynamically. Everything i throw into google leads me in the wrong direction though. If someone could point me to a good tutorial or give me an idea about what to search id be very grateful.

Cheers.

Hi,

I am trying to get some charecters to display properly in emails that are sent via a form on my site.

The finnish characters &auml; and &ouml; come out as squares when viewed in Outlook. I have tried various encoding types such as UTF-8 and Western European (dreamweaver), both as the script encoding and as the encoding in the mail() function.



$body = 'S&auml;hk&ouml;posti:' ;

mail($salesEmail, "Call Back Request", $body, "MIME-Version: 1.0\r\nContent-type: text/html; charset=utf-8\r\nFrom: $salesEmail") ;


= 'S�hk�posti:' or just squares in Outlook.

I have also tried hard coding them as &auml; and &ouml; and the symbol literals to no effect.

Does anyone know what is causing this?

Hi,

I have a question here. Currently my $tutor_id is auto incremental in my SQL, and it is in running numbers.

However I will like to add a 'T' in front of the id.

Example:

Currently, our id number is
1
2
3
4
etc.

Would like to achieve
T1
T2
T3
T4
etc.

How do I do it? Below is my code as well. Please kindly advise. Thanks


/**INSERT into tutor_id table to create a new id for new tutors**/
   $query = "INSERT INTO tutor_id (id) " .
   "VALUES ('$id')";
   
   $results = mysqli_query($dbc, $query)
   or die(mysqli_error());

   $tutor_id = mysqli_insert_id($dbc);

/**INSERT into tutor table**/
   $query1 = "INSERT INTO tutor (tutor_id, email) " .
   "VALUES ('$tutor_id', '$email')";
   
   $results1 = mysqli_query($dbc, $query1)
   or die(mysqli_error());

Ok, so I currently have this http://pastebin.com/cCgyavs0 snippet that generates links to the previous, next and last page based on the current page (GET variable) or the total item count in the MySQL DB to then use forms as links by inserting the URLs into the action attribute. I did this cause I don't wanna use images as links, btw :P

It kinda works - I get links like:

shop.php?page=1
shop.php?page=12
shop.php?page=14
shop.php?page=225

When I'm on page 13 of 225 for example.

Though when I click one of the buttons, I always get redirected to "shop.php?".

:/

I'm not sure of the appropriate subject line for this feature, but hopefully I'm close.  I'll try to describe what I'm trying to do.  The most common place you see this is on web based file uploads so I'll use it as my example.

Let's say I want to allow my user to upload files so there is a text box where they enter the file name.  The user is allowed to upload as many files as he wants with 1 push of the submit button.

Upon the loading of the form, there will be 5 textboxes for file upload, but if the user wants to upload more than 5 files, there is a link that is clicked and I think via ajax or javascript another textbox will be added.  The user can do this for as many files he wants to upload.  This is what it looks like to the user, but then when the form is submitted how are these variables referenced?

So how is this setup in the main form and how are the variables referenced after form submission?

If anyone can point me to a good web tutorial on this type of thing I would appreciate it.

Thanks

Carl