PHP - Site Loading Slow? Is That Due To My Template

Hi,

I coded this website in php
http://www.3gar.info
but it seem very slow. I checked the server but they said everything is ok and the website run smoothly in server. I have another copy of this website in hostmonister it run very fast there.
http://www.ibuj.org

Ok, so basically someone submits a file (doc) and I need to see if it is the same as another file. So instead of opening 300+ files and checking for word similarity, I put the file info into a table called newnotes. Then check the file size for each of the notes in "newnotes" against all of the notes in the table "approvednotes" this could be something like matching 20 file sizes to 300+ file sizes. The user gets returned back to a page and this is all done in backend by the click of a button the admins can use. But would doing this slow down my server/website?

hey i have a problem when i try to send email through php it seems to take a long time somethings it can be there quickly but somethings it takes forever
is it something im doing wrong in the short script this is part of my script



Code: [Select]
                                                       // email profile owner
$webmaster = "admin@website.com";
$headers = "From: mywebsite<$webmaster>";
$subject = "$username has commented on your profile";
$message = "Hello $firstname $lastname. $username has posted a comment on your profile on mywebsite.com";
$message .= " The message $username has posted with is below.\n";
$message .= "\n****************************************************************\n";
$message .= "$comment";
$message .= "\n\n****************************************************************\n\n";
$message .= "Click here to view $username's profile $site/profile?id=$userid\n";
$message .= "Click here to view your profile $site/profile?id=$getid\n";
// send email
mail($email, $subject, $message, $headers);

Hi,

I am having a problem with a part of my query:


"SELECT SQL_CALC_FOUND_ROWS 
jobs.id AS jobId, enquiries.id AS profId, users.username, entity_details.name AS entityName,
 branches.name AS branch, orderNumber,
 entity_vat_numbers.vatCode, entity_account_numbers.accountNumber,
 
 (SELECT symbol
  FROM parts_trading, currencies
  WHERE parts_trading.enquiryRef = enquiries.id
  AND parts_trading.sellingCurrency = currencies.id
  LIMIT 1)
 AS symbol,
 
 (SELECT SUM(quantity) FROM parts_trading WHERE enquiryRef = enquiries.id)
 -
 COALESCE((SELECT SUM(quantity) FROM invoices_out_reference WHERE jobRef = jobs.id), 0)
 AS differentPartsCount,
 
 (SELECT SUM(quantity*sellingNet) FROM parts_trading WHERE parts_trading.enquiryRef = enquiries.id)
 -
 COALESCE(
  (SELECT SUM(invoices_out.net)
 FROM invoices_out, invoices_out_reference
 WHERE invoices_out_reference.invoiceRef = invoices_out.id
 AND invoices_out_reference.jobRef = jobs.id
  )
 , 0)
 AS netRemaining,
 
 (SELECT SUM(quantity*sellingVat) FROM parts_trading WHERE parts_trading.enquiryRef = enquiries.id)
 -
 COALESCE(
  (SELECT SUM(invoices_out.vat)
 FROM invoices_out, invoices_out_reference
 WHERE invoices_out_reference.invoiceRef = invoices_out.id
 AND invoices_out_reference.jobRef = jobs.id
  )
 , 0)
AS vatRemaining,

(SELECT SUM(quantity*(sellingNet+sellingVat)) FROM parts_trading WHERE parts_trading.enquiryRef = enquiries.id)
 -
 COALESCE(
  (SELECT SUM(invoices_out.net+invoices_out.vat)
 FROM invoices_out, invoices_out_reference
 WHERE invoices_out_reference.invoiceRef = invoices_out.id
 AND invoices_out_reference.jobRef = jobs.id
  )
 , 0)
AS totalRemaining
 
 FROM jobs, enquiries, users, branches, entity_details
 LEFT JOIN entity_account_numbers ON entity_details.id = entity_account_numbers.entityRef
 LEFT JOIN entity_vat_numbers ON entity_details.id = entity_vat_numbers.entityRef
 WHERE enquiries.traderRef = users.id
 AND jobs.enquiryRef = enquiries.id
 AND users.branchRef = branches.id
 AND (SELECT SUM(quantity) FROM parts_trading WHERE enquiryRef = enquiries.id)
 -
 COALESCE((SELECT SUM(quantity) FROM invoices_out_reference WHERE jobRef = jobs.id), 0) > 0
 AND enquiries.entityRef = entity_details.id"


I know for certain that it is the part:


"AND (SELECT SUM(quantity) FROM parts_trading WHERE enquiryRef = enquiries.id)
 -
 COALESCE((SELECT SUM(quantity) FROM invoices_out_reference WHERE jobRef = jobs.id), 0) > 0"


That is causing the problem.

Unfortunately this is a vital part of my query used for not displaying rows that have quantities matching the sum of what is in the other table .

Is there are more efficient way to get the same result than that part of the query?

I am aiming to use setcookie to refresh the expiry of a cookie on EVERY page request.

Is this slow? I'm sure I can design things so i don't need to reset it on every page request, but if it isn't a big deal then I'll do it.

Is setcookie slow?

I have swift mailer setup to send two message and plain and HTML. I have followed a lot of different posts and came up with a solution that works. However when I send for example 7k emails only about 500 made it out before the 30sec timeout. So I switched my timeout to 600secs and only about 3k made it out.

I now I can switch my timeout to 0 or 3600sec and it will go through but it doesnt seem like this should take so long.

I use Debian 6.0, Zimbra 7, Postfix, and SwiftMailer

I am using the mailer like this;

/ Create the Transport
$transport = Swift_SmtpTransport::newInstance('localhost', xx)
->setUsername('xxx')
->setPassword('xxx')
;

// Create the Mailer using your created Transport
$mailer = Swift_Mailer::newInstance($transport);

//Starts the loop to separate the to email addresses everything past here is built for each email
$to1 = explode(", ", $to);
for($i = 0; $i < count($to1); $i++){

// Create a message
$message = Swift_Message::newInstance($subject)
->setFrom(array($from => 'xxx'))
->setTo(array($to1[$i]))
->setBody($plaintxt)
->addPart($htmltxt, 'text/html');

$plaintxt = substr($plaintxt, 0, -$plaindumplength);
$htmltxt = substr($htmltxt, 0, -$dumplength);

$emailcounter += $mailer->send($message);
}

Ok so I have a single mySQL database on a dedicated server hosted through hostgator..

In this database I have 1 table that is a very large table it has well over 900,000 rows on it and we anticipate another 8.1 million records to be added within another 6 months and from there expect the table to grow regularly. Right now my issue is and can only foresee it getting worse as the size gets larger. Is that my queries are running slower and slower. Sometimes even resulting in the DB crashing. So what I am trying to figure out is how do I speed this up. I've tried 101 ways to query the DB to speed it up and can't get it to load 10 results 10.. in less than 30 seconds. I know some of my issue is the fact that I need distinct results or unique ones rather. As there are several duplicate entries but I only need to pull out one of each for this particular function which is a search.

So that said is there any advice one can give me to speed up my query results. I would offer up a sample of my current queries but its just your common query using distinct.

I have the following simple code to test against collision on a primary key I am creating:

Code: [Select]
        $machine_ids = array();
for($i = 0; $i < 100000; $i++) {
//Generate machine id returns a 15 character alphanumeric string
                $mid = Functions::generate_machine_id();

if(in_array($mid, $machine_ids)) {
die("Collision!");
} else {
$machine_ids[] = $mid;
}
}

die("Success!");

Any idea why this is taking minutes to run? Anyway to speed it up?

Hi everyone, I have a data analysis system which, however, takes too long to insert data into the db. Can you help me understand where I went wrong? thank you

DB MYSQL:

1 analytics_number bigint(20) AUTO_INCREMENT
2 visitor_visitor_id varchar(50) utf8mb4_general_ci
3 visitor_session_id varchar(50) utf8mb4_general_ci
4 visitor_pageview_id varchar(50) utf8mb4_general_ci
5 visitor_visitor_sessions bigint(20)
6 visitor_visitor_session bigint(20)
7 visitor_visitor_pageviews bigint(20)
8 visitor_visitor_pageview bigint(20)
9 visitor_visitor_time bigint(20)
10 visitor_visitor_pages text utf8mb4_general_ci
11 visitor_visitor_first_page text utf8mb4_general_ci
12 visitor_visitor_last_page varchar(50) utf8mb4_general_ci
13 visitor_session_pageviews bigint(20)
14 visitor_session_pageview bigint(20)
15 visitor_session_time bigint(20)
16 visitor_session_pages text utf8mb4_general_ci
17 visitor_session_landingpage varchar(500) utf8mb4_general_ci
18 visitor_session_exitpage varchar(500) utf8mb4_general_ci
19 visitor_session_first_page varchar(50) utf8mb4_general_ci
20 visitor_session_last_page varchar(50) utf8mb4_general_ci
21 visitor_enter_timestamp varchar(50) utf8mb4_general_ci
22 visitor_enter_id varchar(50) utf8mb4_general_ci
23 visitor_enter_year int(11)
24 visitor_enter_month int(11)
25 visitor_enter_weekday int(11)
26 visitor_enter_day int(11)
27 visitor_enter_hour int(11)
28 visitor_enter_minute int(11)
29 visitor_leave_timestamp varchar(50) utf8mb4_general_ci
30 visitor_leave_id varchar(50) utf8mb4_general_ci
31 visitor_country varchar(50) utf8mb4_general_ci
32 visitor_country_code varchar(50) utf8mb4_general_ci
33 visitor_region varchar(100) utf8mb4_general_ci
34 visitor_region_code varchar(50) utf8mb4_general_ci
35 visitor_city varchar(100) utf8mb4_general_ci
36 visitor_zip int(11)
37 visitor_lat varchar(100) utf8mb4_general_ci
38 visitor_lon varchar(100) utf8mb4_general_ci
39 visitor_timezone varchar(100) utf8mb4_general_ci
40 visitor_isp varchar(100) utf8mb4_general_ci
41 visitor_language varchar(50) utf8mb4_general_ci
42 visitor_device varchar(100) utf8mb4_general_ci
43 visitor_device_brand varchar(100) utf8mb4_general_ci
44 visitor_device_model varchar(100) utf8mb4_general_ci
45 visitor_os varchar(100) utf8mb4_general_ci
46 visitor_os_version varchar(100) utf8mb4_general_ci
47 visitor_browser varchar(100) utf8mb4_general_ci
48 visitor_browser_version varchar(100) utf8mb4_general_ci
49 visitor_resolution varchar(50) utf8mb4_general_ci
50 visitor_viewport varchar(50) utf8mb4_general_ci
51 visitor_document varchar(50) utf8mb4_general_ci
52 visitor_referrer_url varchar(100) utf8mb4_general_ci
53 visitor_referrer_domain varchar(100) utf8mb4_general_ci
54 visitor_referrer_type varchar(100) utf8mb4_general_ci
55 visitor_referrer_name varchar(100) utf8mb4_general_ci
56 visitor_url varchar(500) utf8mb4_general_ci
57 visitor_domain varchar(100) utf8mb4_general_ci
58 visitor_page_path varchar(500) utf8mb4_general_ci
59 visitor_pageview_time bigint(20)
60 visitor_leave_url varchar(50) utf8mb4_general_ci
61 visitor_leave_domain varchar(100) utf8mb4_general_ci
62 visitor_leave_page varchar(50) utf8mb4_general_ci
63 visitor_leave_type varchar(100) utf8mb4_general_ci
64 visitor_leave_name varchar(100) utf8mb4_general_ci
65 visitor_pageview_update varchar(100) utf8mb4_general_ci

---------------------------------------------------------------------------

CLASS PHP

Analytics.php

class analytics {

    public $search_sites;
    public $social_sites;
    private $_db;
    
    function __construct($db){
        $this->search_sites = array("google" => "google", "goo" => "google", "bing" => "bing", "yahoo" => "yahoo", "baidu" => "baidu", "ask" => "ask", "aol" => "aol", "wow" => "wow", "webcrawler" => "webcrawler", "mywebsearch" => "mywebsearch", "infospace" => "infospace", "duckduckgo" => "duckduckgo", "yandex" => "yandex");
        $this->social_sites = array("facebook" => "facebook", "fb" => "facebook", "twitter" => "twitter", "t.co" => "twitter", "youtube" => "youtube", "instagram" => "instagram", "snap" => "snapchat", "snapchat" => "snapchat", "reddit" => "reddit", "linkedin" => "linkedin", "xing" => "xing", "pinterest" => "pinterest", "tumblr" => "tumblr", "vine" => "vine", "meetup" => "meetup", "quora" => "quora");
        $this->_db = $db;
    }

    public function get_analytics_enter($visitor_ip, $visitor_visitor_id, $visitor_session_id, $visitor_pageview_id, $visitor_referrer, $visitor_url, $visitor_resolution, $visitor_viewport, $visitor_document){

        try{

            $GET_array = array("visitor_ip" => $visitor_ip, "visitor_visitor_id" => $visitor_visitor_id, "visitor_session_id" => $visitor_session_id, "visitor_pageview_id" => $visitor_pageview_id, "visitor_referrer" => $visitor_referrer, "visitor_url" => $visitor_url, "visitor_resolution" => $visitor_resolution, "visitor_viewport" => $visitor_viewport, "visitor_document" => $visitor_document);
             
            require_once('analytics-db.php');
            
            $analytics = array();

            $query = "SELECT * FROM analytics WHERE visitor_visitor_id = '".$visitor_visitor_id."'";
            $visitor_data = $this->_db->query($query)->fetchAll();

            $visitor_ip_info = get_data_visitor($visitor_ip);

            $visitor_visitor_pageview = 0;
            $visitor_session_pageview = 0;

            $session_buffer = array();
            $visitor_visitor_session = 0;

            $visitor_visitor_pages = array();
            $visitor_session_pages = array();

            $analytics["visitor_session_landingpage"] = NULL;
            $analytics["visitor_session_exitpage"] = NULL;

            foreach ($visitor_data as $visitor) {
                $visitor_visitor_pageview += 1;

                if (!in_array($visitor["visitor_page_path"], $visitor_visitor_pages)) {
                    array_push($visitor_visitor_pages, $visitor["visitor_page_path"]);
                }

                if ($visitor["visitor_session_id"] == $visitor_session_id) {
                    $visitor_session_pageview += 1;
                    $analytics["visitor_session_exitpage"] = $visitor["visitor_page_path"];

                    if ($visitor_session_pageview == 1) {
                        $analytics["visitor_session_landingpage"] = $visitor["visitor_page_path"];
                    }

                    if (!in_array($visitor["visitor_page_path"],$visitor_session_pages)) {
                        array_push($visitor_session_pages,$visitor["visitor_page_path"]);
                    }
                }

                if (!in_array($visitor["visitor_session_id"],$session_buffer)) {
                    array_push($session_buffer,$visitor["visitor_session_id"]);
                    $visitor_visitor_session += 1;
                }
            }

            if (!in_array($visitor_session_id,$session_buffer)) {
                $visitor_visitor_session += 1;
            }

            foreach($GET_array as $key => $value) {     
                if (in_array($key, $database_structure["analytics"])) {    
                    $analytics[$key] = $value;
                }
            }  

            $analytics["visitor_visitor_sessions"] = $visitor_visitor_session;
            $analytics["visitor_visitor_session"] = $visitor_visitor_session;

            $analytics["visitor_visitor_pageviews"] = $visitor_visitor_pageview + 1;
            $analytics["visitor_visitor_pageview"] = $visitor_visitor_pageview + 1;

            $analytics["visitor_visitor_time"] = "0";

            $analytics["visitor_session_pageviews"] = $visitor_session_pageview + 1;
            $analytics["visitor_session_pageview"] = $visitor_session_pageview + 1;

            $analytics["visitor_enter_timestamp"] = date("d.m.Y, H:i:s");
            $analytics["visitor_enter_id"] = date("YmdHis");
            $analytics["visitor_enter_year"] = date("Y");
            $analytics["visitor_enter_month"] = date("m");
            $analytics["visitor_enter_weekday"] = date("w");
            $analytics["visitor_enter_day"] = date("d");
            $analytics["visitor_enter_hour"] = date("H");
            $analytics["visitor_enter_minute"] = date("i");

            $analytics["visitor_leave_timestamp"] = date("d.m.Y, H:i:s");
            $analytics["visitor_leave_id"] = date("YmdHis");

            $analytics["visitor_pageview_time"] = "0";

            $analytics["visitor_country"] = $visitor_ip_info["country"];
            $analytics["visitor_country_code"] = $visitor_ip_info["countryCode"];
            $analytics["visitor_region"] = $visitor_ip_info["regionName"];
            $analytics["visitor_region_code"] = $visitor_ip_info["region"];
            $analytics["visitor_city"] = $visitor_ip_info["city"];
            $analytics["visitor_zip"] = $visitor_ip_info["zip"];
            $analytics["visitor_lat"] = $visitor_ip_info["lat"];
            $analytics["visitor_lon"] = $visitor_ip_info["lon"];
            $analytics["visitor_timezone"] = $visitor_ip_info["timezone"];
            $analytics["visitor_isp"] = $visitor_ip_info["isp"];
            $analytics["visitor_language"] = substr($_SERVER["HTTP_ACCEPT_LANGUAGE"], 0, 2);

            $analytics["visitor_referrer_url"] = $visitor_referrer;
            $analytics["visitor_referrer_domain"] = $this->get_domain($visitor_referrer);
            $analytics["visitor_referrer_type"] = $this->visitor_referrer_type($this->get_domain($visitor_referrer));
            $analytics["visitor_referrer_name"] = $this->visitor_referrer_name($this->get_domain($visitor_referrer));

            $analytics["visitor_domain"] = $this->get_domain($visitor_url);
            if ($this->get_page($visitor_url) != "" && $this->get_page($visitor_url) != " " && $this->get_page($visitor_url) != "&nbsp;") {
                $analytics["visitor_page_path"] = $this->get_page($visitor_url);
            }else{
                $analytics["visitor_page_path"] = "/";
            }

            if (!in_array($analytics["visitor_page_path"], $visitor_visitor_pages)) {
                array_push($visitor_visitor_pages,$analytics["visitor_page_path"]);
            }

            if (!in_array($analytics["visitor_page_path"], $visitor_session_pages)) {
                array_push($visitor_session_pages,$analytics["visitor_page_path"]);
            }

            $analytics["visitor_visitor_pages"] = json_encode($visitor_visitor_pages);
            $analytics["visitor_session_pages"] = json_encode($visitor_session_pages);

            if ($analytics["visitor_visitor_pageview"] == 1) {
                $analytics["visitor_visitor_first_page"] = "true";
            }

            if ($analytics["visitor_session_pageview"] == 1) {
                $analytics["visitor_session_first_page"] = "true";
            }

            $sql_1_1 = "UPDATE analytics SET " . "visitor_visitor_last_page" . "='" . "" . "' WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "'";
            $sql_1_2 = "UPDATE analytics SET " . "visitor_session_last_page" . "='" . "" . "' WHERE " . "visitor_session_id" . "='" . $visitor_session_id . "'";

            $sql_1 = $sql_1_1."; ".$sql_1_2.";";
            $this->_db->exec($sql_1);

            $analytics["visitor_visitor_last_page"] = "true";
            $analytics["visitor_session_last_page"] = "true";

            $analytics["visitor_device"] = visitor_device();
            $analytics["visitor_device_brand"] = visitor_device();
            $analytics["visitor_device_model"] = visitor_device();
            $analytics["visitor_os"] = visitor_os();
            $analytics["visitor_os_version"] = visitor_os();
            $analytics["visitor_browser"] = visitor_browser();
            $analytics["visitor_browser_version"] = visitor_browser();

            $analytics["visitor_pageview_update"] = date("YmdHis");

            $sql_2_1 = "INSERT INTO analytics (";
            foreach ($analytics as $key => $value) {$sql_2_1 .= $key . ",";}
            $sql_2_1 = rtrim($sql_2_1,",") . ") VALUES (";
            foreach ($analytics as $key => $value) {$sql_2_1 .= "'" . $value . "',";}
            $sql_2_1 = rtrim($sql_2_1,",") . ")";

            $this->_db->exec($sql_2_1);

            $sql_2_2 = "UPDATE analytics SET " . "visitor_visitor_sessions" . "='" . $analytics["visitor_visitor_sessions"] . "' WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "'";

            $sql_2_3 = "UPDATE analytics SET " . "visitor_visitor_pageviews" . "='" . $analytics["visitor_visitor_pageviews"] . "' WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "'";

            $sql_2_4 = "UPDATE analytics SET " . "visitor_visitor_pages" . "='" . $analytics["visitor_visitor_pages"] . "' WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "'";

            $sql_2_5 = "UPDATE analytics SET " . "visitor_session_pageviews" . "='" . $analytics["visitor_session_pageviews"] . "' WHERE " . "visitor_session_id" . "='" . $visitor_session_id."'";

            $sql_2_6 = "UPDATE analytics SET " . "visitor_session_pages" . "='" . $analytics["visitor_session_pages"] . "' WHERE " . "visitor_session_id" . "='" . $visitor_session_id."'";

            $sql_2_7 = "UPDATE analytics SET " . "visitor_session_landingpage" . "='" . $analytics["visitor_session_landingpage"] . "' WHERE " . "visitor_session_id" . "='" . $visitor_session_id."'";

            $sql_2_8 = "UPDATE analytics SET " . "visitor_session_exitpage" . "='" . $analytics["visitor_session_exitpage"] . "' WHERE " . "visitor_session_id" . "='" . $visitor_session_id."'";

            $sql_2 = $sql_2_2.";".$sql_2_3.";".$sql_2_4.";".$sql_2_5.";".$sql_2_6.";".$sql_2_7.";".$sql_2_8.";";
            $this->_db->exec($sql_2);

        } catch(PDOException $e) {
        }
    }

    public function get_analytics_update($visitor_visitor_id, $visitor_session_id, $visitor_pageview_id, $visitor_pageview_time, $visitor_leave_url){

        try{
            $GET_array = array("visitor_visitor_id" => $visitor_visitor_id, "visitor_session_id" => $visitor_session_id, "visitor_pageview_id" => $visitor_pageview_id, "visitor_pageview_time" => $visitor_pageview_time, "visitor_leave_url" => $visitor_leave_url);
        
            require_once('analytics-db.php');
            
            $query = "SELECT MAX(" . "visitor_visitor_time" . ") FROM analytics WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "' ORDER BY " . "visitor_enter_id" . " DESC LIMIT 1";
            
            $visitor_visitor_time = $this->_db->query($query)->fetchColumn();

            $query = "SELECT MAX(" . "visitor_session_time" . ") FROM analytics WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "' AND " . "visitor_session_id" . "='" . $visitor_session_id . "' ORDER BY " . "visitor_enter_id" . " DESC LIMIT 1";

            $visitor_session_time = $this->_db->query($query)->fetchColumn();

            $query = "SELECT MAX(" . "visitor_pageview_time" . ") FROM analytics WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "' AND " . "visitor_session_id" . "='" . $visitor_session_id . "' AND " . "visitor_pageview_id" . "='" . $visitor_pageview_id . "' ORDER BY " . "visitor_enter_id" . " DESC LIMIT 1";
                
            $visitor_pageview_time = $this->_db->query($query)->fetchColumn();

            $analytics = array();

            foreach($GET_array as $key => $value) {
                if ($key != "visitor_visitor_id" && $key != "visitor_session_id" && $key != "visitor_pageview_id" && in_array($key, $database_structure["analytics"])) {    
                    if(is_array($value)) {
                        $analytics[$key] = json_encode($value);
                    }else{
                        $analytics[$key] = $value;
                    }
                }
            }  

            $analytics["visitor_leave_timestamp"] = date("d.m.Y, H:i:s");
            $analytics["visitor_leave_id"] = date("YmdHis");

            $analytics["visitor_visitor_time"] = $visitor_visitor_time + ($visitor_pageview_time - $visitor_pageview_time);
            $analytics["visitor_session_time"] = $visitor_session_time + ($visitor_pageview_time - $visitor_pageview_time);

            $analytics["visitor_pageview_update"] = date("YmdHis");

            if (isset($visitor_leave_url)) {
                $analytics["visitor_leave_domain"] = $this->get_domain($visitor_leave_url);
                $analytics["visitor_leave_page"] = $this->get_page($visitor_leave_url);
                $analytics["visitor_leave_type"] = $this->visitor_leave_type($this->get_domain($visitor_leave_url));
                $analytics["visitor_leave_name"] = $this->visitor_leave_name($this->get_domain($visitor_leave_url));
            }

            $sql_1_1 = "UPDATE analytics SET ";
            foreach ($analytics as $key => $value) {$sql_1_1 .= $key . "='" . $value . "',";}
            $sql_1_1 = rtrim($sql_1_1,",");
            $sql_1_1 .= " WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "' AND " . "visitor_session_id" . "='" . $visitor_session_id . "' AND " . "visitor_pageview_id" . "='" . $visitor_pageview_id . "'";
        
            $sql_1_2 = "UPDATE analytics SET " . "visitor_visitor_time" . "='" . $analytics["visitor_visitor_time"] . "' WHERE " . "visitor_visitor_id" . "='" . $visitor_visitor_id . "'";
        
            $sql_1_3 = "UPDATE analytics SET " . "visitor_session_time" . "='" . $analytics["visitor_session_time"] . "' WHERE " . "visitor_session_id" . "='" . $visitor_session_id . "'";
            
            $sql_1 = $sql_1_1."; ".$sql_1_2."; ".$sql_1_3.";";
            $this->_db->exec($sql_1);

        } catch(PDOException $e) {
        }
    }
        
    function get_domain($url) {
          $pieces = parse_url($url);
          $domain = isset($pieces['host']) ? $pieces['host'] : '';
          if (preg_match('/(?P<domain>[a-z0-9][a-z0-9\-]{0,63}\.[a-z\.]{1,6})$/i', $domain, $regs)) {
            return $regs['domain'];
          }else{
              return false;
          }
    }
    
    function get_page($url) {
        return trim(str_replace($this->get_domain($url),"",str_replace("www.","",str_replace("http://","",str_replace("https://","",$url)))),"/");
    }

    function visitor_referrer_type($referrer) {
        $search_sites = $this->search_sites;
        $social_sites = $this->social_sites;

        if ($referrer == "") {
            return "direct";
        }

        $referrer = explode(".",$referrer);
        $referrer = strtolower($referrer[0]);

        if (array_key_exists($referrer,$search_sites)) {
            return "search";
        }else if (array_key_exists($referrer,$social_sites)) {
            return "social";
        }else {
            return "website";
        }
        
    }

    function visitor_referrer_name($referrer) {
        $search_sites = $this->search_sites;
        $social_sites = $this->social_sites;

        if ($referrer == "") {
            return "";
        }

        $referrer = explode(".",$referrer);
        $referrer = strtolower($referrer[0]);

        if (array_key_exists($referrer,$search_sites)) {
            return $search_sites[$referrer];
        }else if (array_key_exists($referrer,$social_sites)) {
            return $social_sites[$referrer];
        }else {
            return $referrer;
        }
    }

    function visitor_leave_type($leave_url)
    {
        $url_paz = $_SERVER['HTTP_HOST'];

        if ($leave_url == "") {
            return "unknown";
        }

        if (strpos($leave_url, $url_paz) !== false) {
            return "internal";
        }else {
            return "external";
        }
    }

    function visitor_leave_name($leave_url)
    {
        if ($leave_url == "") {
            return "";
        }

        $leave_url = $this->get_domain($leave_url);

        $leave_url = explode(".",$leave_url);
        $leave_url = strtolower($leave_url[0]);
        
        return $leave_url;
    }

}

?>

analytics-db.php

<?php
    
    $database_structure = array();
    $database_structure["analytics"] = array();

    // Dataset IDs

    array_push($database_structure["analytics"],"visitor_visitor_id");
    array_push($database_structure["analytics"],"visitor_session_id");
    array_push($database_structure["analytics"],"visitor_pageview_id");

    // Dataset Visitor Data

    array_push($database_structure["analytics"],"visitor_visitor_sessions");
    array_push($database_structure["analytics"],"visitor_visitor_session");
    array_push($database_structure["analytics"],"visitor_visitor_pageviews");
    array_push($database_structure["analytics"],"visitor_visitor_pageview");
    array_push($database_structure["analytics"],"visitor_visitor_time");
    array_push($database_structure["analytics"],"visitor_visitor_pages");
    array_push($database_structure["analytics"],"visitor_visitor_first_page");
    array_push($database_structure["analytics"],"visitor_visitor_last_page");

    // Dataset Session Data

    array_push($database_structure["analytics"],"visitor_session_pageviews");
    array_push($database_structure["analytics"],"visitor_session_pageview");
    array_push($database_structure["analytics"],"visitor_session_time");
    array_push($database_structure["analytics"],"visitor_session_pages");
    array_push($database_structure["analytics"],"visitor_session_landingpage");
    array_push($database_structure["analytics"],"visitor_session_exitpage");
    array_push($database_structure["analytics"],"visitor_session_first_page");
    array_push($database_structure["analytics"],"visitor_session_last_page");

    // Dataset Pageview Data

    // Dataset Enter Time

    array_push($database_structure["analytics"],"visitor_enter_timestamp");
    array_push($database_structure["analytics"],"visitor_enter_id");
    array_push($database_structure["analytics"],"visitor_enter_year");
    array_push($database_structure["analytics"],"visitor_enter_month");
    array_push($database_structure["analytics"],"visitor_enter_weekday");
    array_push($database_structure["analytics"],"visitor_enter_day");
    array_push($database_structure["analytics"],"visitor_enter_hour");
    array_push($database_structure["analytics"],"visitor_enter_minute");

    // Dataset Leave Time

    array_push($database_structure["analytics"],"visitor_leave_timestamp");
    array_push($database_structure["analytics"],"visitor_leave_id");

    // Dataset Geolocation

    array_push($database_structure["analytics"],"visitor_country");
    array_push($database_structure["analytics"],"visitor_country_code");
    array_push($database_structure["analytics"],"visitor_region");
    array_push($database_structure["analytics"],"visitor_region_code");
    array_push($database_structure["analytics"],"visitor_city");
    array_push($database_structure["analytics"],"visitor_zip");
    array_push($database_structure["analytics"],"visitor_lat");
    array_push($database_structure["analytics"],"visitor_lon");
    array_push($database_structure["analytics"],"visitor_timezone");
    array_push($database_structure["analytics"],"visitor_isp");
    array_push($database_structure["analytics"],"visitor_language");

    // Dataset Technology

    array_push($database_structure["analytics"],"visitor_device");
    array_push($database_structure["analytics"],"visitor_device_brand");
    array_push($database_structure["analytics"],"visitor_device_model");
    array_push($database_structure["analytics"],"visitor_os");
    array_push($database_structure["analytics"],"visitor_os_version");
    array_push($database_structure["analytics"],"visitor_browser");
    array_push($database_structure["analytics"],"visitor_browser_version");
    array_push($database_structure["analytics"],"visitor_resolution");
    array_push($database_structure["analytics"],"visitor_viewport");
    array_push($database_structure["analytics"],"visitor_document");

    // Dataset Referrer

    array_push($database_structure["analytics"],"visitor_referrer_url");
    array_push($database_structure["analytics"],"visitor_referrer_domain");
    array_push($database_structure["analytics"],"visitor_referrer_type");
    array_push($database_structure["analytics"],"visitor_referrer_name");

    // Dataset Page

    array_push($database_structure["analytics"],"visitor_url");
    array_push($database_structure["analytics"],"visitor_domain");
    array_push($database_structure["analytics"],"visitor_page_path");

    // Dataset Time

    array_push($database_structure["analytics"],"visitor_pageview_time");

    // Dataset Leave

    array_push($database_structure["analytics"],"visitor_leave_url");
    array_push($database_structure["analytics"],"visitor_leave_domain");
    array_push($database_structure["analytics"],"visitor_leave_page");
    array_push($database_structure["analytics"],"visitor_leave_type");
    array_push($database_structure["analytics"],"visitor_leave_name");

    // Dataset Update

    array_push($database_structure["analytics"],"visitor_pageview_update");
        
?>

analytics-enter.php

<?php

if(isset($_POST["visitor_ip"])){
    
    $analytics->get_analytics_enter($_POST["visitor_ip"], $_POST["visitor_visitor_id"], $_POST["visitor_session_id"], $_POST["visitor_pageview_id"], $_POST["visitor_referrer"], $_POST["visitor_url"], $_POST["visitor_resolution"], $_POST["visitor_viewport"], $_POST["visitor_document"]);
    print "done";
    
}else{
    
    print "error";
    
}

?>

analytics-update.php

<?php

$analytics->get_analytics_update($_POST["visitor_visitor_id"], $_POST["visitor_session_id"], $_POST["visitor_pageview_id"], $_POST["visitor_pageview_time"], $_POST["visitor_leave_url"]);

?>

JS FILE

$(function(){

    function create_cookie(name,value,days) {
        if (days) {
            var date = new Date();
            date.setTime(date.getTime()+(days*24*60*60*1000));
            var expires = "; expires="+date.toGMTString();
        }else {
            var expires = "";
        }

        var host = window.location.hostname;
        var domain = host.substring(host.lastIndexOf(".", host.lastIndexOf(".") - 1) + 1);

        document.cookie = name+"="+value+expires+"; path=/; domain=." + domain;
    }

    function read_cookie(name) {
        var nameEQ = name + "=";
        var ca = document.cookie.split(';');
        for (var i = 0; i < ca.length; i++) {
            var c = ca;

            while (c.charAt(0) == ' ') {
                c = c.substring(1,c.length);
            }

            if (c.indexOf(nameEQ) == 0) {
                return c.substring(nameEQ.length,c.length);
            }
        }
        return null;
    }

    function random_string(length, chars) {
        var result = '';
        for (var i = length; i > 0; --i) result += chars[Math.round(Math.random() * (chars.length - 1))];
        return result;
    }

    function create_id() {
        var result = random_string(16, "0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ");
        var date_time = new Date();
        result += date_time.getFullYear();
        result += date_time.getMonth();
        result += date_time.getDate();
        result += date_time.getHours();
        result += date_time.getMinutes();
        result += date_time.getSeconds();
        return btoa(result);
    }

    function create_visitor_visitor_id() {
        if (visitor_visitor_id() == null) {    
            create_cookie("visitor_id", create_id(), 3650)
        }
    }

    function visitor_visitor_id() {
        return read_cookie("visitor_id");
    }

    function create_visitor_session_id() {
        if (visitor_session_id() == "") {
            sessionStorage.setItem("visitor_session_id", create_id());
        }
    }

    function visitor_session_id() {
        return sessionStorage.getItem("visitor_session_id") == null ? "" : sessionStorage.getItem("visitor_session_id");
    }

    function get_ip() {    
        return $.getJSON("https://api.ipify.org?format=jsonp&callback=?").then(function(data){
            return {
                visitor_ip: data.ip
            }
        });    
    }

    if (new URL(window.location.href).searchParams.get("analytics") != "true") {
        create_visitor_visitor_id();
        create_visitor_session_id();

        var analytics_script_location = "/analytics/controllers/";

        var screen_width = screen.width;
        var screen_height = screen.height;

        var viewport_width = window.innerWidth || document.documentElement.clientWidth || document.body.clientWidth;
        var viewport_height = window.innerHeight || document.documentElement.clientHeight || document.body.clientHeight;

        var document_width = window.innerWidth || document.documentElement.clientWidth || document.body.clientWidth;
        var document_height = document.documentElement.scrollHeight;

        var visitor_ip;
        get_ip().then(function(returndata){ visitor_ip = returndata.visitor_ip});

        var visitor_visitor_id = visitor_visitor_id();
        var visitor_session_id = visitor_session_id();
        var visitor_pageview_id = create_id();

        var visitor_enter_time = new Date();
        var visitor_referrer = document.referrer;
        var visitor_url = window.location.href;

        var visitor_resolution = screen_width + "x" + screen_height;
        var visitor_viewport = viewport_width + "x" + viewport_height;
        var visitor_document = document_width + "x" + document_height;

        var visitor_leave_url = "NULL";

        var current_time = 0;

        var scroll_sum = 0;
        var scroll_count = 0;

        var visitor_enter_sent = false;
        var visitor_leave_sent = false;

        var current_viewport_width = window.innerWidth || document.documentElement.clientWidth || document.body.clientWidth;
        var current_viewport_height = window.innerHeight || document.documentElement.clientHeight || document.body.clientHeight;
        var current_document_width = window.innerWidth || document.documentElement.clientWidth || document.body.clientWidth;
        var current_document_height = document.documentElement.scrollHeight;

        var current_viewport = current_viewport_width + "x" + current_viewport_height;
        var previous_viewport = current_viewport_width + "x" + current_viewport_height;

        var current_document = current_document_width + "x" + current_document_height;
        var previous_document = current_document_width + "x" + current_document_height;

        function track_a_href(event) {
             visitor_leave_url = event.target.href;
             analytics_visitor_leave();
        }

        function analytics_visitor_enter() {    
            if (visitor_enter_sent == false) {

                $.ajax({
                    type: "POST",
                    url: analytics_script_location + "analytics-enter.php",
                    data: {
                        visitor_ip: visitor_ip,
                        visitor_visitor_id: visitor_visitor_id,
                        visitor_session_id: visitor_session_id,
                        visitor_pageview_id: visitor_pageview_id,
                        visitor_referrer: visitor_referrer,
                        visitor_url: visitor_url,
                        visitor_resolution: visitor_resolution,
                        visitor_viewport: visitor_viewport,
                        visitor_document: visitor_document
                    },
                    success: function(data){
                        if(data == "done"){
                            visitor_enter_sent = true;
                        }else{
                            visitor_enter_sent = false;
                        }
                    }
                });
            }
        }

        function analytics_visitor_update() {
            var visitor_pageview_time = Math.round(((new Date() - visitor_enter_time)/1000)%60);

            $.ajax({
                type: "POST",
                url: analytics_script_location + "analytics-update.php",
                data: {
                    visitor_visitor_id: visitor_visitor_id,
                    visitor_session_id: visitor_session_id,
                    visitor_pageview_id: visitor_pageview_id,
                    visitor_pageview_time: visitor_pageview_time,
                    visitor_leave_url: visitor_leave_url
                }
            });
            
        }

        window.setInterval(function() {
            if(visitor_enter_sent == true){
                analytics_visitor_update();
            }else{
                analytics_visitor_enter();
            }
        }, 15000);

        function analytics_visitor_leave() {    
            if (visitor_leave_sent == false) {   
                analytics_visitor_update();
                visitor_leave_delay(250);
                visitor_leave_sent = true;
            }
        }

        function visitor_leave_delay(time) {
            var start = +new Date;
            while ((+new Date - start) < time);
        }

        $(window).load(function() { analytics_visitor_enter(); });
        $(window).on('pagehide', function () { analytics_visitor_leave(); });
        $(window).on('beforeunload', function () { analytics_visitor_leave(); });
        $(window).unload( function() { analytics_visitor_leave(); });

    }

});

Let's say I have a forum with 300 active people posting 24/7

I have error reporting turned off.

But if I turn it on, it shows 100-200 Undefined variable's error's on each forum page, even if it's off does it effect performance or does it matter if the php is writing to a error_log? If so how can I disable php writing to a error_log as I have no sense or no need for it.

Thanks, and would the speed be noticable if I went ahead and fixed all the errors, if it would help? or no

I code fine, it's just i dont use the isset..

Hi Guys

We have had a holiday program written in php in the past by an experienced developer but we are experiencing problems now.   So I am curious to try and resolve the best approach

Here goes

1:  We query multiple APIs to return holiday results to our users

2:  This can take up to 20 seconds to return results but sometimes its much quicker depending on the volume of API returned results

3:  Other users seem to be locked out of even visiting our website if an API call is running

So initially without posting any code, I have a couple of questions which are

A:  Is there a way to maybe poll a process or allow partial results to the users browser while things run in the background ( similar to what other holiday providers seem to be doing )

B:  Is there a way to speed this up or maybe some sort of better technology to utilise

 

Many thanks professionals

I have a simple php script without mysql database. Normally it takes less than 1s to complete the process. But in high traffic (more than 10 concurrent processes), the execution time dramatically increases to 10-30s. This itself causes an increase in the concurrent processes. I think this behavior is not very common. Any idea?

Btw, can huge error logs make the system slow? I have numerous php notices and it's growing.

Hello, 

Hello,
I'm using php's mail function to send sms messages to my sprint phone.  Sometimes I receive the text right away and other times it comes in as much as an hour or so later.  My server is on GoDaddy.  Does anyone have any ideas about what could be causing the bottleneck?  To debug this I tried sending sms messages from my comcast email.  So far those are always received very quickly.  Perhaps the issue is on the GoDaddy server... I might try contacting them.

By the way, it seems like the first text I send is received quickly, but then if I send other text messages within some short time frame, those don't always show up immediately.

Has anyone else experienced anything similar?

I've got my own proprietary framework. I call it Brain. It uses composer, and installation is done with a single composer file, which is handy. Here's an example:

{
    "name": "skunkbad/brain-test",
    "description": "My Awesome App",
    "license": "proprietary",
    "minimum-stability": "dev",
    "repositories": [
        {
            "type": "hg",
            "url": "ssh://hg@bitbucket.org/skunkbad/brain"
        }
    ],
    "require": {
        "skunkbad/brain": "default"
    },
    "scripts": {
        "post-install-cmd": "Brain\\Statics\\BrainInstallScript::run"
    }
}

Brain has it's own dependencies, which aren't all really dependencies, but I've added them all to its composer.json file so I get everything I want for a new project. Here is it's composer.json:

{
    "name": "skunkbad/brain",
    "version": "1.0.0",
    "type": "framework",
    "license": "Proprietary",
    "authors": [
        {
            "name": "Robert B Gottier",
            "email": "xXxXxXxXx@gmail.com",
            "homepage": "http://brianswebdesign.com",
            "role": "Developer"
        }
    ],
    "require": {
        "pimple/pimple"          : "v2.0.0",
        "swiftmailer/swiftmailer": "v5.2.0",
        "dompdf/dompdf"          : "0.6.1",
        "phpseclib/phpseclib"    : "0.3.6",
        "stripe/stripe-php"      : "v1.15.0",
        "firephp/firephp-core"   : "dev-master",
        "doctrine/dbal"          : "v2.4.2"
    },
    "autoload": {
        "psr-4": { 
            "Brain\\": "/",
            "App\\": "../../../App/"
        },
        "classmap": [
        	"Statics/"
        ]
    }
}

In Windows terminal, I can run composer install or composer install --prefer-dist, and it seems that especially when the doctrine packages are being downloaded or cloned (whatever it does), its super slow. Some of them hang for so long that occasionally the terminal will give me a message indicating a particular package timed out (5 mins).   So I was wondering if this is just the norm. Feels like I'm on dial-up, but my internet connection is Verizon FiOS (fiber optic). Here is an example of the time-out message I get from Composer:     Failed to download doctrine/common from source: The process "git clone --no-checkout "git://github.com/doctrine/common.git" "C:\XXXxxx" && cd /D "C:\XXXxxx" && git remote add composer "git://github.com/doctrine/common.git" && git fetch composer" exceeded the timeout of 300 seconds.   I timed my install, and composer/common actually hung for about 7 mins. Total time was 9.5 mins.