PHP - Curl Help - With Example Html And Code

well basically im trying to do that the 'subject says.
ive done my homework and had around 10 examples of using curl, but none of them worked in my case.
this is the final code i'm using

<?php
$cookiefile = '/temp/cookies.txt';


#2 ways ive tried doing

#$data = array('edit[username]' => 'REMOVED', 'edit[password]' => 'REMOVED', 'edit[submit]' => 'Login');
$data = array('username] => 'REMOVED', 'password' => 'REMOVED', 'submit' => 'Login');




$ch = curl_init();

curl_setopt($ch, CURLOPT_URL, 'http://pokerrpg.com');
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);

curl_setopt($ch, CURLOPT_COOKIEFILE, $cookiefile);
curl_setopt($ch, CURLOPT_COOKIEJAR, $cookiefile);

curl_setopt($ch, CURLOPT_POST, true);
curl_setopt($ch, CURLOPT_POSTFIELDS, $data);

curl_exec($ch);

curl_setopt($ch, CURLOPT_URL, 'http://pokerrpg.com/furniture_store.php');
$contents = curl_exec($ch);
$headers = curl_getinfo($ch);

echo $contents;

curl_close($ch);
unlink($cookiefile);
?>

im not sure about the cookie file, but i just made a txt file to that location. and empty txt file.  hope it's fine.

the page i'm trying is http://pokerrpg.com, you can even look the source code that both of these fields do exist.

when i run it, the output is a login page without logging in, so it does not log in. 

Well this is a tricky one for me. The script I've created is able to upload images to a server. The server, which I have no control over, generates a random name. It uses Javascript and flash. As a result the links to these images are not within the source code.

I suppose the question is, is there a way to still grab these links? I'm familiar with cURL and I was thinking about using something like (CURLOPT_FOLLOWLOCATION) but I'm wondering if that would just look at the source code for links as well?

Has anyone had this problem before?

I'm trying to work on my php skills by creating an online content "finder". I'm using cURL to grab webpage HTML and store it in a variable.

I then want my program to find the article title, keywords and the content. I'm using articles from Ezine.

here is an example webpage.

Code: [Select]
http://ezinearticles.com/?8-Ways-to-Reduce-Stock-Investment-Risks&id=954266
I don't have any problems grabbing the webpage html. But when I try to grab the title, keywords, and content using this code.

Code: [Select]
$title = getbetween($html, "<title>", "</title>");
$keywords = getbetween($html, "<meta name=\"keywords\" content=\"", "\">");
$content  = getbetween($html, "<div id=\"body\">", "</div>");
$content  = "<P>" . getbetween($content . "<E>", "<P>", "<E>");

echo "Title: " . $title . "<P>";
echo "Keywords: " . $keywords . "<P>";
echo "Content: " . $content . "<P>";

Only the title comes out of the page, the rest of the values are blank... I'm not sure why the getbetween is only working to extract the title from the html. Does anyone have any ideas why??

I tried testing to see if it was grabbing the propper webpage and when I used 'echo $html;' the webpage came out fine on my page..

I am totally lost on this, I just want to practice using cURL and my webrequest coding.

Thanks for any help, I appreciate it.

Hey All,

I will be marketing a simple php script shortly and would like to Obfuscate my code and have it check to see if the person is running the script on the proper domain, much like other Purchased Scripts, you have to buy licenses and some are limited to a Per Domain basis.

Could I use cURL to run a script on another server (mine) that takes the URL it came from, and a variable "the auth key" and check if the person is using the script on the proper domain?  If the domain and auth key don't match in the DB i would return a message saying invalid key or something, else continue to execute the script.


<?php
//authkey would be defined in config file
$authkey = "769870afhljkzxf90436";

$curl_handle=curl_init();
curl_setopt($curl_handle,CURLOPT_URL,"http://example.com/page.php?authkey=$authkey");
curl_setopt($curl_handle,CURLOPT_CONNECTTIMEOUT,2);
curl_setopt($curl_handle,CURLOPT_RETURNTRANSFER,1);
$buffer = curl_exec($curl_handle);
curl_close($curl_handle);

if (empty($buffer))
{
    print "Sorry, AuthServ is performing maintenance.....<p>";
}
else
{
    print $buffer;
}
?>



Is there a smarter way to do this?  I don't have an extra 300 bucks to use something like ioncube,  just looking for a general proper direction on going about this as I am totally clueless.

thanks

Hi guys,

I am making a bot which only scrapes the source code of the site AFTER logging into the site.The script to login is :

Code: [Select]
<?php

    $username="xxx"; 
$password="iwonttellyou"; 
$url="http://internet.com/login.php"; 
$cookie="cookie.txt"; 

$postdata = "name=".$username."&password=".$password; 

$ch = curl_init(); 
curl_setopt ($ch, CURLOPT_URL, $url); 
curl_setopt ($ch, CURLOPT_SSL_VERIFYPEER, FALSE); 
curl_setopt ($ch, CURLOPT_USERAGENT, "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6"); 
curl_setopt ($ch, CURLOPT_TIMEOUT, 60); 
curl_setopt ($ch, CURLOPT_FOLLOWLOCATION, 0); 
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1); 
curl_setopt ($ch, CURLOPT_COOKIEJAR, $cookie); 
curl_setopt ($ch, CURLOPT_REFERER, $url); 

curl_setopt ($ch, CURLOPT_POSTFIELDS, $postdata); 
curl_setopt ($ch, CURLOPT_POST, 1); 
$result = curl_exec ($ch); 

echo $result;  

?>

I can see different SESSION ID's in cookie.txt everytime i compile this code, which makes me believe its working.However what next?
How should i go to that site again, already logged in and scrape the data ? Some suggestions would be nice.

I have looked up tutorials on Google. I am still confused. I built a php script that receives the data from my html form then filters out bad words. I am trying to get the script to resend the data to pm.cgi. The form was originally targeting pm.cgi but it needed filtered. This is why i am using php in the first place.  Please help me pass these variables from the php script to the cgi script the same way that a html form would. Thank you.
Here is my code, it prints correctly. I cannot get cURL to work.
<?php
  $action = $_GET['action'] ;
  $login = $_REQUEST['login'] ;
  $ID = $_REQUEST['ID'] ;
  $text = $_REQUEST['Unused10'] ;
  $submit = $_REQUEST['submit'] ;


function filterBadWords($str){

 // words to filter
 $badwords=array( "badword1", "badword2");

 // replace filtered words with random spaces
 $replacements=array( "****", "***", "****" );

 for($i=0;$i < sizeof($badwords);$i++){
  srand((double)microtime()*1000000);
  $rand_key = (rand()%sizeof($replacements));
  $str=eregi_replace($badwords[$i], $replacements[$rand_key], $str);
 }
 return $str;
}
$text = filterBadWords($text);
print_r($action);
print_r($login);
print_r($ID);
print_r($text);
print_r($submit);


?>

I need to send the variables that i printed above to pm.cgi. Can you point me in the right direction? Thanks again!

good day dear community,

i am workin on a Curl loop to fetch multiple pages:

i have some examples - and a question:

Example: If we want to get information from 3 sites with CURL we can do it like so:


$list[1] = "http://www.example1.com";
$list[2] = "ftp://example.com";
$list[3] = "http://www.example2.com";


After creating the list of links we should initialize the cURL multi handle and adding the cURL handles.


$curlHandle = curl_multi_init();
for ($i = 1;$i <= 3; $i++)
 $curl[$i] = addHandle($curlHandle,$list[$i]);


Now we should execute the cURL multi handle retrive the
content from the sub handles that we added to the cURL multi handle.

ExecHandle($curlHandle);
for ($i = 1;$i <= 3; $i++)
{
 $text[$i] =  curl_multi_getcontent ($curl[$i]);
 echo $text[$i];
}

In the end we should release the handles from the cURL multi handle by calling curl_multi_remove_handle and close the cURL multi handle!

If we want to another Fetch of sites with cURL-Multi - since this is the most pretty way to do it!
Well I am not sure bout the string concatenation. How to do it - Note I want to fetch several hundred pages:
see the some details for this target-server sites - /(I have to create a loop over several hundred sites).

    * siteone.example/?show_subsite=9009
    * siteone.example/?show_subsite=9742
    * siteone.example/?show_subsite=9871

.... and so on and so forth Question: How to appy this loop into the array of the curl-multi?



<?php
/************************************\
* Multi interface in PHP with curl  *
* Requires PHP 5.0, Apache 2.0 and  *
* Curl         *
*************************************
* Writen By Cyborg 19671897         *
* Bugfixed by Jeremy Ellman         *
\***********************************/

$urls = array(
   "siteone",
   "sitetwo",
   "sitethree"
   );

$mh = curl_multi_init();

foreach ($urls as $i => $url) {
       $conn[$i]=curl_init($url);
       curl_setopt($conn[$i],CURLOPT_RETURNTRANSFER,1);//return data as string 
       curl_setopt($conn[$i],CURLOPT_FOLLOWLOCATION,1);//follow redirects
       curl_setopt($conn[$i],CURLOPT_MAXREDIRS,2);//maximum redirects
       curl_setopt($conn[$i],CURLOPT_CONNECTTIMEOUT,10);//timeout
       curl_multi_add_handle ($mh,$conn[$i]);
}

do { $n=curl_multi_exec($mh,$active); } while ($active);

foreach ($urls as $i => $url) {
       $res[$i]=curl_multi_getcontent($conn[$i]);
       curl_multi_remove_handle($mh,$conn[$i]);
       curl_close($conn[$i]);
}
curl_multi_close($mh);


print_r($res);

?>





I look forward to your ideas.

I have the following code in html:

<html>
<head>
<script type="text/javascript">
<!--
function delayer(){
    window.location = "http://VARIABLEVALUE.mysite.com"
}
//-->
</script>
<title>Redirecting ...</title>
</head>
<body onLoad="setTimeout('delayer()', 1000)">



<script type="text/javascript">
var sc_project=71304545;
var sc_invisible=1;
var sc_security="9c433fretre";
</script>

<script type="text/javascript"
src="http://www.statcounter.com/counter/counter.js"></script><noscript>
<div
class="statcounter"><a title="vBulletin statistics"
href="http://statcounter.com/vbulletin/"
target="_blank"><img class="statcounter"
src="http://c.statcounter.com/71304545/0/9c433fretre/1/"
alt="vBulletin statistics" ></a></div></noscript>


</body>
</html>

Is a basic html webpage with a timer redirect script and a stascounter code.

I know a bit about html and javascript, but almost nothing about php.

My question is:

How a can convert this html code into a php file, in order to send a variable value using GET Method and display this variable value inside the javascript code where says VARIABLEVALUE.

Thanks in adavance for your help.

I have a form that users input user name, password, and email... all writes to csv fine.  My problem is I need to concatenate a a string with a variable and some html code will preserving the html when written to the csv..

I need the csv to be this

username,password,email,user,category,text with http://sub.domain..com/splash/,something,something

here's what i have

Code: [Select]
<?php
if($_POST['formSubmit'] == "Submit")

$varUserName = $_POST['username'];
$varPW = $_POST['PW'];
$varEmail = $_POST['email'];
{
$fs = fopen("testcsv.csv","a");
fputcsv($fs, array($varUserName,$varPW,$varEmail,"user","title",",category","some text '<a href="http://$varUserName.url.com/splash/>site.com</a>',));
fclose($fs);

exit;
}
?>
and of course I'm getting

Parse error: syntax error, unexpected T_STRING, expecting ')' on line 9

Can I combine also HTML code in PHP function?
For example, can a PHP function include HTML form and the PHP code to handle this form?

If yes, this will make my main code much more smaller and readable.

If not, is there a way to define an "external macro" like, which allow me to replace pre-defined lines of code with short alias?


 

class curl2{

    private $curl_init; 
    private $CURLOPT_URL;

    public function connect(){ 
       $this->curl_init = curl_init(); 
    }

    public function debug(){
 
       curl_setopt($this->curl_init, CURLOPT_VERBOSE, TRUE);
       $fp = fopen("curl2.txt", "w"); 
       curl_setopt($this->curl_init, CURLOPT_STDERR, $fp); 
       curl_setopt($this->curl_init, CURLOPT_RETURNTRANSFER, TRUE);

    }

    public function setUrl($url = null){
       $this->CURLOPT_URL = $url;
       curl_setopt($this->curl_init, CURLOPT_URL, $this->CURLOPT_URL);
    }

    public function execute(){

       $out = curl_exec($this->curl_init);
       curl_close($this->curl_init);

       return $out;
    }
}

$curl2 = new curl2;
$curl2->connect();
$curl2->setUrl("http://www.linuxformat.co.uk");
$curl2->debug();
echo $curl2->execute();



It display a blank page like attachment result1.jpg, but if I move the
$fp = fopen("curl2.txt", "w"); 
curl_setopt($this->curl_init, CURLOPT_STDERR, $fp); 
curl_setopt($this->curl_init, CURLOPT_RETURNTRANSFER, TRUE);
from function debug() and join it with function execute()
like this:
  public function execute(){
       $fp = fopen("curl2.txt", "w"); 
       curl_setopt($this->curl_init, CURLOPT_STDERR, $fp); 
       curl_setopt($this->curl_init, CURLOPT_RETURNTRANSFER, TRUE);

       $out = curl_exec($this->curl_init);
       curl_close($this->curl_init);

       return $out;
    }

it return me Linuxformat content ( expected result ) like result2.jpg

below is the working code :
class curl2{

    private $curl_init; 
    private $CURLOPT_URL;

    public function connect(){ 
       $this->curl_init = curl_init(); 
    }

    public function debug(){
 
       curl_setopt($this->curl_init, CURLOPT_VERBOSE, TRUE);
      

    }

    public function setUrl($url = null){
       $this->CURLOPT_URL = $url;
       curl_setopt($this->curl_init, CURLOPT_URL, $this->CURLOPT_URL);
    }

    public function execute(){
       $fp = fopen("curl2.txt", "w"); 
       curl_setopt($this->curl_init, CURLOPT_STDERR, $fp); 
       curl_setopt($this->curl_init, CURLOPT_RETURNTRANSFER, TRUE);

       $out = curl_exec($this->curl_init);
       curl_close($this->curl_init);

       return $out;
    }
}

$curl2 = new curl2;
$curl2->connect();
$curl2->setUrl("http://www.linuxformat.co.uk");
$curl2->debug();
echo $curl2->execute();

 
Why I couldn't split "CURLOPT_STDERR, CURLOPT_RETURNTRANSFER" with "curl_exec"
 

I'm trying to submit html/php code through an html form and then insert it into a mysql database. I've got the following code so far (without the insert into database query), however when I submit the form I get pushed through to my 403 page. If i comment out the textarea that contains the code I am trying to submit, then it goes through fine.

Any ideas?


Code: [Select]
<?
if (isset($_POST['optone'])) {$optone=$_POST['optone']; $opttwo=$_POST['opttwo'];}
if (isset($_POST['type'])) {if ($_POST['type']=='Theory') {$optone=1;} if ($_POST['type']=='Demo') {$optone=2;} $opttwo=$_POST['module'];}

?>

<h3>Module administration</h3>
<script>
function setOptions(chosen) {
var selbox = document.myform.opttwo;
 
selbox.options.length = 0;
if (chosen == " ") {
  selbox.options[selbox.options.length] = new Option('Please select an option first',' ');
  document.myform.go.disabled=true;
 
}
if (chosen == "1") {
  selbox.options[selbox.options.length] = new Option('Module 1','1');
  selbox.options[selbox.options.length] = new Option('Module 2','2');
  selbox.options[selbox.options.length] = new Option('Module 3','3');
  selbox.options[selbox.options.length] = new Option('Module 4','4');
  selbox.options[selbox.options.length] = new Option('Module 5','5');
  selbox.options[selbox.options.length] = new Option('Module 6','6');
  selbox.options[selbox.options.length] = new Option('Module 7','7');
  selbox.options[selbox.options.length] = new Option('Module 8','8');
  selbox.options[selbox.options.length] = new Option('Module 9','9');
  selbox.options[selbox.options.length] = new Option('Module 10','10');
  document.myform.go.disabled=false;
}
if (chosen == "2") {
  selbox.options[selbox.options.length] = new Option('Module 1','1');
  selbox.options[selbox.options.length] = new Option('Module 2','2');
  selbox.options[selbox.options.length] = new Option('Module 3','3');
  selbox.options[selbox.options.length] = new Option('Module 4','4');
  selbox.options[selbox.options.length] = new Option('Module 5','5');
  selbox.options[selbox.options.length] = new Option('Module 6','6');
  selbox.options[selbox.options.length] = new Option('Module 7','7');
  selbox.options[selbox.options.length] = new Option('Module 8','8');
  selbox.options[selbox.options.length] = new Option('Module 9','9');
  selbox.options[selbox.options.length] = new Option('Module 10','10');
  document.myform.go.disabled=false;
}
}
</script>
<br />
<center>
<form name="myform" method='post'>
Edit:
<select id="optone" name="optone" size="1" onchange="setOptions(document.myform.optone.options[document.myform.optone.selectedIndex].value);" >
<option value=" " >--Choose--</option>
<option value="1" >Theory</option>
<option value="2" >Demo</option>
</select>
<select name="opttwo" size="1">
<option value=" " selected="selected">Please select an option first</option>
</select>
<input type='submit' name='go' id='go' value='Go' disabled='disabled'/>
</form>
</center>
<br /><br />
<?
if (isset($opttwo)) {
if ($optone==1) {$query = "SELECT info,userscompleted,last_user,enabled FROM theorydata WHERE TheoryID=".$opttwo; $typestr='Theory'; $texthelp='Code must be entered in HTML';}
if ($optone==2) {$query = "SELECT info,userscompleted,last_user,enabled FROM demodata WHERE DemoID=".$opttwo; $typestr='Demo'; $texthelp='Code must be entered in PHP';}
$result = mysql_query($query) or die(mysql_error());
$row = mysql_fetch_array($result);
$query2="SELECT full_name FROM users WHERE id=".$row['last_user'];
$result2 = mysql_query($query2) or die(mysql_error());
$row2 = mysql_fetch_array($result2);

?>
<form method='post' >
<table>
<tr>
<td align='center'>
Type:
</td>
<td>
<input type='text' name='type' readonly='readonly' value="<? echo $typestr; ?>" />
</td>
</tr>
<tr>
<td align='center'>
Module:
</td>
<td>
<input type='text' name='module' readonly='readonly' value="<? echo $opttwo; ?>" />
</td>
</tr>
<tr>
<td align='center' >
Enabled?
</td>
<td>
<select name='enabled'>
<option value='yes' <? if ($row['enabled'] == '1') {echo "selected='selected'";}?> >Yes</option>
<option value='no' <? if ($row['enabled'] == '0') {echo "selected='selected'";}?> >No</option>
</select>
</td>

</tr>
<tr>
<td align='center'>
Code:
</td>
<td>
<center><font color='red'><? echo $texthelp; ?></font></center>
<textarea  name='info' rows=35 cols=80><? echo htmlentities($row['info']); ?></textarea>
</td>
</tr>
<tr>
<td align='center' >
Users completed:
</td>
<td>
<input type='text' name='userscompleted' value="<? echo $row['userscompleted']; ?>" size=4/>
</td>
</tr>
<tr>
<td align='center' >
Last user:
</td>
<td>
<input type='text' name='last_user' readonly='readonly' value="<? echo $row2['full_name']; ?>" />
</td>
</tr>
<tr>
<td></td>
<td align='center'>
<input type='submit' value='Edit'/>
</td>
</tr>
</table>
</form>
<?
}//close isset(opttwo)
?>

This doesn't work inside html.
Code: [Select]
<tr valign="top">
                <td height="22" align="right" valign="middle"><!-- <img src="images/bult-gamblingtemplatesdotnet.jpg" width="11" height="11"> --></td>
                <td height="22" valign="middle"><class="navbar3">
                <?php
include("config.php");
$result = mysql_query("SELECT name, lic_num, purpose FROM charity where sysdate() between start_date and end_date");
while ($row = mysql_fetch_array($result,MYSQL_ASSOC)) {
print "<b>Charity: </b>".$row{'name'}."<br><b>License #: </b>".$row{'lic_num'}."<br><b>Purpose: </b>".$row{'purpose'}."<p>";
}
mysql_close($dbh);
?></td>

This is the output on the website.
Code: [Select]
Charity: ".$row{'name'}."
License #: ".$row{'lic_num'}."
Purpose: ".$row{'purpose'}."

"; } mysql_close($dbh); ?>

When I do this
Code: [Select]
<tr valign="top">
     <td height="22" align="right" valign="middle"><!-- <img src="images/bult-gamblingtemplatesdotnet.jpg" width="11" height="11"> --></td>
     <td height="22" valign="middle"><class="navbar3"><?php include("test.php"); ?></td>
</tr>

I get this
Code: [Select]



Can someone please point me in the correct direction?
Also if I run the code as a stand alone it works perfectly.

Thanks

I am sure this has been answered in the past and is a valid question, I have searched high and low for this solution on and off for a few months. Any help would be greatly appreciated...

Please note: if you respond, keep it simple-ish - I code but not advanced.

First, take a look at the HTML source on the following page... Specificity the meta description.
http://boormanarchery.com/test.php?route=common/home&information_id=5

Code: [Select]
<META NAME="Description" CONTENT="Terms &amp; Conditions - <p>

Terms &amp; Conditions</p>

">
HTML code is pulled into the description field... I want to strip every single piece of HTML.

Here is my HTML / PHP code...

Code: [Select]

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />

<?php
$con = mysql_connect("localhost","username","password");
mysql_select_db("MyDatabase",$con);
if (!$con)
  {
  die('Could not connect: ' . mysql_error());
  }

// Get ID From URL
$id = (isset($_GET['information_id']) ? $_GET['information_id'] : 0);
$routeid = (isset($_GET['route']) ? $_GET['route'] : 0);

// Return Product Code and Select
$details = "SELECT * FROM information_description WHERE information_id=($id)";

$SQ_query = mysql_query($details);
$detail = mysql_fetch_array($SQ_query);

$metatitle = $detail['title'];
$longdescription = $detail['description'];

$metadescription=substr($longdescription, 0, 150);
$metakeywords=substr($longdescription, 0, 150); 

mysql_close($con);
?>

<html>
<head>
<title>Boorman Archery: <?php echo "$metatitle"; ?></title>
<META NAME="Description" CONTENT="<?php echo "$metatitle"; ?> - <?php echo html_entity_decode($metadescription, ENT_QUOTES, "ISO-8859-1"); ?>">
<META NAME="Keywords" CONTENT="<?php echo "$metatitle"; ?> , archery, boorman, bows, arrows">
<META NAME="author" content="Randall Wright">
<META NAME="copyright" content="Boorman Archery">
<meta http-equiv="pragma" content="no-cache">
<META NAME="language" content="en-us">
<META NAME="rating" content="General">
<META name="robots" content="index,follow">
<META NAME="revisit-after" content="7 Days">
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">

</head>

<body>

</body>
</html>

What is the correct order for HTML?
 

<html>
<head>
<title>
</title>
</head>
<body
</body>
</html>