PHP - Proper Http Request

Hello,
If i am not posting this question at right location then i apologize for it.

My problem is: I need to send HTTP get request to the webservice end point which must include the following http headers:

GET / HTTP/1.1
Host: apis.live.net
Accept: application/json
Content-Type: application/json
Authorization: WRAP access_token=AuthToken (here AuthToken is the Access Token String)

Note: I am using OAuth for getting an access Token but for getting contents I need to send an HTTP get request.

Any kind of help will be appreciated.
Thanks

Hey guys, every now and then some of my scripts that consistently access headers seem to fail to open the stream. I'm running about 1-50 of these shell scripts at once, but it doesn't seem to make a difference weather I have 1 or 50 scripts open at once. I was wondering if there was a way to tell PHP: Alright, so it failed to open the http stream, I want you to try again until it works. I just want it to try again until it works, because when it doesn't load certain headers, things go very wrong. Thanks.

Here's an example of the code where the problem occurs:
$Attack = file_get_contents($MobLink."attack?user_id=".$UserID."&target_id=".$TargetID."&auth_key=".$AuthKey);
xml_parse_into_struct($iP=xml_parser_create(), $Attack, $iS, $iX);xml_parser_free($iP);
echo "$i :.:.: ".strip_tags($iS[$iX['MESSAGE'][0]]['value'])." :.:.:\n\n";

First thanks for any help that you can provide. I am somewhat new to PHP and this is the first "Web Service" I have had to create.

THE GOAL:
I need to pull XML data from another server. This company's API is setup so that you must give an IP and so you can only pull data from server to server instead of client to server. The data is pulled from the API using HTTP requests...very similar to YQL. (in essence the structured query is located in the URL).  This API also requires that my server only ping's their server every 10-15 mins, in order to cut down on server requests.

The logical thought in my head was to setup: a cron job to run a PHP script every 10 mins. The PHP scripts would then do the following:
1. Make the HTTP request
2. Open an existing file or create one (on my server)
3. Take the returned XML data from the API and write to the newly opened file.
4. Convert that XML to JSON.
5. Save the JSON
6. Cache the JSON file
7. STOP

My thought was to use curl and fopen for the first 3 steps. I found a basic script that will do this on PHP.net (as shown below). After that I am pretty much lost on how to proceed.


Code: [Select]
<?php

$ch = curl_init("http://www.example.com/");
$fp = fopen("example_homepage.txt", "w");

curl_setopt($ch, CURLOPT_FILE, $fp);
curl_setopt($ch, CURLOPT_HEADER, 0);

curl_exec($ch);
curl_close($ch);
fclose($fp);
?>

I would REALLY appreciate any help on this. Also, if you have the time to please comment and explain what you are doing in any code examples and why....that would HELP out a lot. I truly want to learn not just grab a snippet and run. So, your comments are vital for me.

thank!!!

Hey! I am trying to get a database table of users but am running into the error:

Warning: file_get_contents(http://protege-ontology-editor-knowledge-acquisition-system.136.n4.nabble.com/template/NamlServlet.jtp?macro=user_nodes&amp;user=68583) [function.file-get-contents]: failed to open stream: HTTP request failed! HTTP/1.1 500 in get_user_from_parameter(nabble:utilities.naml:890) - <n.get_user_from_parameter.as_user_page.do/> - public v in C:\xampp\htdocs\website4js\stanford\loadUsernames.php on line 32

I have looked it up and it may be a security thing...The urls I am getting are http://protege-ontology-editor-knowledge-acquisition-system.136.n4.nabble.com/template/NamlServlet.jtp?macro=user_nodes&user=68583 but the error adds an nodes&amp; part that screws it up. Any way around this?

Code: [Select]
<?PHP
$maxPage = 0;
$mainPage = "http://protege-ontology-editor-knowledge-acquisition-system.136.n4.nabble.com/template/NamlServlet.jtp?macro=app_people&node=136";
$mainContent = file_get_contents($mainPage);
$pattern = "/(?<=\"Page )\d\d+/";
preg_match_all($pattern, $mainContent, $pageNumb);

//find the max page
for($i=0;$i<sizeof($pageNumb[0]);$i++) {
if($pageNumb[0][$i] > $maxPage) {
$maxPage = $pageNumb[0][$i];
}
}
//echo('Max page is: '.$maxPage.'\n');

//Get an array of all the pages
$pages = array();
 for($i=1;$i<$maxPage;$i++) {
$pages[$i] = "http://protege-ontology-editor-knowledge-acquisition-system.136.n4.nabble.com/template/NamlServlet.jtp?macro=app_people&node=136&i=".($i*20);
 }
//print_r($userPages);

//Get personal page urls and add to MySQL
mysql_connect("localhost" , "root") or die("Cant connect");
mysql_select_db("protegeusers") or die("Cant find database");
foreach($pages as $url) {
$urlContents = file_get_contents($url);
$pattern = "/http:\/\/protege-ontology-editor-knowledge-acquisition-system\.136\.n4\.nabble\.com\/template\/NamlServlet\.jtp\?macro=.+;user=\d+/";
preg_match_all($pattern, $urlContents, $personalPage);
foreach($personalPage as $user) {
for($i=0; $i<sizeof($user);$i++) {
[color=green]$userContents = file_get_contents($user[$i]);[/color]
$pattern1 = "/user\/SendEmail\.jtp\?type=user.+;user=\d+/";
$pattern2 = "/(?<=\">Send Email to ).+(?=<)/";
preg_match_all($pattern1, $userContents, $userEmail);
preg_match_all($pattern2, $userContents, $username);
[color=green]print_r($username);
print_r($email);[/color]
//$query = "INSERT INTO users (username, userurl) values ('$userName','$userUrl')";
//mysql_query($query);
}
}
}
?>

I am trying to figure how to code around this. I have a DOM scraper function that pulls urls from my database, opens the page, scrapes the data, and then moves onto the next URL to scrape. my issue is that if the page fails to load the script bombs and I have to restart it again. Trying to figure out how if the Code: [Select]
$html->find('div[class="itemHeader address"]') as $div fails to open the page it just skips the DOM inspection.

Here is my error...

Failed to open stream: HTTP Request failed.

Here is where I am at with my script....

Code: [Select]
mysql_select_db("scraped") or die(mysql_error());
$result = mysql_query("SELECT PKEY, URL, HASSCRAPED, SHOULDSCRAPE FROM CRAWLED WHERE SHOULDSCRAPE ='1' AND HASSCRAPED = '0'") or die(mysql_error()); 

while($row = mysql_fetch_array( $result )) {
mysql_query("UPDATE CRAWLED SET CRAWLED.HASSCRAPED =  '1' WHERE CRAWLED.URL = '" . $row['URL'] . "'");
$html = file_get_html($row['URL']);
foreach($html->find('div[class="itemHeader address"]') as $div) {
foreach($div->find('a') as $element){
$CleanData = CleanData($element->innertext);
if (strlen($CleanData[0]) > 5){
    mysql_query("INSERT INTO SCRAPED (ADDR1, CITY, STATE, ZIP, URL, DATE) VALUES ('" . $CleanData[0] . "','" . $CleanData[1] . "','" . $CleanData[2] . "','" . $CleanData[3] . "','". $row['URL'] . "','". date( 'Y-m-d H:i:s ' ) ."')");
        }
}
}

$html->clear();
unset($html);
unset($CleanData);
}

function CleanData($data) {
  $NewData = trim($data);
  $NewData = str_replace("<em>", "", $NewData);
  $AddrCityStateZip = explode("</em>",$NewData);
  $CityStateZip = explode(",",$AddrCityStateZip[1]);
  $StateZip = explode(' ',$CityStateZip[1]);
  $NewDataArray = array ($AddrCityStateZip[0], $CityStateZip[0], $StateZip[1], $StateZip[2]);
  return $NewDataArray;
  unset($NewData);
  unset($AddrCityStateZip);
  unset($CityStateZip);
  unset($StateZip);
}
mysql_close($link);
echo 'Scraping has compleated without error';

Hi everyone:

Can someone show me an example of the proper way to request an id, and then use "If Then Else" statements to display data depending on the id selected.

I am use to doing this with ASP, but never with PHP. I have found so many different examples on GOOGLE, but would like some input from this forum. That always helps me.

I have a page roster.php:
Code: [Select]
<html>
...
<a href="players.php?PlayerID=1">Player 1</a><br />
<a href="players.php?PlayerID=2">Player 1</a><br />
<a href="players.php?PlayerID=3">Player 1</a><br />
<a href="players.php?PlayerID=4">Player 1</a><br />
...
</html>

Then it goes to players.php:
Code: [Select]
<?php
$myvar = $_REQUEST['PlayerID'];
echo $myvar;
?>

IS THE ABOVE THE PROPER WAY TO REQUEST AN ID?

<html>
...

<% If PlayerID=1 Then %>
PLAYER 1 PHOTO AND BIO
<% ElseIf PlayerID=2 Then %>
PLAYER 2 PHOTO AND BIO
<% ElseIf PlayerID=3 Then %>
PLAYER 3 PHOTO AND BIO
<% Else %>
PLAYER 4 PHOTO AND BIO
<% End If %>
...
</html>

I would write it somewhat like that with ASP.

How do I do this with PHP?

Thanks!

Doing something wrong, but don't see it.  How should one retrieve a POST parameter?  My $request->toArray()['html'] works, but I am sure it is not the "right way".

<?php
namespace App\DataPersister;
use ApiPlatform\Core\DataPersister\DataPersisterInterface;
use Symfony\Component\HttpFoundation\RequestStack;

class ArchivePersister implements DataPersisterInterface
{
    public function __construct(RequestStack $requestStack)
    {
        $request = $requestStack->getCurrentRequest();
        syslog(LOG_ERR, '$request->getMethod(): '.$request->getMethod());
        syslog(LOG_ERR, '$request->getContent(): '.$request->getContent());
        syslog(LOG_ERR, '$request->request->get(html): '.$request->request->get('html'));
        syslog(LOG_ERR, '$request->query->get(html): '.$request->query->get('html'));
        syslog(LOG_ERR, '$request->get(html): '.$request->get('html'));
        syslog(LOG_ERR, '$request->toArray(): '.json_encode($request->toArray()));
        syslog(LOG_ERR, '$request->toArray()[html]: '.$request->toArray()['html']);
    }
}

output

$request->getMethod(): POST
$request->getContent(): {"project":"/projects/1","description":"","html":"<p>{{ project_name }}</p>"}
$request->request->get(html):
$request->query->get(html):
$request->get(html):
$request->toArray(): {"project":"\/projects\/1","description":"","html":"<p>{{ project_name }}<\/p>"}
$request->toArray()[html]: <p>{{ project_name }}</p>

Trying to run a simple program that, when submitted, stores the username and password as cookies.  When clicking Submit, I get the error  "HTTP Error 405 - The HTTP verb used to access this page is not allowed". If the username and password fields are left blank when submitting it's suppose to give a message to enter a username and password, but, I still get that error message.

HTML form:

Code: [Select]

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<title>Week 1 Project--Cookies</title>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" />


</head>

<body>
<form action="cookie1.php" method="post">
<h2 align="center">Cookies</h2>

<br />
<div>
<p>Enter your username and password and click "Submit":</p><br />
<p>Username:<input type="text" name="username" size="20"></p>
<p>Password:<input type="text" name="password" size="20"></p>
</div>
<br />
<div><input type="submit" name="submit" value="Submit" /></div>
<br />
<div>
<input type="reset" name="Reset" value="Start Over" />
</div>

</form>



</body>
</html>


PHP file:

Code: [Select]

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<title>Cookie File</title>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" />
</head>

<body>
<div>
<?php
if ($_SERVER['REQUEST_METHOD'] == 'POST')
{
 setcookie('username', $_POST['username'], time() + 2592000);
 setcookie('password', $_POST['password'], time() + 2592000);
}
if(($_POST['username'] == "") || ($_POST['password'] == "")) {
print "You must enter both a username and password. Press the Back button on your browser and try again.";
}
else if (isset($_COOKIE['username'])) {
print "Welcome, " .$_COOKIE['username'];
}
?>
</div>
</body>
</html>

How do I only redirect the page when index.php is present?

Say I have two areas of a website. 

1 - root directory (index, sign up, sign in)

2 - folders (this would contain folders such as snippets, members, assets)

Due to the nature of the folders, the links cannot be the same as they are on the pages in the root directory. Index page for example.  So if I'm on members/dashboard.php, any a links linking to index.php, will have to have "../" in front of them. To solve the issue, my current set up is like this. But I understand it's not the most efficient way to do this. I was wondering if you can share your expertise for a better method.

$currentPage = basename($_SERVER['PHP_SELF'], ".php");

<?php if($currentPage == 'index' || $currentPage == 'members') { ?>

	<!DOCTYPE HTML>
	<head>
		<meta charset="UTF-8">
		<title></title>
		<meta http-equiv="X-UA-Compatible" content="IE=edge">
		<meta name="description" content="">
		<link rel="shortcut icon" href="images/favicon.ico.png">
		<link href="css/screen.css" media="screen" rel="stylesheet" />
	</head>
	<body>
    <a href="index">
      <img src="images/logo.PNG" alt="logo" />
    </a>
  </body>

<?php } else { ?>  

  <!DOCTYPE HTML>
  <head>
    <meta charset="UTF-8">
    <title></title>
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <meta name="description" content="">
    <link rel="shortcut icon" href="../images/favicon.ico.png">
    <link href="../css/screen.css" media="screen" rel="stylesheet" />
  </head>
  <body>
    <a href="../index">
      <img src="../images/logo.PNG" alt="logo" />
    </a>
  </body>

<?php } else { ?>  

 

Should this be the proper way of adding the getUsername() text in the query below:

Code: [Select]
mysql_query("UPDATE posts SET content = '$content', lastedit = ". getUsername() .":NOW() WHERE id = '$pid'") or die(mysql_error());

Im having trouble with this wondering if someone could help me out please

if (isset($_POST['escape'])) { || if (isset($_POST['suicide'])) {

its giving me a error on the ||

im writing it so that one or the other has to happend. is this the correct way to use this?

Just curious, what is proper programming in cases where you're just doing a simple IF statement where there really is no need for an ELSE.  Should you still write out the ELSE?

For example, which is proper...
Code: [Select]
if (x=1) {
//code here to do something
}

or
Code: [Select]
if (x=1) {
//code here to do something
} else {
}

There would be nothing in the ELSE statement, so is it OK to just leave it out completely (i.e. version #1), or is it proper to still have it listed (i.e. version #2)?

Code: [Select]
if (isset($select_category) || isset($most_liked)) {
// ALL but NO OTHER
if (((($select_category == 'All') || (!isset($select_category)))) && (!isset($most_liked))) {

           
$query = "SELECT * FROM con, user WHERE con.user_id = user.user_id ORDER BY contribution_date DESC";

fetch_all ($dbc, $query);


// CATEGORY but NOT most_liked
} elseif (isset($select_category) && !isset($most_liked)) {

$query = "SELECT * FROM con, user WHERE con.user_id = user.user_id AND category = '$select_category' ORDER BY contribution_date DESC";

fetch_all ($dbc, $query);

// CATEGORY and MOST_LIKED
} elseif (($select_category != 'All') && (isset($select_category) && isset($most_liked))) {

$query = "SELECT * FROM con, user WHERE con.user_id = user.user_id AND category = '$select_category' ORDER BY likes DESC";

fetch_all ($dbc, $query);

// ALL or NO CATEGORY but MOST LIKED
} elseif ((($select_category == 'All') || (!isset($select_category))) && (isset($most_liked))) {

$query = "SELECT * FROM con, user WHERE con.user_id = user.user_id ORDER BY likes DESC";
fetch_all ($dbc, $query);

}

}

What I am basically trying to accomplish is, choose a category through a drop down list, select that category and then go through all the rows in the database and print the content out.

As of now it is working for me, I am also using a pagination script to print out everything in a table.

The problem I am having is that fetch_all function is also printing the query out together with the content. Any ideas why it does that?

Did I use this function the right way?

If you need more information let me know.

Hello everyone, I've recently asked a question about forms and Requinix mentioned PRG method of processing forms. The PRG idea solves my refresh and back button document expired problems but i notice something new: when i refresh a page or use the browser back button - then return to the PRG process - repeat a refresh or back button action - i notice that i can traverse the cache history as many times as my prg approach redirects me. I feel like i am not implementing this PRG method correctly, or is this correct?

Here is the form process if it helps solve the problem:

i have a login form which contains a CSRF token. when i submit the form i specify an action as /prg/ which submits the data to index.php in the prg folder. After processing the data, prg index.php redirects to the root (because you are logged in). One problem is that i have a logo on the login page that allows you to return to the root (localhost index page). When the form is not submitted or it contaiuns incorrect login data or the logo is clicked to return to homepage, then the history seems to repeat itself. I've read that people recommend to use a header 303 See Other but the result is the same. Basiclly, if i am implementing a prg correctly, then the question becomes how can i instruct a browser to ignore the redirect as if the cache contains only the index page?

i cannot find prg examples that involve a csrf token and other links on the protected page (prg/index.php protected because you need a form submission with a csrf token and it only processes data then redirects.) I don't see this happening in professional sites like Google or Microsoft etc. what am i doing wrong?