PHP - Parsing Html To Strip Required Data

I think what I'd like to do is very simple, but I just can't figure out how to accomplish the task.  Fair warning -- I'm pretty new to PHP and any help is appreciated.

I have a form that takes in multiple fields of data and stores it in a mysql database.  I'm trying to output the data to another page on my website and I'm able to do that, but I'm really looking to output it in a way that's easily formatted using CSS.

This is on a wordpress site and I'm using the following code to output my data:

Code: [Select]
<?php 
$result = $wpdb->get_results ("SELECT field_val FROM wp_cformsdata WHERE field_name <> 'page' OR 'Fieldset1'", OBJECT);
foreach ($result as $teaminfo)
{
echo $teaminfo->field_val . "<br/>";
}
?>

Obviously, this just outputs the data with a <br> after each field value.  I'd like to see if there's a way to individually echo each field, such as "echo $teaminfo->name;" or "echo $teaminfo->address;" so that I can wrap each echo within a CSS class.

Alternatively, would there be a way to echo the field_val wrapped around <span class="field_name"></span> ?  This would also suit my needs, but I'm not sure how to accomplish it.

Also, unfortunately I don't have remote access to mysql with my hosting company, but I've included the output from myphpadmin when I run describe wp_cformsdata; :



Thank you in advance for your help.

good day dear phpfreaks. 

 

I am new to PHP's SimpleXML. i want to work with SimpleXML on OSM-files.

The original version of this question was derived from he OSM Data parsing to get the nodes with child 

https://stackoverflow.com/questions/16129184/osm-data-parsing-to-get-the-nodes-with-child

I am thankful that hakre offered a great example in the comments that makes a overwhelming 
starting point for my project. Below I have added my own answer to the question, how to refine the code to ad more tags. I can work on the methods using SimpleXML and Xpath; The job is most easily done with xpath, the used PHP XML library is based on libxml  which supports XPath 1.0 which covers the various querying needs very well.

goal: how to get more out of it: I want to filter the data to get the nodes with special category. Here is sample of the OSM data I want to get the whole schools within an area. The first script runs well - but now I want to refine the search and add more tags. Finally I want to store all into MySQL.

So we need to make some XML parsing with PHP:

The following is a little OSM Overp
 

 

 

Quote

 

# get all school nodes with xpath
$xpath = '//node[tag[@k = "amenity" and @v = "school"]]';
$schools = $result->xpath($xpath);
printf("%d School(s) found:\n", count($schools));
foreach ($schools as $index => $school)
{
    # Get the name of the school (if any), again with xpath
    list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
    printf("#%02d: ID:%' -10s  [%s,%s]  %s\n", $index, $school['id'], $school['lat'], $school['lon'], $name);
}

since i am learning - i break down the code into pieces...For my question, the second part is more interesting here.

That is querying the XML data we have already. Again - as mentioned above: This is most easily done with xpath, the used PHP XML library is based on libxml which supports XPath 1.0  which covers the various querying needs very well. The following example lists all schools and tries to obtain their names as well.

# get all school nodes with xpath
$xpath = '//node[tag[@k = "amenity" and @v = "school"]]';
$schools = $result->xpath($xpath);
printf("%d School(s) found:\n", count($schools));
foreach ($schools as $index => $school)
{
    # Get the name of the school (if any), again with xpath
    list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
    printf("#%02d: ID:%' -10s  [%s,%s]  %s\n", $index, $school['id'], $school['lat'], $school['lon'], $name);
}
The key point here are the xpath queries: Two are used, the first one to get the nodes that have certain tags.

//node[tag[@k = "amenity" and @v = "school"]]

This line says: Give me all node elements that have a tag element inside which has the k attribute value "amenity" and the v attribute value "school". Explanation: This is the condition we have to filter out those nodes that are tagged with amenity school.

Further on xpath is used again - a second time: now relative to those school nodes to see if there is a name and if so to fetch it: Therefore we use the foreach-syntax:

foreach ($schools as $index => $school)
{
    # Get the name of the school (if any), again with xpath
    list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
    printf("#%02d: ID:%' -10s  [%s,%s]  %s\n", $index, $school['id'], $school['lat'], $school['lon'], $name);
}
and

tag[@k = "name"]/@v'
= $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
and this is pretty important

tag[@k = "name"]/@v'
This line says: Relative to the current node, give me the v attribute from a tag element that as the k attribute value "name". As you can see, some parts are again similar to the line before. I think you can both adopt them to your needs.

Because not all school nodes have a name, a default string is provided for display purposes by adding it to the (then empty) result array:

list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
                                                    ^^^^^^^^^^^^^^^
                                                Provide Default Value
So here some of the results for that code-example:

Query returned 907 node(s) and took 1.10735 seconds.
more than 2000 School(s) found:
#00: ID:332534486   [39.5017565,16.2721899]  Scuola Primaria
#01: ID:1428094278  [39.3320912,16.1862820]  (unnamed)
#02: ID:1822746784  [38.9075566,16.5776597]  (unnamed)
#03: ID:1822755951  [38.9120272,16.5713431]  (unnamed)
#04: ID:1903859699  [38.6830409,16.5522243]  Liceo Scientifico Statale A. Guarasci
#05: ID:2002566438  [39.1347698,16.0736924]  (unnamed)
#06: ID:2056891127  [39.4106679,16.8254844]  (unnamed)
#07: ID:2056892999  [39.4124687,16.8286119]  (unnamed)
#08: ID:2272010226  [39.4481717,16.2894353]  SCUOLA DELL'INFANZIA SAN FRANCESCO
#09: ID:2272017152  [39.4502366,16.2807664]  SCUOLA MEDIA 
and now i try to figure out how i can enter more xpath queries at the above mentioned code

goal: to get out even more important data - see here Key:contact - OpenStreetMap Wiki

   

Well - we are already extracting the name: If we want to have more data then we just have to run a few more xpath queries inside our loop for all the address keys and the website. So - additionally: we do not have to forget to look for the website key additional to contact:website. cf: https://wiki.openstreetmap.org/wiki/Key:website

conclusio: well - i think that i need to extend the xpath requests within the loop where xpath is used again,  now relative to those school nodes to see if there is a name and if so to fetch it:

tag[@k = "name"]/@v'
tag[@k = "contact:website"]/@v'
tag[@k = "contact:email"]/@v'
What do you say...?

i did some further tess and found out very interesting things

see more he - the code that runs very well:

#'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''#
<?php
/**
 * OSM Overpass API with PHP SimpleXML / XPath
 *
 * PHP Version: 5.4 - Can be back-ported to 5.3 by using 5.3 Array-Syntax (not PHP 5.4's square brackets)
 */
//
// 1.) Query an OSM Overpass API Endpoint
//

$query = 'node
  ["amenity"~".*"]
  (38.415938460513274,16.06338500976562,39.52205163048525,17.51220703125);
out;';

$context = stream_context_create(['http' => [
    'method'  => 'POST',
    'header' => ['Content-Type: application/x-www-form-urlencoded'],
    'content' => 'data=' . urlencode($query),
]]);

# please do not stress this service, this example is for demonstration purposes only.
$endpoint = 'http://overpass-api.de/api/interpreter';
libxml_set_streams_context($context);
$start = microtime(true);

$result = simplexml_load_file($endpoint);
printf("Query returned %2\$d node(s) and took %1\$.5f seconds.\n\n", microtime(true) - $start, count($result->node));

//
// 2.) Work with the XML Result
//

# get all school nodes with xpath
$xpath = '//node[tag[@k = "amenity" and @v = "school"]]';
$schools = $result->xpath($xpath);
printf("%d School(s) found:\n", count($schools));
foreach ($schools as $index => $school)
{
    # Get the name of the school (if any), again with xpath
    list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
    printf("#%02d: ID:%' -10s  [%s,%s]  %s\n", $index, $school['id'], $school['lat'], $school['lon'], $name);
}

//node[tag[@k = "amenity" and @v = "school"]]
//tag[@k = "name"]/@v'

$query = 'node
  ["addr:postcode"~"RM12"]
  (51.5557914,0.2118915,51.5673083,0.2369398);
   node
  (around:1000)
  ["amenity"~"fast_food"];
           out;';

$context = stream_context_create(['http' => [
    'method'  => 'POST',
    'header' => ['Content-Type: application/x-www-form-urlencoded'],
    'content' => 'data=' . urlencode($query),
]]);

$endpoint = 'http://overpass-api.de/api/interpreter';
libxml_set_streams_context($context);

$result = simplexml_load_file($endpoint);
printf("Query returned %2\$d node(s) and took %1\$.5f seconds.\n\n", microtime(true) - $start, count($result->node));
see the results:

me/martin/dev/php/o1.php on line 68
linux-3645:/home/martin/dev/php # php o1.php
Query returned 2799 node(s) and took 17.02055 seconds.

33 School(s) found:
#00: ID:332534486   [39.5018840,16.2722854]  Scuola Elementare
#01: ID:1428094278  [39.3320912,16.1862820]  (unnamed)
#02: ID:1822746784  [38.9075566,16.5776597]  (unnamed)
#03: ID:1822755951  [38.9120272,16.5713431]  (unnamed)
#04: ID:2002566438  [39.1349460,16.0736446]  (unnamed)
#05: ID:2056891127  [39.4106679,16.8254844]  (unnamed)
#06: ID:2056892999  [39.4124687,16.8286119]  (unnamed)
#07: ID:2272010226  [39.4481717,16.2894353]  Scuola dell'infanzia San Francesco
#08: ID:2272017152  [39.4502366,16.2807664]  Scuola Media
#09: ID:2358307794  [39.5015031,16.3905965]  I.I.S.S. Liceo Statale V. Iulia
#10: ID:2358307796  [39.4926280,16.3853662]  Liceo Classico
#11: ID:2358307797  [39.4973761,16.3858275]  Scuola Media
#12: ID:2358307800  [39.5015527,16.3941156]  I.T.C. e per Geometri
#13: ID:2358307801  [39.4983862,16.3807796]  Istituto Professionale
#14: ID:2448031004  [38.6438417,16.3873106]  (unnamed)
#15: ID:2458139204  [39.0803263,17.1291649]  Sacro Cuore
#16: ID:2552412313  [39.0765212,17.1224610]  (unnamed)
#17: ID:2582443083  [39.0815417,17.1178983]  Liceo Socio Biologico Gravina
#18: ID:2585754364  [38.8878393,16.4076323]  Scuola Elementare
#19: ID:2585754366  [38.8877600,16.4076216]  Scuola Media
#20: ID:3071126720  [38.6022703,16.5554408]  Scuola Media
#21: ID:3071127683  [38.6027273,16.5563125]  Scuola Elementare
#22: ID:3081362915  [39.2865638,16.2601963]  Convitto Nazionale Bernardino Telesio
#23: ID:3081362921  [39.2856714,16.2613594]  Liceo Classico B. Telesio
#24: ID:3081362926  [39.2888949,16.2577446]  Scuola
#25: ID:3732551794  [39.5132435,16.2863285]  (unnamed)
#26: ID:3740289655  [39.5167318,16.2838146]  scuola media
#27: ID:3740289656  [39.5164344,16.2821103]  scuola elementare
#28: ID:4004532684  [38.7804787,16.5122952]  Liceo Artistico
#29: ID:4589289756  [38.6794209,16.1063084]  Scuola Comprensiva Trentacapilli
#30: ID:4843966477  [39.0709866,17.1288384]  Pegaso
#31: ID:5297629775  [38.5768845,16.3263536]  Scuola Media Statale "Ignazio La Russa"
#32: ID:5316865306  [39.0807997,17.1264225]  Enrico Fermi
Query returned 3 node(s) and took 17.44780 seconds.

so far so good : if i add some lines in the part 2 i run into errors... -see below:
background: i want to get more data out of the dataset - i wnat to have more information about.

i want to get more data out of it:  - and coded like so;

{
    # Get the name of the school (if any), again with xpath
    list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
    list($name) = $school->xpath('tag[@k = "contact:website"]/@v');
    list($name) = $school->xpath('tag[@k = "contact:email"]/@v');
    printf("#%02d: ID:%' -10s  [%s,%s]  %s\n", $index, $school['id'], $school['lat'], $school['lon'], $name);
}

note - within the part 2 that works with the XML-Result.

//
// 2.) Work with the XML Result
//

# get all school nodes with xpath
$xpath = '//node[tag[@k = "amenity" and @v = "school"]]';
$schools = $result->xpath($xpath);
printf("%d School(s) found:\n", count($schools));
foreach ($schools as $index => $school)
{
    # Get the name of the school (if any), again with xpath
    list($name) = $school->xpath('tag[@k = "name"]/@v') + ['(unnamed)'];
    list($name) = $school->xpath('tag[@k = "contact:website"]/@v');
    list($name) = $school->xpath('tag[@k = "contact:email"]/@v');
    printf("#%02d: ID:%' -10s  [%s,%s]  %s\n", $index, $school['id'], $school['lat'], $school['lon'], $name);
}
the question is: how to get more out of it.. at least the address and the website and now i try to figure out how i can enter more xpath queries at the above mentioned code and get out even more important data - see here Key:contact - OpenStreetMap Wiki

    contact:phone
    contact:fax    
    contact:website
    contact:email

I will dig into all documents and come back later the weekend... and report all the findings

well - i think that i need to extend the xpath requests within the loop where xpath is used again, now relative to those school nodes to see if there is a name and if so to fetch it:

tag[@k = "name"]/@v'
tag[@k = "contact:website"]/@v'
tag[@k = "contact:email"]/@v'

 

Edited April 25, 2019 by dil_bert
more infos

I am having trouble parsing data that is separated by comas in an XLS file.

The upload and parsing scripts work beautifully, but the problem I am having is the data is read in from one cell (all 5 fields for the row are in column A)

I am exploding it by , but some of the cells contain comas.

For example a cell might contain "jim,jones,12345678,jim@jones.com,More, Data,192.168.1.1"
but the next one might be
"Dave,Thomas,98765432,dave@wendys.com,something else, 255.255.255.0"

The problem I am having is More, Data should be one cell.

Not all position 4 will have a , so I can't just add it back because the IP address would be appended to more...

Any ideas?  I hope thats clear enough...

Hello, I've tried to get a dynamic table from an external page, and searching for entries in it, so i used a dynamic XLS file using php excel reader. I only exported the file, but i couldn't search for data. Can i get some help please ?

Hi guys. I have been using the wikipedia API to retrieve information about a topic. Ive managed to get a response and retrieve the first section of the topic (in this case football)

Using this method - http://en.wikipedia.org/w/api.php?action=parse&page='.$search.'&redirects=1&format=json&prop=text&section=0');

However the first section that is retrieved includes the pictures and i just want to main text from the introduction.

The code that is sent back from wiki is this -
Code: [Select]
Array
(
    [parse] => Array
        (
            [text] => Array
                (
                    [*] => <div class="dablink">This article is about sports known as football.  For the ball used in these sports, see <a href="/wiki/Football_(ball)">Football (ball)</a>.</div>
<div class="thumb tright">
<div class="thumbinner" style="width:227px;"><a href="/wiki/File:Football4.png" class="image"><img alt="" src="http://upload.wikimedia.org/wikipedia/commons/thumb/d/d2/Football4.png/225px-Football4.png" width="225" height="274" class="thumbimage" /></a>
<div class="thumbcaption">
<div class="magnify"><a href="/wiki/File:Football4.png" class="internal" title="Enlarge"><img src="http://bits.wikimedia.org/skins-1.17/common/images/magnify-clip.png" width="15" height="11" alt="" /></a></div>
Some of the many different games known as football. From top left to bottom right: <a href="/wiki/Association_football">Association football</a> or soccer, <a href="/wiki/Australian_rules_football">Australian rules football</a>, <a href="/wiki/International_rules_football">International rules football</a>, <a href="/wiki/Rugby_Union" class="mw-redirect" title="Rugby Union">Rugby Union</a>, <a href="/wiki/Rugby_League" class="mw-redirect" title="Rugby League">Rugby League</a>, and <a href="/wiki/American_Football" class="mw-redirect" title="American Football">American Football</a>.</div>
</div>
</div>
<p>The game of <b>football</b> is any of several similar <a href="/wiki/Team_sport" title="Team sport">team sports</a>, of similar origins which involve advancing a ball into a goal area in an attempt to score. Many of these involve <a href="/wiki/Kick_(football)" title="Kick (football)">kicking</a> a ball with the foot to score a <a href="/wiki/Goal_(sport)" title="Goal (sport)">goal</a>, though not all codes of football using kicking as a primary means of advancing the ball or scoring. The most popular of these sports worldwide is <a href="/wiki/Association_football">association football</a>, more commonly known as just "football" or "soccer". Unqualified, the word <i><a href="/wiki/Football_(word)" title="Football (word)">football</a></i> applies to whichever form of football is the most popular in the regional context in which the word appears, including <a href="/wiki/American_football">American football</a>, <a href="/wiki/Australian_rules_football">Australian rules football</a>, <a href="/wiki/Canadian_football">Canadian football</a>, <a href="/wiki/Gaelic_football">Gaelic football</a>, <a href="/wiki/Rugby_league">rugby league</a>, <a href="/wiki/Rugby_union">rugby union</a> and other related games. These variations are known as "codes".</p>

I want the code that resides in the <p> tags. How would i go about parsing this and removing the rest. ive tried to get to work simple html dom parser but with no luck.

Any help would be greatly appreciated 

Thanks,

DIM3NSION

Hi,

I am trying to make a web interface for a robot, I have written php to send/recieve values via a serial port to my robot. They work.

I am now tring to develop my web interface.

I'm using java to generate http requests client side in the form of;
Code: [Select]
/request?command=Forward&param1=254
I was wondering how I can parse the command and param1 in php sereverside?

Or is there a better alternative?

Hi guys,
im trying to parse a html table from an existing website to my own. However ive run into a few problems. Does anyone know how to parse html tables?? im using the PHP DOM Parser but at the moment i am only able to return all the data on the website rather then the specific table.
Thanks for any help!

This topic has been moved to PHP Regex.

http://www.phpfreaks.com/forums/index.php?topic=308636.0

Hello again,

I'm trying to scrape a table from another website using preg_match, especifically, using this code:
Code: [Select]
<?php 
$data = file_get_contents('http://tvcountdown.com/index.php');
$regex = '/[color=red]<table class="episode_list_table">[/color] (.+?) [color=red]</table>[/color]/';
preg_match($regex,$data,$match);
var_dump($match); 
echo $match[0];
?>
Heres the thing. It doesnt work   
I think it's because the first and second anchors are html tags, 'cause if I parse some other stuff without any tag, there's no problemo.

Any hints, mates?
Thanks

Hello dear Community,

i have a document i need to parse it and spit out only this part of the table:

see http://schulnetz.nibis.de/db/schulen/schule.php?schulnr=67003&lschb=

how to i parse the stuff!? With perl or php?

Note i have the xpaths (see below) Sad that i cannot apply them on Simple DOM Parser since this Dom Parser does not work with Xpaths but with  CSS-Selectors:

Well i want to get all the data with that are within the table that name is called  class="fliess"

How to dump all the results?
BTW - thinking about the most elegant way, i think it is the most pretty way would be to do it with perl - So i can try it with HTML::TableExtract or....

Well what do you suggest - Which way to choose to do this [very] simple thing?


Look forward to hear from you!

see the xpaths:

Schule:  /html/body/center/table/tbody/tr[2]/td[1]
Stasse: /html/body/center/table/tbody/tr[3]/td[1]
Ort:     /html/body/center/table/tbody/tr[4]/td[1]
Tel:     /html/body/center/table/tbody/tr[5]/td[1]
Schulgliederungen:  /html/body/center/table/tbody/tr[6]/td[1]
Besonderheite: /html/body/center/table/tbody/tr[7]/td[1]
E-Mail: /html/body/center/table/tbody/tr[8]/td[1]
Schulnummer: /html/body/center/table/tbody/tr[9]/td[1]

Hey guys,

So when I put the following line of php on an html page:
Code: [Select]
echo '&reg';

I get the 'Registered' symbol. How do I turn this off? What is happening is that it is part of a longer string that represents an url and the URL is not rendering correctly due to the special character.

Thanks

Hello to all,

I have problem figuring out how to properly display data fetched from MySQL database in a HTML table.

In the below example I am using two while loops, where the second one is nested inside first one, that check two different expressions fetching data from tables found in a MySQL database. The second expression compares the two tables IDs and after their match it displays the email of the account holder in each column in the HTML table.

The main problem is that the 'email' row is displayed properly while its while expression is not nested and alone(meaning the other data is omitted or commented out), but either nested or neighbored to the first while loop, it is displayed horizontally and the other data ('validity', 'valid_from', 'valid_to') is not displayed.'

Can someone help me on this, I guess the problem lies in the while loop?
Here is part of the HTML code:

<thead>
 <tr>
 <th data-column-id="id" data-type="numeric">ID</th>
 <th data-column-id="email">Subscriber's Email</th>
 <th data-column-id="validity">Validity</th>
<th data-column-id="valid_from">Valid From</th>
 <th data-column-id="valid_to">Valid To</th>
</tr>
</thead>

Here is part of the PHP code:

 

    <?php
    while($row = $stmt->fetch(PDO::FETCH_ASSOC))
    {
        echo '
            <tr>
                <td>'.$row["id"].'</td>
        ';
        while ($row1 = $stmt1->fetch(PDO::FETCH_ASSOC)) {
        echo '
                <td>'.$row1["email"].'</td>
        ';
        }
        if($row["validity"] == 1) {
            echo '<td>'.$row["validity"].' month</td>';
        }else{
            echo '<td>'.$row["validity"].' months</td>';
        }
        echo '  <td>'.$row["valid_from"].'</td>
                <td>'.$row["valid_to"].'</td>
        </tr>';
    }
    ?>

P.S. Please know that I have purposely omitted the connection part and the methods in the class that are used in this code to keep the spot of the problem as clean as possible. If you need me to rephrase the question, please ask.

Thank you.

I have a paragrpah which has tags that needs to be stripped off.

so the paragraph looks like

Quote

<div id="ctl00_placeholderMain_pnlInTheBox" class="tabitem">                       <p>                      HP LaserJet 9050 printer<br/> Power cord<br/> Parallel cable<br/> HP LaserJet Q8543X Smart print cartridge<br/> Printer documentation<br/> Printer software CD<br/> Control panel overlay<br/> Face-up output bin<br/> Two 500-sheet input tray<br/> 100 Sheet Multipurpose Tray<br/> HP JetDirect Fast</p>                </div>


I want it to look like

Quote

HP LaserJet 9050 printer
Power cord
Parallel cable
HP LaserJet Q8543X Smart print cartridge
Printer documentation
Printer software CD
Control panel overlay
Face-up output bin
Two 500-sheet input tray
100 Sheet Multipurpose Tray
HP JetDirect Fast


How would I go on about doing this..

currently i use

Code: [Select]
$inbox = $html->find( "#ctl00_placeholderMain_pnlInTheBox" );

if ( isset( $inbox[ 0 ] ) )
{



$box =( $inbox[0] );

$box = strpos($box, ';') !== FALSE ? substr( $box, strpos( $box, ";" ) + 1 ) : $box; 


}
else
{
$box = "0";
}

$name = "D'Angelo" 

ok I'm running a mysql query as

$query = " INSERT INTO TEST (ID, NAME) VALUES ('NULL','$NAME')";


If the name = "D'Angelo" the apostrophe would cause it to fail. Is there a way to do this without striping the characters? 

Hi All I Am confused

I would like to put info into a database but need it to be secure. I have some code shown below. The problem is I would like to put in ' but keep the data secure.
When it comes back I do not want to show \' I think you might know what I am trying to do.
Here is the code but would like to know how to stop the \' showing.
Code: [Select]
$password = mysql_real_escape_string(stripslashes(trim($_POST['password'])));
Any help would be great thank you.