PHP - How To Extract Data Using A Pattern By Simple Html Dom?

There is a web page that is programmed in ASP and has a simple one field form (drop down list) and a submit button.
After you submit the form by selecting an option (over 150 options), it will take you to the result page using the "Post" method. The variable does not show in the result page URL. The result page has table with multiple columns.
What I want is to have ALL the results in one CSV file.

Here what I really need in details:
1- Import all tables (one table for each option in the drop-down list) into a CSV file.
2- The content of two columns has codes. Replace all the codes in the table to a separate column.
3- Create an additional column that contains the name of the option on the first page form.

I need to have it in a php file so that I can run it via cron job few times a year.

How can I obtain this functionality with PHP?

I'm trying to build a calculator for a game...but I'm stuck on the extracting part. I don't really know what it's called (so if you know of a tutorial/handbook please link), but how I would I extract this data:

//data to extract
$name = "Robin hood hat"
$currentprice = "3.3m"
$change = "+11.5k"
//display
echo $name
echo $currentprice
echo $change

from: http://itemdb-rs.runescape.com/results.ws?query=robin hood hat

And a small question: how would I convert "+11.5k" into "11500" (1k = 1,000)? The * multiplies it but how do I check for and remove the "+" and "k"?

Hi,

Anybody can help me to extract data from son using php

 

{"location":{"woeid":2293962,"city":"Kasaragod","region":" KL","country":"India","lat":12.5174,"long":74.990662,"timezone_id":"Asia/Kolkata"},"current_observation":{"wind":{"chill":80,"direction":338,"speed":11.81},"atmosphere":{"humidity":70,"visibility":10.0,"pressure":29.8,"rising":0},"astronomy":{"sunrise":"6:54 am","sunset":"6:35 pm"},"condition":{"text":"Clear","code":31,"temperature":80},"pubDate":1549638000},"forecasts":[{"day":"Fri","date":1549564200,"low":76,"high":85,"text":"Sunny","code":32},{"day":"Sat","date":1549650600,"low":76,"high":85,"text":"Sunny","code":32},{"day":"Sun","date":1549737000,"low":75,"high":85,"text":"Sunny","code":32},{"day":"Mon","date":1549823400,"low":76,"high":87,"text":"Mostly Sunny","code":34},{"day":"Tue","date":1549909800,"low":76,"high":89,"text":"Sunny","code":32},{"day":"Wed","date":1549996200,"low":77,"high":88,"text":"Partly Cloudy","code":30},{"day":"Thu","date":1550082600,"low":76,"high":89,"text":"Mostly Sunny","code":34},{"day":"Fri","date":1550169000,"low":76,"high":86,"text":"Sunny","code":32},{"day":"Sat","date":1550255400,"low":76,"high":85,"text":"Sunny","code":32},{"day":"Sun","date":1550341800,"low":74,"high":85,"text":"Sunny","code":32}]}

 

How to extract data of "current_observation"

 

Thanks

I am also trying to extract the "address_components" from the JSON data, but the array index changes if you do not submit an address line for example.

I am trying to get the "sublocality" and "administrative_area_level_1" from the "address_components" below.

The API sample is as follows:

{
   "results" : [
      {
         "access_points" : [],
         "address_components" : [
            {
               "long_name" : "10",
               "short_name" : "10",
               "types" : [ "street_number" ]
            },
            {
               "long_name" : "Gillespie Street",
               "short_name" : "Gillespie St",
               "types" : [ "route" ]
            },
            {
               "long_name" : "South Beach",
               "short_name" : "South Beach",
               "types" : [ "political", "sublocality", "sublocality_level_1" ]
            },
            {
               "long_name" : "Durban",
               "short_name" : "Durban",
               "types" : [ "locality", "political" ]
            },
            {
               "long_name" : "Durban Metro",
               "short_name" : "Durban Metro",
               "types" : [ "administrative_area_level_2", "political" ]
            },
            {
               "long_name" : "KwaZulu-Natal",
               "short_name" : "KZN",
               "types" : [ "administrative_area_level_1", "political" ]
            },
            {
               "long_name" : "South Africa",
               "short_name" : "ZA",
               "types" : [ "country", "political" ]
            },
            {
               "long_name" : "4001",
               "short_name" : "4001",
               "types" : [ "postal_code" ]
            }
         ],
         "formatted_address" : "10 Gillespie St, South Beach, Durban, 4001, South Africa",
         "geometry" : {
            "location" : {
               "lat" : -29.859728,
               "lng" : 31.039773
            },
            "location_type" : "ROOFTOP",
            "viewport" : {
               "northeast" : {
                  "lat" : -29.8583790197085,
                  "lng" : 31.0411219802915
               },
               "southwest" : {
                  "lat" : -29.8610769802915,
                  "lng" : 31.0384240197085
               }
            }
         },
         "place_id" : "ChIJGRCdW0mo9x4RcIwU_7S1xa8",
         "plus_code" : {
            "compound_code" : "42RQ+4W Durban, South Africa",
            "global_code" : "5G2H42RQ+4W"
         },
         "types" : [ "street_address" ]
      }
   ],
   "status" : "OK"
}

If you submit a full address to the API, you can use the hard coded index like below: [7]

$json_a['results'][0]['address_components'][7]['long_name']

But it is not reliable to hard code the index [7] in this case.

So I tested some sample code from above post, it is working, but in some cases it does not return the "long_name" of the "sublocality" or "administrative_admin_level_1":

/* if no address, then the array index change */
//  $json_a['results'][0]['address_components'][7]['long_name']
$area = array();
foreach ($json_a['results'][0]['address_components'] as $addrObj) {
    foreach($addrObj['types'] as $type) {
         if (substr_count($type, 'sublocality')>0) {
             $area['short_name'] = $addrObj['short_name'];
             $area['long_name'] = $addObj['long_name'];
						  // var_dump($addrObj);
         } 
         if (substr_count($type, 'administrative_area_level_1')>0) {
             $area['short_admin'] = $addrObj['short_name'];
             $area['long_admin'] = $addObj['long_name'];
						  var_dump($addrObj);
         } 
    }
}

In the var_dump() I do get the long_name value though: In this sample it must be "Kwazulu-Natal", but from the code above, it returns a NULL value.

array(3) { ["long_name"]=> string(13) "KwaZulu-Natal" ["short_name"]=> string(3) "KZN" ["types"]=> array(2) { [0]=> string(27) "administrative_area_level_1" [1]=> string(9) "political" } } 

Below is the full script I am trying to get to work. The lon, lng and format name is working 100%, it is just this array index problem.

/*  get google result in JSON*/
$googleString = file_get_contents($googleUrl); // get json content
$json_a = json_decode($googleString, true); //json decoder

// response status will be 'OK', if able to geocode given address 
if($json_a['status']=='OK'){
// get the important data
$lati = isset($json_a['results'][0]['geometry']['location']['lat']) ? $json_a['results'][0]['geometry']['location']['lat'] : "";
$longi = isset($json_a['results'][0]['geometry']['location']['lng']) ? $json_a['results'][0]['geometry']['location']['lng'] : "";
$formatted_address = isset($json_a['results'][0]['formatted_address']) ? $json_a['results'][0]['formatted_address'] : "";

/* if no address, then the array index change */
//  $json_a['results'][0]['address_components'][7]['long_name']
$area = array();
foreach ($json_a['results'][0]['address_components'] as $addrObj) {
    foreach($addrObj['types'] as $type) {
         if (substr_count($type, 'sublocality')>0) {
             $area['short_name'] = $addrObj['short_name'];
             $area['long_name'] = $addObj['long_name'];
						  // var_dump($addrObj);
         } 
         if (substr_count($type, 'administrative_area_level_1')>0) {
             $area['short_admin'] = $addrObj['short_name'];
             $area['long_admin'] = $addObj['long_name'];
						  var_dump($addrObj);
         } 
    }
}

Is there a better way to get the "sublocality" and "administrative_area_level_1" from the array $area array above. Any pointers will be much appreciated.

Is it possible to write a php script that would extract data from an external web page. I've been working with php for a few years as a hobby, but I've never seen this done or needed a reason to until now. Thanks in advance for any responses.

 I want to get loop numbers and hyperlinks from other included file function
how to call function that gives me all 1-10 numbers and hyperlinks thanks

Code: [Select]

<?php
include('linksandid.php');
 idlink(); here i want get all numbers and hyperlinks separately  
?>
linksandid.php:
Code: [Select]
<?php
function idlink() {
for($i =1; $i <= 10; $i ++) {
$links = "<a href=\"http://localhost\123.php?page=$i\"> $i</a> ";
}
?>

Hello,

Hello everyone,

I have been trying several things,recently, and I can't figure out how to get a series of numbers, grouped together as a string of number, instead of it adding or grabbing the last number that was randomly generated.

I'm wanting to save it in a variable (of course), so I can pass it though a query when it is needed.


foreach($array as $number){
echo $number;
}


$array is the variable where it is an array but all the randomly generated numbers are stored there.

All / any help would be gratefully appreciated.

This topic has been moved to PHP Regex.

http://www.phpfreaks.com/forums/index.php?topic=350672.0

Hi,

I want to extract weather for 5 cities from www.wunderground.com/global/SB.html and put the field data such as colombo, temprature, humidity and conditions in to a mysql table so I can display the weather for this 5 cities and automatically set a cronjob to update it everyday. Issue is I am unable to extract the specific data from this page.

Please help.

thanks

Geek Friends,

I have list of URLs in an array called '$domains'

1- I want to run through each and every element of $domains in an API call.

API: Quote

http://lightapi.majesticseo.com/api_command.php?app_api_key=API_KEY&cmd=GetIndexItemInfo&items=1&item0=http://www.majesticseo.com


(Note: In this API "http://www.majesticseo.com" will be replaced with each element of $domain array in a loop)


2- The resulting output is XML:
<?xml version="1.0" encoding="utf-8"?>
<Result Code="OK" ErrorMessage="" FullError="">


<GlobalVars IndexBuildDate="17/04/2010 16:43:46" MostRecentBackLinkDate="2010-03-25"/>

<DataTables Count="1">

<DataTable Name="Results" RowsCount="1" Headers="ItemNum|Item|ResultCode|Status|ExtBackLinks|RefDomains|AnalysisResUnitsCost|ACRank|ItemType|IndexedURLs|GetTopBackLinksAnalysisResUnitsCost|RefIPs|RefSubNets|RefDomainsEDU|ExtBackLinksEDU|RefDomainsGOV|ExtBackLinksGOV|RefDomainsEDU_Exact|ExtBackLinksEDU_Exact|RefDomainsGOV_Exact|ExtBackLinksGOV_Exact">


<Row>0|majesticseo.com|OK|Found|28381|1229|28381|-1|1|4774|28381|1074|954|1|5|0|0|0|0|0|0</Row>

</DataTable>



</DataTables>
</Result>



I want to extract the below Elements out of this XML Output for each element of $domains in loop:

Quote

ACRank
ExtBackLinks
RefDomains
AnalysisResUnitsCost
RefIPs
RefSubNets
RefDomainsEDU
ExtBackLinksEDU
RefDomainsGOV
ExtBackLinksGOV
RefDomainsEDU_Exact
ExtBackLinksEDU_Exact
RefDomainsGOV_Exact
ExtBackLinksGOV_Exact
LastCrawlDate
Title




How can i achieve this with PHP?

P.S.: I have a scrapper code, that will scrape data for the array $domains, it best if we can merge this code with that code, so all run in one code only.

Please Letme know and i will PM you that scrapper Code, as i do not want to share that Publically.

Cheers & Enjoy the Snow  ,
Natasha T

Hi,

How do I open all HTML file contained in a folder, then search for the title of the page, and save the title in the database?
Also, is it possible to do this using functions?

Cheers.

Hi guys,

I want to generate reports and i want to use some fields of one table and other fields of another table. How can i use that?

Ex.   customer(customer_id, full_name,name_with_initials, address, contact_number,gender)

       transaction_table(tran_ID, account_number,account_type,transaction_type, amount, Date)


If i want to use only customer_id, tran_ID, full_name and amount how can i use them to generate reports.

I want them to be taken as fields of one table and use it..

Thanks,
Heshan

This topic has been moved to Third Party PHP Scripts.

http://www.phpfreaks.com/forums/index.php?topic=321546.0