nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Use JSL to get data from the web

uday_guntupalli

Hello All,

After looking at this discussion (Use JSL to Scrape Data From the Web and Predict Football Wins!) - I got very excited about the # of data sets available online to enhance my JSL skills. However - I haven't had much success after trying the code provided in this post. I tried to write to the author and am still waiting to hear back. If some one has done this before - can someone - please show how to get data from the web .

Lets say For E.g. I want to get the stock price for Twitter , its 52 - week low , 52-week high and current price - how can I do that in JSL .

Any inputs are appreciated.

Best

uday

Accepted answers

msharp

There are many methods to get data from the web. The best method depends on the data source. In the example you posted, the user is simply using an Open() command and tells it which data table in the HTML to pull. This is by far the easiest, but not always possible. Some sites, like Twitter have set up API's. This method is slightly more complicated but extremely more powerful.

Have you done your research? Do you know where you want to get the stock price information? What's the data source?

All comments

msharp

Have you done your research? Do you know where you want to get the stock price information? What's the data source?

uday_guntupalli

msharp,

I have a couple of options that I have looked at :

1. Bar Chart .com

2. Yahoo Finance

3. Google Finance

But I dont know if we need to ping the api's of these websites or if they are accessible as HTML tables.

Best
uday

Jeff_Perkinson

The Yahoo Finance Fetcher JMP Add-in would be a good place to start.

-Jeff

uday_guntupalli

Hello Jeff ,

Thank you . I have already downloaded the addin. my objective is to be able to learn and understand how to do it in JSL and I dont know how to tap in to the code behind the addin . Also - the addin just seems to open the stock information in a browser against importing the data into JMP (which is what I would like to do) . I wish to import the data from these public repositories to further my analytical skills and coding skills in JSL .

Best

Uday

msharp

So, using yahoo finance as an example I show you the two general methods. If you go to any website you can just use the open command and specify the HTML table. This requires the data to be stored in an HTML table.

Below that, I show you the yahoo finance table.csv api. Adding s=TWTR to the end will create a CSV file for all the twitter data you could then play with in JMP. If you want to know more about the api, this page is helpful.

Yahoo Finance (hidden) API | Ido Green

//Just browsing the web, was able to get these tables

open("http://finance.yahoo.com/echarts?s=TWTR#{\!"allowChartStacking\!":true}", HTML Table(2));

open("http://finance.yahoo.com/q;_ylt=AwrXgiOYWBFXxGUAYiiTmYlQ;_ylu=X3oDMTE0bWJta2VyBGNvbG8DZ3ExBHBvcwMxBHZ0aWQDVklEUUJDS18xBHNlYwNzYw--?s=TWTR", HTML Table(2));

open("http://finance.yahoo.com/q;_ylt=AwrXgiOYWBFXxGUAYiiTmYlQ;_ylu=X3oDMTE0bWJta2VyBGNvbG8DZ3ExBHBvcwMxBHZ0aWQDVklEUUJDS18xBHNlYwNzYw--?s=TWTR", HTML Table(3));

//This is the yahoo finance api interface

open("http://ichart.finance.yahoo.com/table.csv?s=TWTR");

uday_guntupalli

@msharp:

I seem to get the same error as I did when I tried to use the Open command earlier. Does this have anything to do with the settings ?

theresagoodyear

Hi Uday.

I was interested in getting football data from the web as well after attending that seminar in San Diego. I created the attached script and got quarterback data from espn.com. I figured out I could get historical data simply be replacing the link with the corresponding year. Once I got historical data and concatenated it, I ran a regression analysis and found that 'passing yards' is the biggest contributor to the quarterback's rank on the ESPN top QB list.

I've modeled other analysis after this one. Hope this helps. Thank you.

Football_Table_Open.jsl

uday_guntupalli

theresagoodyear : Thanks for sharing the script and analysis Theresa. I think the primary issue that has plagued me in this context has been that I have network related issues as Craige and MSharp have previously assessed. My network has been redirecting me out of the web when ever I try to access it through JSL. Once I am able to get through to the data - it will be a great experience to start looking at your work and learning what ever is helpful and incorporating those concepts