Tech Question for Computery Monkeys

Does anyone know an easy way to mass query Rotten Tomatoes, similiar to how you would to a SQL database? So for instance if I have a list of 1000 movie titles and want to quickly pull up their Rotten Tomoatoes ratings or any other data fields (year released, studio, director, writer, etc), is there an easy way to do that without loading each movie one by one on the site? the data is all there...

 

You can program a web scraper to enter the movie titles and search them 1-by-1, then copy the relevant data into an excel sheet.

I might be wrong about this, but I thought Google had some free version of what I described - but it will only do a limited number of loops.

You might be able to download free web scrapers somewhere, but I doubt they have a lot of power.

At a former job of mine, we bought a tool for $10-20k that did this on a large scale to evaluate competitors' data. We would scrape hundreds of thousands of pages from dozens of competitors My suggestions come from this experience.

I'll do what I can to help ya'll. But, the game's out there, and it's play or get played.
 
<span class=keyword_link><a href=/resources/skills/finance/going-concern>Going Concern</a></span>:
Does anyone know an easy way to mass query Rotten Tomatoes, similiar to how you would to a SQL database? So for instance if I have a list of 1000 movie titles and want to quickly pull up their Rotten Tomoatoes ratings or any other data fields (year released, studio, director, writer, etc), is there an easy way to do that without loading each movie one by one on the site? the data is all there...

See if they have an API. I don't know of any programs that will loop and automatically query the data on the website, even if that worked how would you dload it into a flat file? I'd contact them directly or goog search ard

 

thanks guys. i searched for RT web scrapers but i didnt find a ready-made one that i can use for a list of movies.

rottentomatoes do have an API. but, i can't figure out how to use it to pull data for a list of movies, only a single one, and then the output is code not something that's easy to read. it's definitely doable, but seems like you might have to use some sort of javascript or php code that uses the API to loop through each movie's data record, and that is a bit beyond my expertise.

the only API i'm familiar with is the Bloomberg API, and that works as an excel add-in so it's really easy to use within excel.

:(

 
marko:
Time to learn Javascript. http://www.codecademy.com/

Or hire a programmer (costs money and you don't learn anything, though).

bloomberg api is not real api. Yes all you would need to do is run a for loop counter that just queries the dbase and pulls the info into a multi-dimensional arrya that you can then easily spit out into a flat file. It's easy, just google for/loops...or check out www.experts-exchange.com for help on programming questions. You're not writing a new program but think of it more like a stupid excel macro..it's simple...even girls can do it.

 
Best Response
socola2003:
marko:
Time to learn Javascript. http://www.codecademy.com/

Or hire a programmer (costs money and you don't learn anything, though).

bloomberg api is not real api. Yes all you would need to do is run a for loop counter that just queries the dbase and pulls the info into a multi-dimensional arrya that you can then easily spit out into a flat file. It's easy, just google for/loops...or check out www.experts-exchange.com for help on programming questions. You're not writing a new program but think of it more like a stupid excel macro..it's simple...even girls can do it.

hmm yea, i can easily do that in vba, but not as familiar with that using something like javascript. btw, is javascript actually the right thing to use for this?

 
socola2003:
it depends what code you have to use to access the API. For ex w bloomberg you're using excel's built in compiler to access the API...if you send me the link to rotten tomatoes API i can check it out and see if i know what to do..im a comp sci major from penn but haven't really built a lot of code since i was 21..9 yrs ago hehe

respect.

here are two pages that help explain rotten tomatoes api:

http://developer.rottentomatoes.com/docs http://developer.rottentomatoes.com/docs/read/json/v10/examples

also, my "API key" is p3mw5gy2pfvn9j6a99pdwet7

goes without saying, any help is much appreciated.

 
Going Concern:
socola2003:
it depends what code you have to use to access the API. For ex w bloomberg you're using excel's built in compiler to access the API...if you send me the link to rotten tomatoes API i can check it out and see if i know what to do..im a comp sci major from penn but haven't really built a lot of code since i was 21..9 yrs ago hehe

respect.

here are two pages that help explain rotten tomatoes api:

http://developer.rottentomatoes.com/docs http://developer.rottentomatoes.com/docs/read/json/v10/examples

also, my "API key" is p3mw5gy2pfvn9j6a99pdwet7

goes without saying, any help is much appreciated.

lemme take a look and see what i can come up...

 

Dolor occaecati consequatur libero officia earum sed odio. Quisquam et alias nobis eum. Velit voluptatem quis aut impedit delectus sed similique. Sint reprehenderit dicta maiores et rerum. Facere cumque cum nisi. Et consequatur temporibus iure.

Beatae magni hic iste voluptatibus consectetur delectus fugit. Non esse nostrum earum et enim. Et non quia sit nobis unde natus aperiam et. Ipsum aspernatur a quae id. Cum qui voluptatem corporis qui quod. Vitae ut quia dignissimos consequatur. Accusamus atque non velit cum id.

Aperiam tempore error fugiat consequuntur quae molestiae. Repellendus eos eaque ipsum quo aperiam. Saepe placeat rerum minus cum voluptatibus.

Career Advancement Opportunities

April 2024 Investment Banking

  • Jefferies & Company 02 99.4%
  • Goldman Sachs 19 98.8%
  • Harris Williams & Co. New 98.3%
  • Lazard Freres 02 97.7%
  • JPMorgan Chase 03 97.1%

Overall Employee Satisfaction

April 2024 Investment Banking

  • Harris Williams & Co. 18 99.4%
  • JPMorgan Chase 10 98.8%
  • Lazard Freres 05 98.3%
  • Morgan Stanley 07 97.7%
  • William Blair 03 97.1%

Professional Growth Opportunities

April 2024 Investment Banking

  • Lazard Freres 01 99.4%
  • Jefferies & Company 02 98.8%
  • Goldman Sachs 17 98.3%
  • Moelis & Company 07 97.7%
  • JPMorgan Chase 05 97.1%

Total Avg Compensation

April 2024 Investment Banking

  • Director/MD (5) $648
  • Vice President (19) $385
  • Associates (87) $260
  • 3rd+ Year Analyst (14) $181
  • Intern/Summer Associate (33) $170
  • 2nd Year Analyst (66) $168
  • 1st Year Analyst (205) $159
  • Intern/Summer Analyst (146) $101
notes
16 IB Interviews Notes

“... there’s no excuse to not take advantage of the resources out there available to you. Best value for your $ are the...”

Leaderboard

1
redever's picture
redever
99.2
2
Betsy Massar's picture
Betsy Massar
99.0
3
BankonBanking's picture
BankonBanking
99.0
4
Secyh62's picture
Secyh62
99.0
5
CompBanker's picture
CompBanker
98.9
6
kanon's picture
kanon
98.9
7
GameTheory's picture
GameTheory
98.9
8
dosk17's picture
dosk17
98.9
9
DrApeman's picture
DrApeman
98.8
10
bolo up's picture
bolo up
98.8
success
From 10 rejections to 1 dream investment banking internship

“... I believe it was the single biggest reason why I ended up with an offer...”