Tech Question for Computery Monkeys

Does anyone know an easy way to mass query Rotten Tomatoes, similiar to how you would to a SQL database? So for instance if I have a list of 1000 movie titles and want to quickly pull up their Rotten Tomoatoes ratings or any other data fields (year released, studio, director, writer, etc), is there an easy way to do that without loading each movie one by one on the site? the data is all there...

 

You can program a web scraper to enter the movie titles and search them 1-by-1, then copy the relevant data into an excel sheet.

I might be wrong about this, but I thought Google had some free version of what I described - but it will only do a limited number of loops.

You might be able to download free web scrapers somewhere, but I doubt they have a lot of power.

At a former job of mine, we bought a tool for $10-20k that did this on a large scale to evaluate competitors' data. We would scrape hundreds of thousands of pages from dozens of competitors My suggestions come from this experience.

I'll do what I can to help ya'll. But, the game's out there, and it's play or get played.
 
<span class=keyword_link><a href=/resources/skills/finance/going-concern>Going Concern</a></span>:
Does anyone know an easy way to mass query Rotten Tomatoes, similiar to how you would to a SQL database? So for instance if I have a list of 1000 movie titles and want to quickly pull up their Rotten Tomoatoes ratings or any other data fields (year released, studio, director, writer, etc), is there an easy way to do that without loading each movie one by one on the site? the data is all there...

See if they have an API. I don't know of any programs that will loop and automatically query the data on the website, even if that worked how would you dload it into a flat file? I'd contact them directly or goog search ard

 

thanks guys. i searched for RT web scrapers but i didnt find a ready-made one that i can use for a list of movies.

rottentomatoes do have an API. but, i can't figure out how to use it to pull data for a list of movies, only a single one, and then the output is code not something that's easy to read. it's definitely doable, but seems like you might have to use some sort of javascript or php code that uses the API to loop through each movie's data record, and that is a bit beyond my expertise.

the only API i'm familiar with is the Bloomberg API, and that works as an excel add-in so it's really easy to use within excel.

:(

 
marko:
Time to learn Javascript. http://www.codecademy.com/

Or hire a programmer (costs money and you don't learn anything, though).

bloomberg api is not real api. Yes all you would need to do is run a for loop counter that just queries the dbase and pulls the info into a multi-dimensional arrya that you can then easily spit out into a flat file. It's easy, just google for/loops...or check out www.experts-exchange.com for help on programming questions. You're not writing a new program but think of it more like a stupid excel macro..it's simple...even girls can do it.

 
Best Response
socola2003:
marko:
Time to learn Javascript. http://www.codecademy.com/

Or hire a programmer (costs money and you don't learn anything, though).

bloomberg api is not real api. Yes all you would need to do is run a for loop counter that just queries the dbase and pulls the info into a multi-dimensional arrya that you can then easily spit out into a flat file. It's easy, just google for/loops...or check out www.experts-exchange.com for help on programming questions. You're not writing a new program but think of it more like a stupid excel macro..it's simple...even girls can do it.

hmm yea, i can easily do that in vba, but not as familiar with that using something like javascript. btw, is javascript actually the right thing to use for this?

 
socola2003:
it depends what code you have to use to access the API. For ex w bloomberg you're using excel's built in compiler to access the API...if you send me the link to rotten tomatoes API i can check it out and see if i know what to do..im a comp sci major from penn but haven't really built a lot of code since i was 21..9 yrs ago hehe

respect.

here are two pages that help explain rotten tomatoes api:

http://developer.rottentomatoes.com/docs http://developer.rottentomatoes.com/docs/read/json/v10/examples

also, my "API key" is p3mw5gy2pfvn9j6a99pdwet7

goes without saying, any help is much appreciated.

 
Going Concern:
socola2003:
it depends what code you have to use to access the API. For ex w bloomberg you're using excel's built in compiler to access the API...if you send me the link to rotten tomatoes API i can check it out and see if i know what to do..im a comp sci major from penn but haven't really built a lot of code since i was 21..9 yrs ago hehe

respect.

here are two pages that help explain rotten tomatoes api:

http://developer.rottentomatoes.com/docs http://developer.rottentomatoes.com/docs/read/json/v10/examples

also, my "API key" is p3mw5gy2pfvn9j6a99pdwet7

goes without saying, any help is much appreciated.

lemme take a look and see what i can come up...

 

Debitis ratione veniam non dolore non. Autem ex id consectetur tempora. Rerum quis enim fugit quia. Dignissimos et eum et atque ut vel.

Velit nihil incidunt molestiae. Cum consectetur enim accusamus. Et autem eum non explicabo eius. Voluptatem delectus aut aspernatur quaerat officiis. Aut repellat aut ut provident laudantium recusandae. Voluptatem ut voluptatem similique eos sit aut fuga odio. Quasi delectus unde non sed possimus illum et.

Career Advancement Opportunities

April 2024 Investment Banking

  • Jefferies & Company 02 99.4%
  • Goldman Sachs 19 98.8%
  • Harris Williams & Co. New 98.3%
  • Lazard Freres 02 97.7%
  • JPMorgan Chase 03 97.1%

Overall Employee Satisfaction

April 2024 Investment Banking

  • Harris Williams & Co. 18 99.4%
  • JPMorgan Chase 10 98.8%
  • Lazard Freres 05 98.3%
  • Morgan Stanley 07 97.7%
  • William Blair 03 97.1%

Professional Growth Opportunities

April 2024 Investment Banking

  • Lazard Freres 01 99.4%
  • Jefferies & Company 02 98.8%
  • Goldman Sachs 17 98.3%
  • Moelis & Company 07 97.7%
  • JPMorgan Chase 05 97.1%

Total Avg Compensation

April 2024 Investment Banking

  • Director/MD (5) $648
  • Vice President (19) $385
  • Associates (87) $260
  • 3rd+ Year Analyst (14) $181
  • Intern/Summer Associate (33) $170
  • 2nd Year Analyst (66) $168
  • 1st Year Analyst (205) $159
  • Intern/Summer Analyst (146) $101
notes
16 IB Interviews Notes

“... there’s no excuse to not take advantage of the resources out there available to you. Best value for your $ are the...”

Leaderboard

success
From 10 rejections to 1 dream investment banking internship

“... I believe it was the single biggest reason why I ended up with an offer...”