Does anyone know an easy way to mass query Rotten Tomatoes, similiar to how you would to a SQL database? So for instance if I have a list of 1000 movie titles and want to quickly pull up their Rotten Tomoatoes ratings or any other data fields (year released, studio, director, writer, etc), is there an easy way to do that without loading each movie one by one on the site? the data is all there...
Trending Content - Off Topic Forum
Career Resources
.
You can program a web scraper to enter the movie titles and search them 1-by-1, then copy the relevant data into an excel sheet.
I might be wrong about this, but I thought Google had some free version of what I described - but it will only do a limited number of loops.
You might be able to download free web scrapers somewhere, but I doubt they have a lot of power.
At a former job of mine, we bought a tool for $10-20k that did this on a large scale to evaluate competitors' data. We would scrape hundreds of thousands of pages from dozens of competitors My suggestions come from this experience.
See if they have an API. I don't know of any programs that will loop and automatically query the data on the website, even if that worked how would you dload it into a flat file? I'd contact them directly or goog search ard
thanks guys. i searched for RT web scrapers but i didnt find a ready-made one that i can use for a list of movies.
rottentomatoes do have an API. but, i can't figure out how to use it to pull data for a list of movies, only a single one, and then the output is code not something that's easy to read. it's definitely doable, but seems like you might have to use some sort of javascript or php code that uses the API to loop through each movie's data record, and that is a bit beyond my expertise.
the only API i'm familiar with is the Bloomberg API, and that works as an excel add-in so it's really easy to use within excel.
:(
Time to learn Javascript. http://www.codecademy.com/
Or hire a programmer (costs money and you don't learn anything, though).
bloomberg api is not real api. Yes all you would need to do is run a for loop counter that just queries the dbase and pulls the info into a multi-dimensional arrya that you can then easily spit out into a flat file. It's easy, just google for/loops...or check out www.experts-exchange.com for help on programming questions. You're not writing a new program but think of it more like a stupid excel macro..it's simple...even girls can do it.
hmm yea, i can easily do that in vba, but not as familiar with that using something like javascript. btw, is javascript actually the right thing to use for this?
it depends what code you have to use to access the API. For ex w bloomberg you're using excel's built in compiler to access the API...if you send me the link to rotten tomatoes API i can check it out and see if i know what to do..im a comp sci major from penn but haven't really built a lot of code since i was 21..9 yrs ago hehe
respect.
here are two pages that help explain rotten tomatoes api:
http://developer.rottentomatoes.com/docs http://developer.rottentomatoes.com/docs/read/json/v10/examples
also, my "API key" is p3mw5gy2pfvn9j6a99pdwet7
goes without saying, any help is much appreciated.
lemme take a look and see what i can come up...
hey i figured it out...the API i have will query about 1500 movies and spit out into a flat file csv. PM me if you want the file or want to get the movie info using your list.
Porro explicabo numquam iste fugit illum. Tenetur illo enim totam dolores. A a quisquam amet. Cumque voluptates commodi dolorem mollitia ad mollitia sunt rem. Vero quia ipsum culpa qui et at. Fugit non qui nemo sed minus quis. Incidunt dicta delectus voluptatem quia sit quis assumenda dolorum.
Culpa doloremque odio rerum accusamus. Quae minus culpa ut tenetur ratione et quis. Sed ut veritatis provident voluptatibus nihil qui.
See All Comments - 100% Free
WSO depends on everyone being able to pitch in when they know something. Unlock with your email and get bonus: 6 financial modeling lessons free ($199 value)
or Unlock with your social account...