Gathering data using twitter search API

So part of my university project is to collect data from twitter for processing (mainly using the natural language toolkit). I am supposed to collect random samplings for specific hashtags and saving them into a mySQL database.

I have been reading articles online and it seems like Python is rather popular for this kind of thing. However, I can't figure out how to practically do it. could anyone write some sample code that can be used to harvest this data? or point me in the right direction? I have been reading the twitter API documentation have have a somewhat ok idea of how it works.


-------------Problems Reply------------

A quick Google search for "python twitter api getting started" yields the following:

The Twitter docs also list quite a few Python libraries. Tweepy seems to be quite popular.

Category:python Views:0 Time:2011-11-07

Related post

  • How can I use the Twitter Search API to return all tweets that match my search query, posted only within the last five seconds? 2008-10-15

    I would like to use the API to return all tweets that match my search query, but only tweets posted within the last five seconds. With Twitter's Search API, I can use the since_id to grab all tweets from a specific ID. However, I can't really see a g

  • How to get more than 20 results with the Twitter Search API 2010-12-16

    I'm using the Twitter Search API ( to retrieve tweets for specific search terms from Twitter. It seems however that there is a limit of 20 tweets per result or some kind of date limit. Does anyone know of a way t

  • Twitter search API suddenly stopped returning results 2011-07-27

    I've been using the Twitter search api and PHP to pull in tweets from my account: (using simplexml and caching the feed so I'm only calling to twitter once and hour) It's been working fine for ab

  • Search button - Twitter Search API 2011-10-01

    I'm trying to create a button that takes a subject you've typed in and pulls the relevant tweets using the Twitter Search API. I've seen something similar with the jTwitter plugin, but I'm not sure on how to do it myself, and can't seem to find any d

  • How to get location of Tweets with Twitter search API 2011-11-18

    The statuses/user_timeline part of the Twitter API returns geolocation data as "place" along with each Tweet. The search API, on the other hand, does not return this location data (as far as I can tell). Is there a way to get location data with the s

  • Twitter search API with location 2010-01-28

    I want to execute a Location-based Twitter search using the location operator --------------Solutions------------- You can use the geocode parameter referenced here: Or you can use the near

  • Twitter search API VS Operators 2010-03-21

    I've found this page about the Twitter search API and some operators : But is it possible to make a search like : All posts containing the words "ipod OR ipad" AND all posts containing the words "funny OR joke" in

  • Delay and Inconsistent results using Twitter search API when using "since_id" parameter 2010-04-22

    We've noticed what seems to be a delay and/or inconsistent results using the Twitter Search API when specifying a sinceid in the param clause. For example:[email protected]+b4esummit&q=&result_type=

  • What is the source: attribute of a tweet sent from a tweet button using the Twitter Search API? 2011-04-11

    I'm trying to use Twitter search to find all mentions of a word that DIDN'T come from a "tweet this" button. I'm trying to build a stream of all brand mentions, but I don't want to sift through all of the retweets coming from our blog, which uses Twi

  • question regarding twitter search api 2011-05-03

    I want to use the twitter search api to search for some famous person. For instance I want to search for a particular "Mr Patrick Lee C K". I would construct my search term to be something like:

  • Twitter Search API rate limit 2011-06-24

    I'm using the Twitter search API (for example: I read here: this: We do not rate limit the search API under ordinary circumstances, however we h

  • How to get required number of entries using Twitter Search API 2011-06-29

    I am using Twitter Search API to get 10 entries for a particular search term. I issued: But I am getting only 5 entries. Is there anyway I can resolve this which doesn't require authenticat

  • Require your help for Twitter Search API 2011-07-04

    As there are 2 response format(Atom and Json) from Twitter search api, i am trying to fetch the twits(Json format) by using the URL:[], but you know it is returning only 1 page with 15 twits at a ti

  • Twitter Search API - NetworkError: 405 Method Not Allowed 2011-09-15

    I was following this tutorial on how to parse twitter search api requests with jquery. The code in the post uses a search box for the user to enter the search term and what I simply want

  • Twitter search API results results['text'] value does not have the a href tags 2011-10-12

    Twitter search API results returned like the below values ( [source] => <a href="">web</a> [text] => #prabhu linked into #apptivo via [to_user_id] => [to_user_id_str] => ) Here, [text] =

  • Any way to get past Twitter search API 6-9 day limit 2012-01-19

    I have the Twitter search API working in my Rails 3 app. If I tweet with a specific hashtag I can render the tweet in my view just fine. However, I tweeted with the same hashtag a week ago and it isn't included in my search results. I know there is a

  • Twitter Search Api to find exact results 2012-01-28

    I am using twitter search api I want to search for a word (exact match) and count the no of mentions or hashtags of that word (exact match). I have tried q="json" OR #json OR @json but they retun something li

  • How can you use the Twitter search API from an app hosted in another cloud? 2012-02-24

    This is a question regarding the undocumented limits that Twitter will impose for overusing their search API. This app resides on and therefore shares physical IP addresses with potentially large numbers of users in a multi-tenant architect

  • Twitter Search API - PHP multiple word search not working 2012-04-28

    I have a simple search bar, user types in a search terms and tweets that match the search terms should show up. However, it only works for single word searches. <div id="search"> <form action="" method="get"> <label> Search: <inp

Copyright (C), All Rights Reserved.

processed in 0.141 (s). 11 q(s)