MassMine — Social Media Mining
https://www.ispeech.org
MassMine is a social media mining and archiving application that simplifies the process of collecting and managing large amounts of data across multiple sources. It is designed with the researcher in mind, providing a flexible framework for tackling individualized research needs. MassMine is designed to run both on personal computers and dedicated servers/clusters. MassMine handles credential authorizations, rate limiting, data acquisition & archiving, as well as customized data export and analysis.
[adsense size='1']
With MassMine You Can:
- Automate access to social media and web data through a flexible interface. MassMine runs on personal computers and headless environments such as dedicated servers.
- Collect current and past data from sources such as Twitter, Facebook, Google trends, and Wikipedia. Your data is stored on your own machine.
- Process and analyze your data to satisfy exploratory and targeted investigations of social media trends and network connectivity.
MassMine is a research tool designed to simplify the collection and use of data from social media outlets.
Specifically, MassMine:
- Is designed for use on personal computers or on servers/clusters.
- Handles the acquisition of data from sites such as Twitter, Wikipedia, etc., including rate limits imposed by these services.
- Makes setting up custom data requests easy, allowing for flexible deployment for individualized research needs.
- Creates and manages databases of collected data automatically. This means that all tweets, trends, posts, etc. related to your research questions are saved permanently on your local hard drive.
- Is designed for long-running data collection projects. MassMine makes it easy to create your own database of social media content spanning days, months, or years.
- Balances ease of use with powerful flexibility:
- Offers access to social media APIs.
- Designed for the non-programmer looking to get into big data research, but offers additional functionality for power users.
[adsense size='1']
Installation
Unpack the downloaded file, replacing all “x.x.x” with the version number you downloaded:
For zipped packages
unzip massmine-x.x.x-linux-x86_64.zip
For tarballs
tar -xzf massmine-x.x.x-linux-x86_64.tar.gz
Either of the above commands will produce a directory called “massmine”. This is all you need to get working! Move this directory to somewhere in your file system for safe keeping.
Inside the directory “massmine” you will find an executable file called massmine. You can run this directly to get started right away. Working from inside the “massmine” directory:
./massmine --help
Even better, make the massmine command available from anywhere on your computer by creating a symbolic link to the executable somewhere on your path. Again, working from within the “massmine” directory, run:
ln -s `pwd`/massmine /usr/local/bin
You may need administrator privileges for that last command, in which case try:
sudo ln -s `pwd`/massmine /usr/local/bin
That’s it! You’re ready to use massmine.
Use The Source
Grab the code:
git clone https://github.com/n3mo/massmine.git
This project is currently in beta form.
Although compatibility-breaking changes are unlikely to occur, upcoming version 1.0.0 will mark the first stable release
[adsense size='1']
Getting Help
MassMine ships with built-in help to familiarize users with features. See what options are available to you with
massmine --help
Usage: massmine ... [options...] -h, --help Help information -v, --version Version information -p, --project=NAME Create project -a, --auth=FILE Credentials file -o, --output=FILE Write to file -t, --task=TASK Task name -q, --query=QUERY Query string -c, --count=NUM Number of records -d, --dur=SECOND Max runtime -g, --geo=LOCATION Location -l, --lang=LANG Language -u, --user=NAME Screen name --date=YYYYMMDD Date (or date range) --config=FILE Config file --no-splash Inhibit splash screen
Gloss